-- Logs begin at Wed 2022-07-20 18:35:06 UTC, end at Wed 2022-07-20 19:43:43 UTC. -- Jul 20 19:09:37.737399 dv-cinder-819149-14-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 20 19:09:37.749715 dv-cinder-819149-14-smb devstack@keystone.service[80225]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 20 19:09:37.749715 dv-cinder-819149-14-smb devstack@keystone.service[80225]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 19:09:37 2022] *** Jul 20 19:09:37.749715 dv-cinder-819149-14-smb devstack@keystone.service[80225]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 19:09:37.749715 dv-cinder-819149-14-smb devstack@keystone.service[80225]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 19:09:37.749715 dv-cinder-819149-14-smb devstack@keystone.service[80225]: nodename: dv-cinder-819149-14-smb Jul 20 19:09:37.749715 dv-cinder-819149-14-smb devstack@keystone.service[80225]: machine: x86_64 Jul 20 19:09:37.749715 dv-cinder-819149-14-smb devstack@keystone.service[80225]: clock source: unix Jul 20 19:09:37.749715 dv-cinder-819149-14-smb devstack@keystone.service[80225]: pcre jit disabled Jul 20 19:09:37.749715 dv-cinder-819149-14-smb devstack@keystone.service[80225]: detected number of CPU cores: 4 Jul 20 19:09:37.749715 dv-cinder-819149-14-smb devstack@keystone.service[80225]: current working directory: / Jul 20 19:09:37.749715 dv-cinder-819149-14-smb devstack@keystone.service[80225]: detected binary path: /usr/bin/uwsgi-core Jul 20 19:09:37.749715 dv-cinder-819149-14-smb devstack@keystone.service[80225]: your processes number limit is 47680 Jul 20 19:09:37.749715 dv-cinder-819149-14-smb devstack@keystone.service[80225]: your memory page size is 4096 bytes Jul 20 19:09:37.749715 dv-cinder-819149-14-smb devstack@keystone.service[80225]: detected max file descriptor number: 2048 Jul 20 19:09:37.749715 dv-cinder-819149-14-smb devstack@keystone.service[80225]: lock engine: pthread robust mutexes Jul 20 19:09:37.749715 dv-cinder-819149-14-smb devstack@keystone.service[80225]: thunder lock: enabled Jul 20 19:09:37.749715 dv-cinder-819149-14-smb devstack@keystone.service[80225]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 20 19:09:37.749715 dv-cinder-819149-14-smb devstack@keystone.service[80225]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 19:09:37.792555 dv-cinder-819149-14-smb devstack@keystone.service[80225]: Python main interpreter initialized at 0x5617ad8829c0 Jul 20 19:09:37.792555 dv-cinder-819149-14-smb devstack@keystone.service[80225]: python threads support enabled Jul 20 19:09:37.792555 dv-cinder-819149-14-smb devstack@keystone.service[80225]: your server socket listen backlog is limited to 100 connections Jul 20 19:09:37.792555 dv-cinder-819149-14-smb devstack@keystone.service[80225]: your mercy for graceful operations on workers is 90 seconds Jul 20 19:09:37.792902 dv-cinder-819149-14-smb devstack@keystone.service[80225]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 19:09:37.792979 dv-cinder-819149-14-smb devstack@keystone.service[80225]: *** Operational MODE: preforking *** Jul 20 19:09:37.793234 dv-cinder-819149-14-smb devstack@keystone.service[80225]: *** uWSGI is running in multiple interpreter mode *** Jul 20 19:09:37.793234 dv-cinder-819149-14-smb devstack@keystone.service[80225]: spawned uWSGI master process (pid: 80225) Jul 20 19:09:37.793470 dv-cinder-819149-14-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 20 19:09:37.794289 dv-cinder-819149-14-smb devstack@keystone.service[80225]: spawned uWSGI worker 1 (pid: 80233, cores: 1) Jul 20 19:09:37.794425 dv-cinder-819149-14-smb devstack@keystone.service[80225]: spawned uWSGI worker 2 (pid: 80234, cores: 1) Jul 20 19:09:37.795566 dv-cinder-819149-14-smb devstack@keystone.service[80225]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 19:09:43.251881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:09:43.251881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: from cryptography.utils import int_from_bytes Jul 20 19:09:43.252707 dv-cinder-819149-14-smb devstack@keystone.service[80234]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:09:43.252707 dv-cinder-819149-14-smb devstack@keystone.service[80234]: from cryptography.utils import int_from_bytes Jul 20 19:09:43.253127 dv-cinder-819149-14-smb devstack@keystone.service[80233]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:09:43.253127 dv-cinder-819149-14-smb devstack@keystone.service[80233]: from cryptography.utils import int_from_bytes Jul 20 19:09:43.253237 dv-cinder-819149-14-smb devstack@keystone.service[80234]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 19:09:43.253237 dv-cinder-819149-14-smb devstack@keystone.service[80234]: from cryptography.utils import int_from_bytes Jul 20 19:09:43.303158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 19:09:43.303349 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 19:09:43.303450 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 19:09:43.303539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 19:09:43.303606 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] command line args: [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 19:09:43.303679 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] command line args: [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 19:09:43.303831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 19:09:43.303927 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 19:09:43.304001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ================================================================================ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 19:09:43.304237 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] admin_token = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.304317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ================================================================================ {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 19:09:43.304510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] admin_token = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.304596 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] config_dir = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.304737 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.304826 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] config_dir = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.304929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.305018 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] config_source = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.305115 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] config_source = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.305195 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] debug = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.305298 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] debug = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.305385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.306675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.306776 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.306853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.306915 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.306979 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.306979 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.307104 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.307164 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.307228 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.307293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] list_limit = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.307353 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.307418 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] log_config_append = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.307478 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_config_append = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.307541 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.307541 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] log_dir = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.307645 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.307709 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] log_file = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.307778 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_dir = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.307838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.307896 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_file = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.307953 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.308016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.308075 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.308143 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.308377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.308454 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.308563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.308563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.308768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.308858 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.308939 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.309064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.309147 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.309292 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.309380 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.309524 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.309603 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.309757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.309879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.309988 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.310080 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.310234 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.310393 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.310541 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.310697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.310845 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.311024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.311201 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.311378 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.311553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] publish_errors = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.311706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.311865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.311865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.312108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.312226 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.312347 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] publish_errors = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.312496 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.312613 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.312733 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.312849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.312981 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] standard_threads = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.313108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.313250 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.313363 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.313527 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.313644 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.313761 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.313761 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] use_journal = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.313982 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] standard_threads = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.314094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] use_json = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.314216 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.314356 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] use_stderr = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.314474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.314626 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] use_syslog = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.314746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.314861 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.314985 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] use_journal = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.315100 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.315220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] use_json = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.315325 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.315436 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] use_stderr = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.315436 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] use_syslog = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.315664 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.315779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 19:09:43.315898 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.316015 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.316134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.316254 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.316377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.316493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.316606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.316719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.316831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.316950 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.317073 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.317222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.317369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.317482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.317601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.317716 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.317837 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.317952 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.318065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.318179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.318292 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.318423 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.318549 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.318673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.318791 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.318890 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.318985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.319086 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.319266 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.319388 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.319504 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.319617 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.319736 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.319851 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.319979 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.320100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.320216 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.320334 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.320448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.320568 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.320693 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.320808 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.320921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.321034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.321152 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.321267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.321389 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.321504 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.321617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.321729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.321842 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.321967 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.322082 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.322195 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.322376 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.322504 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.322626 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.322751 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.322872 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.322986 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.323099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.323212 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.323326 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.323447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.323562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.323675 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.323793 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.323906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.324019 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.324140 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.324261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.324862 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.324985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.325099 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.325212 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.325404 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.325522 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.325642 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.325756 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.325870 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.325983 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.325983 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.326215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.326344 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.326460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.326573 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.326686 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.326812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.326928 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.327048 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.327162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.327276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.327389 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.327511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.327625 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.327748 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.327867 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.327981 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.328095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.328200 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.328297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.328392 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.328494 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.328591 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.328716 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.328832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.328932 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.329028 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.329124 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.329226 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.329322 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.329429 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.329502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.329608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.330037 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.330160 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.330285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.330462 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.330594 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.330713 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.330836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.330953 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.331059 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.331172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.331295 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.331411 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.331526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.331654 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.331772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.331887 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.331992 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.332116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.332233 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.332354 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.332470 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.332575 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.332696 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.332813 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.332912 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.333026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.333130 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.333234 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.333340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.333438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.333551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.333666 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.333787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.333902 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.334015 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.334119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.334232 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.334360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.334477 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.334592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.334719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.334837 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.334952 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.335067 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.335181 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.335296 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.335418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.335418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.335634 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.335634 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.335855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.335973 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.336095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.336212 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.336326 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.336441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.336555 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.336670 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.336862 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.336981 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.337096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.337210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.337325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.337439 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.337563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.337750 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.337883 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.338002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.338117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.338231 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.338372 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.338502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.338628 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.338744 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.338859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.338974 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.339097 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.339213 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.339344 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.339461 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.339575 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.339690 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.339811 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.339935 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.340103 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.340734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.340853 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.340969 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] auth.external = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.341084 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.341210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.341327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.341443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.341559 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.341674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.341798 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.341924 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] auth.password = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.342069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.external = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.342205 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] auth.token = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.342351 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.342472 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.342472 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.342690 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.342807 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.342807 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.343035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.343151 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.343151 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.343369 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.password = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.343484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.343484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] credential.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.343716 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] auth.token = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.343833 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.343833 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.344060 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.344178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.344178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.344406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.344522 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.344522 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.344739 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.344854 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.344983 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.345101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.345101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.345327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.345445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.345445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.345674 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.345792 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.345792 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.346009 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.346138 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.346138 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.346427 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.346547 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.346664 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.346781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.346781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.347006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.347135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.348629 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.348766 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.348886 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.349010 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.349129 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.349255 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.349374 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.349374 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.349594 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.349711 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.349828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.349953 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.350072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.351141 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.351263 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.351381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.351499 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.351626 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.351746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.351863 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.351980 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.351980 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.352198 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.352323 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.352442 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.352558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.352677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.352677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.352900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.353024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.353150 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.353269 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.353386 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.355642 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.355873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.356004 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.356004 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.356231 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.356349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.356466 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.356594 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.356712 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.356829 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.356947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.357063 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.357179 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.357305 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.357423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.357539 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.357655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.357772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.357887 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.358018 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.358137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.358254 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.358391 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.358509 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.360703 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.360849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.360970 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.361090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.361208 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.361326 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.361443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.361569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.361687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.361804 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.361921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.362038 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.362156 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.362282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.362446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.362563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.362563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.362782 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.362899 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.363028 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.363147 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.363265 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.363382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.363498 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.363614 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.363740 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.363858 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.363975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.364090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.364216 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.364334 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.364459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.364577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.365239 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.365239 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.365470 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.365588 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.365715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.365834 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.365950 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.366067 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.366184 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.366184 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.366456 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.366576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.366694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.366810 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.366926 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.367043 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.367168 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.367294 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.367413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.367531 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.367654 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.367771 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.367896 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.368020 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.368139 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.368263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.368381 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.368499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.368499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.368727 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.368844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.368968 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.369086 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.369203 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.369328 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.369452 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.369571 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.369687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.369804 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.369804 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.370100 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.370235 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.370380 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.370500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.370616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.370744 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.370863 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.370980 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.371096 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.371233 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.371355 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.371481 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.371621 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.371739 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.371856 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.371972 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.372089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.372213 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.372331 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.372448 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.372565 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.372682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.372799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.372923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.373040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.373157 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.373274 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.373390 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.373507 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.373507 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.373739 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.373739 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.373957 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.373957 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.374175 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.374313 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.374433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.374550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.374666 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.374794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.374903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.375027 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.375145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.375268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.375385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.375501 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.375617 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.375742 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.375860 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.375977 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.376092 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.376208 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.376325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.376449 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.376568 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.376684 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.376808 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.376925 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.377042 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.377167 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.377285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.377401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.377517 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.377632 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.377748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.377874 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.377992 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.378107 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.378223 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.378391 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.378540 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.378708 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.378892 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.379081 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.379275 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.379405 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.379522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.379649 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.379768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.379892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.380016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.380135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.380251 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.380376 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.380495 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.380611 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.380728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.380845 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] role.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.380962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.381088 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] role.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.381207 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.381324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.381441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.381558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.381675 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.381871 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.381993 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.382111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.382229 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.382360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.382479 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.382608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.382727 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.382727 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.382946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.383062 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.383179 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.383303 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.383421 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.383536 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.383651 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.383786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] role.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.383913 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.384031 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] role.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.384149 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.384266 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.384382 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.384499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.384625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.384743 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.384743 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.384961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.385076 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.385194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.385319 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.385437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.385553 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.385669 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.385786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.385902 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.386026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.386144 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.386263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.386426 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.386544 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.386660 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.386790 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.387416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.387416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.387636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.387752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.387868 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.387994 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.387994 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.387994 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.388303 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.388418 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.388534 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.388658 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.388775 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.388891 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.389007 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.389123 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.389238 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.389362 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.389480 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.389596 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.389712 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.389828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.389951 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.390069 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.390192 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.390324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.390444 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.390563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.390691 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.390810 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.390926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.391042 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.391158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.391274 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.391399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.391518 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.391635 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.391750 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.391867 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.391982 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.392107 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.392225 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.392341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.392457 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.392575 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.392691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.392815 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.392934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.393050 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.393166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.393282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.393397 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.393522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.393641 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.393757 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.393910 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.connection = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.394116 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.394349 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.394476 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.394594 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.394727 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.394847 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.394965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.395082 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.395199 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.395316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.395441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.395560 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.395677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.395793 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.395910 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.396025 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.396150 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.396269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.396385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.396502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.396618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.396736 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.396861 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.396979 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.397097 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.397214 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.397214 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.397440 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.397567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.397697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.397816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.397934 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.398051 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.398168 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.398285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.398432 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.398551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80233) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 19:09:43.398668 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.398668 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.398668 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.398668 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.398668 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.398668 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.398668 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.398668 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.398668 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.399601 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.399601 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.399601 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.399601 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.399601 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 19:09:43.399601 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80234) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 19:09:43.421944 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.422171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.422420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.423954 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.424189 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.424414 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.431013 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.432880 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.460214 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.460411 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.461676 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.461907 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.603982 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.604592 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.653256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.653571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.653919 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.654153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.720159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.720358 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.720583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.720801 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.721017 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.721205 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.721293 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.721433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.721651 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.721866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.722079 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.722392 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.747137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.747363 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.747452 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.747587 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.747673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.747805 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.747898 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.748018 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.748103 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.748228 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.748312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.748438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.748532 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.748677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.759907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.760891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.773470 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.773644 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.773728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.773805 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.773905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.773991 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.774124 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.774210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.774372 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.774460 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.774589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.774673 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.774801 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80233) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.774886 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80234) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 19:09:43.792326 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.792532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 19:09:43.792618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.792814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 19:09:43.792898 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.793049 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 19:09:43.793662 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.793825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.793907 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 19:09:43.794081 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.794166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.794356 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.794443 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.794609 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.794703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.794858 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.805744 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.805884 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.806013 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.806157 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.806257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.806456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.806544 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.806738 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.815293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.815404 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.818647 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.818743 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.818920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.819005 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.819307 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.819393 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.819586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.819668 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.819862 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.819955 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.820118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.820201 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.820379 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.820463 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.820648 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.820739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.820909 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.820991 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.821175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.821257 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.821434 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.821516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.847883 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.848009 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.849426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.849529 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.849701 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.849791 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.854977 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.855076 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.855250 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.855350 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.855525 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.856093 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.863342 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.863444 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.863621 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.863710 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.868204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.868294 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.868487 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.868588 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.868766 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.868851 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.869037 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.869122 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.869304 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.869398 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.869569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.869655 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.869830 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.869929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.870089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.870180 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.889299 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.889573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.892201 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.892481 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.894142 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.897800 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.898089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.898412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.902037 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.902336 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.903157 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.906800 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.907502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.910831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.911124 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.911402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.911486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.911693 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.911978 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.912250 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.915243 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.915608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.915912 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.916192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.916465 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.916737 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.931860 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.932263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.932533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.932794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.937075 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.937470 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.937736 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.938001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.941361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.943076 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.943353 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.945916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.946420 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.946706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.946984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.947257 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.947554 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.947640 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.947890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.952913 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.954439 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.954827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.955117 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.955429 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.961075 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.961364 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.961641 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.961929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.962203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.962512 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.962784 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.969063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.969351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.969630 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.969926 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.970186 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.970504 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.970781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.982756 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.986029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.989339 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.990879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.990981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.992576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.992856 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.993141 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.994193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:43.998143 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:43.999786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.001264 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.001428 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:44.001710 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.001999 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.003027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:44.006247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.006551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.006828 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.007096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.009545 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.011362 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:44.014687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.014980 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.015258 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.015527 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.016418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:44.016710 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.016989 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.024847 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:44.025061 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80234) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:44.025168 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.025251 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.025399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.025489 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.025671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.025942 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.026212 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.026515 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.026788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.027059 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.027325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.027677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.028042 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.028419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.028813 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80234) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.044836 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80233) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 19:09:44.045123 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.045397 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.045667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.045932 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.046213 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.046513 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.046786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.047057 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.047320 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.047581 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.047833 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.048091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.048360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80233) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 19:09:44.068235 dv-cinder-819149-14-smb devstack@keystone.service[80234]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5617ad8829c0 pid: 80234 (default app) Jul 20 19:09:44.071925 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5873073-38c8-4573-96df-e7da61c1a81e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:09:44.072218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5873073-38c8-4573-96df-e7da61c1a81e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:09:44.072499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5873073-38c8-4573-96df-e7da61c1a81e None None] PATH_INFO: `/v3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:09:44.076869 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Wed Jul 20 19:09:44 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:09:44.087763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5617ad8829c0 pid: 80233 (default app) Jul 20 19:09:51.894747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64941323-3fba-4731-b7a6-ccff36f5bf06 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:09:51.895292 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64941323-3fba-4731-b7a6-ccff36f5bf06 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:09:51.895292 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64941323-3fba-4731-b7a6-ccff36f5bf06 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:09:51.896591 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:09:51.904595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d763233-c4af-4cea-bda2-86042d5cfc13 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:09:51.905091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d763233-c4af-4cea-bda2-86042d5cfc13 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:09:51.905187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d763233-c4af-4cea-bda2-86042d5cfc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:09:51.975324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: INFO dbcounter [None req-6d763233-c4af-4cea-bda2-86042d5cfc13 None None] Registered counter for database keystone Jul 20 19:09:52.001740 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG oslo_db.sqlalchemy.engines [None req-6d763233-c4af-4cea-bda2-86042d5cfc13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80233) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:09:52.008559 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writer thread running {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:09:52.192621 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG passlib.handlers.bcrypt [None req-6d763233-c4af-4cea-bda2-86042d5cfc13 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80233) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 19:09:52.192956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG passlib.handlers.bcrypt [None req-6d763233-c4af-4cea-bda2-86042d5cfc13 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80233) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 19:09:52.247954 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6d763233-c4af-4cea-bda2-86042d5cfc13 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:09:52.249578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6d763233-c4af-4cea-bda2-86042d5cfc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:09:52.372538 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1/3] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:09:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 20 19:09:52.528087 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64941323-3fba-4731-b7a6-ccff36f5bf06 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:09:52.598610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: INFO dbcounter [None req-64941323-3fba-4731-b7a6-ccff36f5bf06 None None] Registered counter for database keystone Jul 20 19:09:52.618834 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG oslo_db.sqlalchemy.engines [None req-64941323-3fba-4731-b7a6-ccff36f5bf06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80234) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 19:09:52.625116 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writer thread running {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 19:09:52.744627 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64941323-3fba-4731-b7a6-ccff36f5bf06 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:09:52.748974 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8426c-ebf1-4cb5-9078-c3372d517303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:09:52.749637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8426c-ebf1-4cb5-9078-c3372d517303 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:09:52.749928 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8426c-ebf1-4cb5-9078-c3372d517303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:09:52.750210 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8426c-ebf1-4cb5-9078-c3372d517303 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:09:52.758461 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8426c-ebf1-4cb5-9078-c3372d517303 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:09:52.810872 dv-cinder-819149-14-smb devstack@keystone.service[80234]: WARNING keystone.common.rbac_enforcer.enforcer [None req-90f8426c-ebf1-4cb5-9078-c3372d517303 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 19:09:52.811152 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8426c-ebf1-4cb5-9078-c3372d517303 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:09:52.821013 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 3/4] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Jul 20 19:09:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 19:09:52.827706 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d763233-c4af-4cea-bda2-86042d5cfc13 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:09:52.845448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d763233-c4af-4cea-bda2-86042d5cfc13 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:09:52.850170 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1b161-6fda-4dcd-8f29-b0ce09618dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:09:52.851312 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1b161-6fda-4dcd-8f29-b0ce09618dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:09:52.851605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1b161-6fda-4dcd-8f29-b0ce09618dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:09:52.851888 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1b161-6fda-4dcd-8f29-b0ce09618dd7 admin admin] PATH_INFO: `/v3/projects/b67a2f849d994ba1b870dbba687449fc` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:09:52.853423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1b161-6fda-4dcd-8f29-b0ce09618dd7 admin admin] RBAC: Authorizing `identity:get_project(project_id=b67a2f849d994ba1b870dbba687449fc)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:09:52.907386 dv-cinder-819149-14-smb devstack@keystone.service[80233]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6ba1b161-6fda-4dcd-8f29-b0ce09618dd7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 19:09:52.907984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1b161-6fda-4dcd-8f29-b0ce09618dd7 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:09:52.912738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 2/5] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Jul 20 19:09:52 2022] GET /identity/v3/projects/b67a2f849d994ba1b870dbba687449fc => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:09:54.924512 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a639f79-fc87-423a-ad87-de450121310d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:09:54.925031 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a639f79-fc87-423a-ad87-de450121310d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:09:54.925031 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a639f79-fc87-423a-ad87-de450121310d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:09:54.929103 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 4/6] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:09:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:09:54.934809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732c50c-e073-404d-8e67-8569d62c5284 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:09:54.935220 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732c50c-e073-404d-8e67-8569d62c5284 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:09:54.935364 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732c50c-e073-404d-8e67-8569d62c5284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:09:54.954181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5732c50c-e073-404d-8e67-8569d62c5284 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:09:54.955752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5732c50c-e073-404d-8e67-8569d62c5284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:09:54.963854 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 3/7] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:09:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 20 19:09:54.987843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a639f79-fc87-423a-ad87-de450121310d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:09:55.000156 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a639f79-fc87-423a-ad87-de450121310d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:09:55.004419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa64ba17-4324-486d-8b97-831e1ff873cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:09:55.005062 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64ba17-4324-486d-8b97-831e1ff873cb admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:09:55.005342 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64ba17-4324-486d-8b97-831e1ff873cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:09:55.005620 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64ba17-4324-486d-8b97-831e1ff873cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:09:55.015890 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64ba17-4324-486d-8b97-831e1ff873cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:09:55.017712 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa64ba17-4324-486d-8b97-831e1ff873cb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:09:55.028198 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 5/8] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Jul 20 19:09:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:09:55.034323 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732c50c-e073-404d-8e67-8569d62c5284 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:09:55.044039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732c50c-e073-404d-8e67-8569d62c5284 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:09:55.048568 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856c1b9-2086-4abb-b1d9-67a3cbe90950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:09:55.049459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856c1b9-2086-4abb-b1d9-67a3cbe90950 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:09:55.049742 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856c1b9-2086-4abb-b1d9-67a3cbe90950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:09:55.050025 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856c1b9-2086-4abb-b1d9-67a3cbe90950 admin admin] PATH_INFO: `/v3/users/b8c2d1f725864ea29520d2932bc19d10` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:09:55.051484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0856c1b9-2086-4abb-b1d9-67a3cbe90950 admin admin] RBAC: Authorizing `identity:get_user(user_id=b8c2d1f725864ea29520d2932bc19d10)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:09:55.053345 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0856c1b9-2086-4abb-b1d9-67a3cbe90950 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:09:55.055009 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 4/9] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Jul 20 19:09:55 2022] GET /identity/v3/users/b8c2d1f725864ea29520d2932bc19d10 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:09:57.196153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297b0a6-68e5-45c1-9fba-2214dd022775 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:09:57.196697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297b0a6-68e5-45c1-9fba-2214dd022775 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:09:57.196697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297b0a6-68e5-45c1-9fba-2214dd022775 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:09:57.198054 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:09:57.203774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0ac02-9c9f-41a6-94d7-0c8bfd5b7649 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:09:57.204192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0ac02-9c9f-41a6-94d7-0c8bfd5b7649 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:09:57.204343 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0ac02-9c9f-41a6-94d7-0c8bfd5b7649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:09:57.220982 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a1a0ac02-9c9f-41a6-94d7-0c8bfd5b7649 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:09:57.222189 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a1a0ac02-9c9f-41a6-94d7-0c8bfd5b7649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:09:57.246753 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f697bc2-f29b-434b-829a-27927aa5dc13 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:09:57.247041 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f697bc2-f29b-434b-829a-27927aa5dc13 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:09:57.247323 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f697bc2-f29b-434b-829a-27927aa5dc13 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:09:57.248681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 7/11] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:09:57.253787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e77c6-8356-45ef-9cb4-c15eddec6928 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:09:57.254264 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e77c6-8356-45ef-9cb4-c15eddec6928 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:09:57.254580 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e77c6-8356-45ef-9cb4-c15eddec6928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:09:57.295426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG passlib.handlers.bcrypt [None req-be2e77c6-8356-45ef-9cb4-c15eddec6928 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80234) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 19:09:57.295850 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG passlib.handlers.bcrypt [None req-be2e77c6-8356-45ef-9cb4-c15eddec6928 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80234) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 19:09:57.305783 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 5/12] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:09:57.328926 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0ac02-9c9f-41a6-94d7-0c8bfd5b7649 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:09:57.341774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-be2e77c6-8356-45ef-9cb4-c15eddec6928 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:09:57.343433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-be2e77c6-8356-45ef-9cb4-c15eddec6928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:09:57.352273 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:09:57.434370 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0ac02-9c9f-41a6-94d7-0c8bfd5b7649 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:09:57.445567 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 8/13] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:09:57.467390 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e77c6-8356-45ef-9cb4-c15eddec6928 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:09:57.468331 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c19993-0345-421d-9e2d-84a8278ea335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:09:57.469149 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c19993-0345-421d-9e2d-84a8278ea335 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:09:57.469437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c19993-0345-421d-9e2d-84a8278ea335 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:09:57.469720 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c19993-0345-421d-9e2d-84a8278ea335 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:09:57.482595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c19993-0345-421d-9e2d-84a8278ea335 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:09:57.493907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-79c19993-0345-421d-9e2d-84a8278ea335 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:09:57.493907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:09:57.493907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:09:57.493907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:09:57.493907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:09:57.493907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:09:57.493907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:09:57.493907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:09:57.493907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:09:57.493907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:09:57.493907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:09:57.493907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:09:57.493907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:09:57.493907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:09:57.493907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:09:57.493907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:09:57.495154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:09:57.495154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:09:57.495154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:09:57.495154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:09:57.495154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:09:57.495154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:09:57.495154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:09:57.495154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:09:57.495154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:09:57.495154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:09:57.495154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:09:57.495154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:09:57.495154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:09:57.495154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:09:57.495154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:09:57.495154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:09:57.496758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:09:57.496758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:09:57.496758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:09:57.496758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:09:57.496758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:09:57.496758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:09:57.496758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:09:57.496758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:09:57.496758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:09:57.496758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:09:57.496758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:09:57.496758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:09:57.496758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 6/14] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:09:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:09:57.501515 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c19993-0345-421d-9e2d-84a8278ea335 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:09:57.580794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e77c6-8356-45ef-9cb4-c15eddec6928 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:09:57.583507 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:09:57.602152 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:09:57.622946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c19993-0345-421d-9e2d-84a8278ea335 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:09:57.633654 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7443b-906f-4b1b-a7eb-acc440009886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:09:57.634102 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7443b-906f-4b1b-a7eb-acc440009886 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:09:57.634421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7443b-906f-4b1b-a7eb-acc440009886 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:09:57.634699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7443b-906f-4b1b-a7eb-acc440009886 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:09:57.658840 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b3796-fa78-4b8f-ba51-f638f7ffea63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:09:57.659868 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b3796-fa78-4b8f-ba51-f638f7ffea63 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:09:57.659868 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b3796-fa78-4b8f-ba51-f638f7ffea63 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:09:57.660058 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b3796-fa78-4b8f-ba51-f638f7ffea63 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:09:57.661077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b3796-fa78-4b8f-ba51-f638f7ffea63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:09:57.661385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b3796-fa78-4b8f-ba51-f638f7ffea63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:09:57.662837 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b3796-fa78-4b8f-ba51-f638f7ffea63 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:09:57.675774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 7/15] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:09:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:09:57.681320 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b3796-fa78-4b8f-ba51-f638f7ffea63 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:09:57.711040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7443b-906f-4b1b-a7eb-acc440009886 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:09:57.712471 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7443b-906f-4b1b-a7eb-acc440009886 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:09:57.789624 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b3796-fa78-4b8f-ba51-f638f7ffea63 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:09:57.821547 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 9/16] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:09:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 19:09:57.827507 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7443b-906f-4b1b-a7eb-acc440009886 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:09:57.827862 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c17deb-cee0-4a67-83b1-e376ff206995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:09:57.828758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c17deb-cee0-4a67-83b1-e376ff206995 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:09:57.829049 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c17deb-cee0-4a67-83b1-e376ff206995 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:09:57.829338 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c17deb-cee0-4a67-83b1-e376ff206995 None admin] PATH_INFO: `/v3/users/b8c2d1f725864ea29520d2932bc19d10` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:09:57.831188 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:09:57.831308 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c17deb-cee0-4a67-83b1-e376ff206995 None admin] RBAC: Authorizing `identity:get_user(user_id=b8c2d1f725864ea29520d2932bc19d10)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:09:57.832316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c17deb-cee0-4a67-83b1-e376ff206995 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:09:57.833895 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 8/17] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:09:57 2022] GET /identity/v3/users/b8c2d1f725864ea29520d2932bc19d10 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:09:57.839889 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c17deb-cee0-4a67-83b1-e376ff206995 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:09:57.856053 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:09:57.946114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7443b-906f-4b1b-a7eb-acc440009886 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:09:57.956521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c17deb-cee0-4a67-83b1-e376ff206995 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:09:57.979115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def352c5-51cd-428b-9fb3-eddcea391e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:09:57.979911 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def352c5-51cd-428b-9fb3-eddcea391e60 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:09:57.980779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def352c5-51cd-428b-9fb3-eddcea391e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:09:57.981049 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def352c5-51cd-428b-9fb3-eddcea391e60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:09:57.993590 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b40d7-375d-4f2a-8bce-b57645e07d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:09:57.994416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b40d7-375d-4f2a-8bce-b57645e07d77 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:09:57.994703 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b40d7-375d-4f2a-8bce-b57645e07d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:09:57.994982 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b40d7-375d-4f2a-8bce-b57645e07d77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:09:57.996173 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b40d7-375d-4f2a-8bce-b57645e07d77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:09:57.997651 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b40d7-375d-4f2a-8bce-b57645e07d77 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:09:57.999315 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:09:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:09:57.999573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def352c5-51cd-428b-9fb3-eddcea391e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:09:58.000845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def352c5-51cd-428b-9fb3-eddcea391e60 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:09:58.005142 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b40d7-375d-4f2a-8bce-b57645e07d77 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:09:58.022516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-def352c5-51cd-428b-9fb3-eddcea391e60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:09:58.022516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:09:58.022516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:09:58.022516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:09:58.022516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:09:58.022516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:09:58.022516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:09:58.022516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:09:58.022516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:09:58.022516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:09:58.022516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:09:58.022516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:09:58.022516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:09:58.022516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:09:58.022516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:09:58.023586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:09:58.023586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:09:58.023586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:09:58.023586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:09:58.023586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:09:58.023586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:09:58.023586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:09:58.023586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:09:58.023586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:09:58.023586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:09:58.023586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:09:58.023586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:09:58.023586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:09:58.023586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:09:58.023586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:09:58.023586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:09:58.023586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:09:58.024631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:09:58.024631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:09:58.024631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:09:58.024631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:09:58.024631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:09:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:09:58.031273 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def352c5-51cd-428b-9fb3-eddcea391e60 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:09:58.090382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:09:58.090873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:09:58.114206 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b40d7-375d-4f2a-8bce-b57645e07d77 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:09:58.137208 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def352c5-51cd-428b-9fb3-eddcea391e60 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:09:58.148116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789919b-dd48-4866-86fe-9b4993ce04d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:09:58.148781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789919b-dd48-4866-86fe-9b4993ce04d4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:09:58.149063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789919b-dd48-4866-86fe-9b4993ce04d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:09:58.149338 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789919b-dd48-4866-86fe-9b4993ce04d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:09:58.150170 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789919b-dd48-4866-86fe-9b4993ce04d4 None admin] RBAC: Adding query filter params (role.id=6322f657162c45ca85f019a408655ff3, scope.domain.id=default, user.id=b8c2d1f725864ea29520d2932bc19d10) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:09:58.150511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789919b-dd48-4866-86fe-9b4993ce04d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:09:58.152484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789919b-dd48-4866-86fe-9b4993ce04d4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:09:58.159316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 10/20] 10.222.0.18 () {56 vars in 1322 bytes} [Wed Jul 20 19:09:58 2022] GET /identity/v3/role_assignments?user.id=b8c2d1f725864ea29520d2932bc19d10&scope.domain.id=default&role.id=6322f657162c45ca85f019a408655ff3 => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:09:58.173234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ddbca-d7ba-41a6-9fd1-df70aa7f9772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:09:58.173930 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ddbca-d7ba-41a6-9fd1-df70aa7f9772 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:09:58.174221 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ddbca-d7ba-41a6-9fd1-df70aa7f9772 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:09:58.174534 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ddbca-d7ba-41a6-9fd1-df70aa7f9772 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:09:58.175308 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ddbca-d7ba-41a6-9fd1-df70aa7f9772 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:09:58.175620 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ddbca-d7ba-41a6-9fd1-df70aa7f9772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:09:58.177075 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ddbca-d7ba-41a6-9fd1-df70aa7f9772 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:09:58.196907 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 11/21] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:00.378512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bd83f-6777-422c-a32b-abb0c368e8fb None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:00.379018 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bd83f-6777-422c-a32b-abb0c368e8fb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:00.379197 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bd83f-6777-422c-a32b-abb0c368e8fb None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:00.380429 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 11/22] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:00.396082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84098f91-db0b-45f4-a668-b78d6be92388 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:00.397036 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84098f91-db0b-45f4-a668-b78d6be92388 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:00.397541 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84098f91-db0b-45f4-a668-b78d6be92388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:00.427327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-84098f91-db0b-45f4-a668-b78d6be92388 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:00.428904 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-84098f91-db0b-45f4-a668-b78d6be92388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:00.486552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a1487-e11e-4dcd-b95d-64c7e17a949b None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:00.487182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a1487-e11e-4dcd-b95d-64c7e17a949b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:00.487659 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a1487-e11e-4dcd-b95d-64c7e17a949b None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:00.489517 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 12/23] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:10:00.495002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba8080-63ec-4a27-b340-592ea6ea7bf4 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:00.496106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba8080-63ec-4a27-b340-592ea6ea7bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:00.496584 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba8080-63ec-4a27-b340-592ea6ea7bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:00.519244 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-75ba8080-63ec-4a27-b340-592ea6ea7bf4 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:00.522002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-75ba8080-63ec-4a27-b340-592ea6ea7bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:00.560382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 12/24] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:00.594851 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84098f91-db0b-45f4-a668-b78d6be92388 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:00.690980 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:00.706779 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 13/25] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:00.747391 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba8080-63ec-4a27-b340-592ea6ea7bf4 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:00.801533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84098f91-db0b-45f4-a668-b78d6be92388 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:00.885236 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde1c1b-4cb8-4c72-b05b-cd4f942b3b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:00.886352 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde1c1b-4cb8-4c72-b05b-cd4f942b3b4b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:00.886852 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde1c1b-4cb8-4c72-b05b-cd4f942b3b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:00.887331 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde1c1b-4cb8-4c72-b05b-cd4f942b3b4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:00.907211 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:00.919955 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde1c1b-4cb8-4c72-b05b-cd4f942b3b4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:00.930349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ecde1c1b-4cb8-4c72-b05b-cd4f942b3b4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:00.930349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:00.930349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:00.930349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:00.930349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:00.930349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:00.930349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:00.930349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:00.930349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:00.930349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:00.930349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:00.930349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:00.930349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:00.930349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:00.930349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:00.930349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:00.931282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:00.931282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:00.931282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:00.931282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:00.931282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:00.931282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:00.931282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:00.931282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:00.931282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:00.931282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:00.931282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:00.931282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:00.931282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:00.931282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:00.931282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:00.931282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:00.932040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:00.932040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:00.932040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:00.932040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:00.932040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:00.932040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:00.932040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:00.932040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:00.932040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:00.932040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:00.932040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:00.932040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:00.932040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 13/26] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:10:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:10:00.938219 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde1c1b-4cb8-4c72-b05b-cd4f942b3b4b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:00.979515 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba8080-63ec-4a27-b340-592ea6ea7bf4 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:01.051055 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41cb77-c1a0-4b7e-a104-c475dc41fc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:01.052243 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41cb77-c1a0-4b7e-a104-c475dc41fc24 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:01.052675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41cb77-c1a0-4b7e-a104-c475dc41fc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:01.053197 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41cb77-c1a0-4b7e-a104-c475dc41fc24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:01.081046 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41cb77-c1a0-4b7e-a104-c475dc41fc24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:01.082862 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41cb77-c1a0-4b7e-a104-c475dc41fc24 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:01.094339 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde1c1b-4cb8-4c72-b05b-cd4f942b3b4b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:01.115289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:01.118878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-ab41cb77-c1a0-4b7e-a104-c475dc41fc24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:10:01.118878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:01.118878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:01.118878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:01.118878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:01.118878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:01.118878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:01.118878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:01.118878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:01.118878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:01.118878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:01.118878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:01.118878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:10:01.118878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:10:01.118878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:10:01.119938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:10:01.119938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:01.119938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:01.119938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:01.119938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:01.119938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:01.119938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:01.119938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:01.119938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:01.119938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:01.119938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:01.119938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:01.119938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:01.119938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:01.119938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:01.119938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:01.119938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:01.121048 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:10:01.121048 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:10:01.121048 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:10:01.121048 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:01.122769 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 14/27] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:01.124293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bf9d8-8ca1-4079-8720-908d13b66d16 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:01.124722 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bf9d8-8ca1-4079-8720-908d13b66d16 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:01.125131 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bf9d8-8ca1-4079-8720-908d13b66d16 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:01.126609 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 15/28] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:01.135805 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942961b0-f7d6-479b-bf65-1eda20968e6c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:01.136886 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942961b0-f7d6-479b-bf65-1eda20968e6c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:01.137324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942961b0-f7d6-479b-bf65-1eda20968e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:01.161658 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264c44f-84d9-4460-9501-ffced1b25558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:01.162607 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264c44f-84d9-4460-9501-ffced1b25558 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:01.163723 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-942961b0-f7d6-479b-bf65-1eda20968e6c None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:01.164161 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264c44f-84d9-4460-9501-ffced1b25558 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:01.164584 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264c44f-84d9-4460-9501-ffced1b25558 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:01.165497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264c44f-84d9-4460-9501-ffced1b25558 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:01.166870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-942961b0-f7d6-479b-bf65-1eda20968e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:01.168939 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264c44f-84d9-4460-9501-ffced1b25558 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:01.174323 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264c44f-84d9-4460-9501-ffced1b25558 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:01.194998 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 14/29] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:01.198422 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264c44f-84d9-4460-9501-ffced1b25558 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:01.311912 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 16/30] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:01.312711 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942961b0-f7d6-479b-bf65-1eda20968e6c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:01.421819 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264c44f-84d9-4460-9501-ffced1b25558 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:01.467719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb1036-380c-4745-a1c3-f7ee29100139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:01.468408 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb1036-380c-4745-a1c3-f7ee29100139 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:01.468695 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb1036-380c-4745-a1c3-f7ee29100139 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:01.468978 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb1036-380c-4745-a1c3-f7ee29100139 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:01.469729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb1036-380c-4745-a1c3-f7ee29100139 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:01.470040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb1036-380c-4745-a1c3-f7ee29100139 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:01.471501 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb1036-380c-4745-a1c3-f7ee29100139 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:01.478792 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:01.501018 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 15/31] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:01.501852 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb1036-380c-4745-a1c3-f7ee29100139 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:01.559994 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942961b0-f7d6-479b-bf65-1eda20968e6c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:01.568735 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:01.610148 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feaa982-9d96-4796-9242-b3282c9faf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:01.611094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feaa982-9d96-4796-9242-b3282c9faf70 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:01.611427 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feaa982-9d96-4796-9242-b3282c9faf70 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:01.611711 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feaa982-9d96-4796-9242-b3282c9faf70 None admin] PATH_INFO: `/v3/users/b8c2d1f725864ea29520d2932bc19d10` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:01.612937 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feaa982-9d96-4796-9242-b3282c9faf70 None admin] RBAC: Authorizing `identity:get_user(user_id=b8c2d1f725864ea29520d2932bc19d10)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:01.614512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feaa982-9d96-4796-9242-b3282c9faf70 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:01.616223 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 17/32] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:01 2022] GET /identity/v3/users/b8c2d1f725864ea29520d2932bc19d10 => generated 247 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:01.617174 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feaa982-9d96-4796-9242-b3282c9faf70 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:01.652820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb1036-380c-4745-a1c3-f7ee29100139 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:01.689405 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2c294-a0f3-4c87-9e8a-196995819954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:01.690370 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2c294-a0f3-4c87-9e8a-196995819954 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:01.690896 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2c294-a0f3-4c87-9e8a-196995819954 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:01.691376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2c294-a0f3-4c87-9e8a-196995819954 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:01.692347 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2c294-a0f3-4c87-9e8a-196995819954 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:01.693938 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2c294-a0f3-4c87-9e8a-196995819954 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:01.729664 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feaa982-9d96-4796-9242-b3282c9faf70 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:01.759015 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:01.772174 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea64336-1031-4cb8-bec1-62df69d5b3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:01.773063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea64336-1031-4cb8-bec1-62df69d5b3eb None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:01.773553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea64336-1031-4cb8-bec1-62df69d5b3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:01.773981 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea64336-1031-4cb8-bec1-62df69d5b3eb None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:01.774909 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea64336-1031-4cb8-bec1-62df69d5b3eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:01.776522 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea64336-1031-4cb8-bec1-62df69d5b3eb None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:01.849680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 16/33] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Jul 20 19:10:01 2022] POST /identity/v3/roles => generated 219 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:01.849680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d0871-2a1f-42a7-ba3d-22fd608f63cc None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:01.849680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d0871-2a1f-42a7-ba3d-22fd608f63cc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:01.849680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d0871-2a1f-42a7-ba3d-22fd608f63cc None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:01.849680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 17/34] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:01.849680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d0871-2a1f-42a7-ba3d-22fd608f63cc None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:01.957327 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 18/35] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 20 19:10:01 2022] POST /identity/v3/projects => generated 301 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:01.959000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dfc7d-8fb3-4c58-9227-c480321c36d0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:01.959306 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dfc7d-8fb3-4c58-9227-c480321c36d0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:01.959597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dfc7d-8fb3-4c58-9227-c480321c36d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:01.969619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:01.984201 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4b6dfc7d-8fb3-4c58-9227-c480321c36d0 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:01.985872 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4b6dfc7d-8fb3-4c58-9227-c480321c36d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:01.987477 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d0871-2a1f-42a7-ba3d-22fd608f63cc None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:02.030550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446043c-eef7-47c2-ad76-f5c0f8002bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:02.031972 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446043c-eef7-47c2-ad76-f5c0f8002bac None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:02.032350 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446043c-eef7-47c2-ad76-f5c0f8002bac None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:02.032636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446043c-eef7-47c2-ad76-f5c0f8002bac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:02.034547 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446043c-eef7-47c2-ad76-f5c0f8002bac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:02.036574 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446043c-eef7-47c2-ad76-f5c0f8002bac None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:02.038772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 18/36] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:02.039993 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fbf2d-0279-4920-8853-a0a7afd81895 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:02.040289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fbf2d-0279-4920-8853-a0a7afd81895 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:02.040577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fbf2d-0279-4920-8853-a0a7afd81895 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:02.041931 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 19/37] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:02.051408 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fbf2d-0279-4920-8853-a0a7afd81895 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:02.098589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 19/38] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:02.100148 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048f44f-0712-49f4-a477-112d8332450b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:02.100383 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048f44f-0712-49f4-a477-112d8332450b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:02.100670 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048f44f-0712-49f4-a477-112d8332450b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:02.135456 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f048f44f-0712-49f4-a477-112d8332450b None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:02.137238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f048f44f-0712-49f4-a477-112d8332450b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:02.202107 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fbf2d-0279-4920-8853-a0a7afd81895 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:02.235766 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 20/39] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:02.237258 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048f44f-0712-49f4-a477-112d8332450b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:02.244757 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16819844-a1ee-48ef-b5fa-86ec05c18561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:02.246197 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16819844-a1ee-48ef-b5fa-86ec05c18561 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:02.246591 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16819844-a1ee-48ef-b5fa-86ec05c18561 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:02.246880 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16819844-a1ee-48ef-b5fa-86ec05c18561 None admin] PATH_INFO: `/v3/domains/default/users/b8c2d1f725864ea29520d2932bc19d10/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:02.249423 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16819844-a1ee-48ef-b5fa-86ec05c18561 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b8c2d1f725864ea29520d2932bc19d10, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:02.250923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16819844-a1ee-48ef-b5fa-86ec05c18561 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:02.268592 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 20/40] 10.222.0.18 () {58 vars in 1361 bytes} [Wed Jul 20 19:10:02 2022] PUT /identity/v3/domains/default/users/b8c2d1f725864ea29520d2932bc19d10/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:10:02.270064 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa49376-2319-4177-b7a9-e621fdb8e5a9 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:02.270428 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa49376-2319-4177-b7a9-e621fdb8e5a9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:02.270719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa49376-2319-4177-b7a9-e621fdb8e5a9 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:02.272089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 21/41] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:02.272809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa49376-2319-4177-b7a9-e621fdb8e5a9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:02.289143 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:02.294523 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:02.384847 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048f44f-0712-49f4-a477-112d8332450b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:02.413549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa49376-2319-4177-b7a9-e621fdb8e5a9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:02.432557 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bed4d-fc65-40de-a74a-8dd630e7c627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:02.435661 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bed4d-fc65-40de-a74a-8dd630e7c627 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:02.435661 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bed4d-fc65-40de-a74a-8dd630e7c627 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:02.435661 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bed4d-fc65-40de-a74a-8dd630e7c627 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:02.435901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bed4d-fc65-40de-a74a-8dd630e7c627 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:02.438168 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bed4d-fc65-40de-a74a-8dd630e7c627 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:02.457288 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a9609-20ac-4532-bcff-8d3ba0649286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:02.457962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a9609-20ac-4532-bcff-8d3ba0649286 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:02.458275 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a9609-20ac-4532-bcff-8d3ba0649286 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:02.458635 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a9609-20ac-4532-bcff-8d3ba0649286 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:02.459391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a9609-20ac-4532-bcff-8d3ba0649286 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:02.460098 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 21/42] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Jul 20 19:10:02 2022] POST /identity/v3/roles => generated 225 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:02.461147 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a846b1a-514e-441b-97bd-624f42a1ab53 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:02.461505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a846b1a-514e-441b-97bd-624f42a1ab53 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:02.461701 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a9609-20ac-4532-bcff-8d3ba0649286 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:02.461790 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a846b1a-514e-441b-97bd-624f42a1ab53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:02.488688 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 22/43] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Jul 20 19:10:02 2022] POST /identity/v3/roles => generated 223 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:02.600135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8a846b1a-514e-441b-97bd-624f42a1ab53 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:02.601399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8a846b1a-514e-441b-97bd-624f42a1ab53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:02.680014 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 22/44] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:02.704447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a9609-20ac-4532-bcff-8d3ba0649286 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:02.894513 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:02.920140 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a9609-20ac-4532-bcff-8d3ba0649286 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:02.953173 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a863f04-54c2-4948-91ad-cb99b4df5f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:02.953906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a863f04-54c2-4948-91ad-cb99b4df5f8f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:02.954191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a863f04-54c2-4948-91ad-cb99b4df5f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:02.954499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a863f04-54c2-4948-91ad-cb99b4df5f8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:02.956167 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a863f04-54c2-4948-91ad-cb99b4df5f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:02.957625 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a863f04-54c2-4948-91ad-cb99b4df5f8f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:02.959289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 23/45] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:02.965262 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a846b1a-514e-441b-97bd-624f42a1ab53 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:02.992257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:03.067149 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a846b1a-514e-441b-97bd-624f42a1ab53 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:03.102315 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c2e9c-798f-48c8-8d00-6315f0d09b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:03.103007 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c2e9c-798f-48c8-8d00-6315f0d09b0d None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:03.103297 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c2e9c-798f-48c8-8d00-6315f0d09b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:03.103578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c2e9c-798f-48c8-8d00-6315f0d09b0d None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:03.104301 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c2e9c-798f-48c8-8d00-6315f0d09b0d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:03.106338 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c2e9c-798f-48c8-8d00-6315f0d09b0d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:03.131356 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 20 19:10:02 2022] POST /identity/v3/projects => generated 312 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:04.390350 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b5848-4047-46f2-854e-fbf0c60a9749 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:04.390880 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b5848-4047-46f2-854e-fbf0c60a9749 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:04.390965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b5848-4047-46f2-854e-fbf0c60a9749 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:04.392440 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 24/47] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:04.397691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2f1ed-5a9b-441e-8215-2f1fa42fde2b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:04.398138 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2f1ed-5a9b-441e-8215-2f1fa42fde2b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:04.398293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2f1ed-5a9b-441e-8215-2f1fa42fde2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:04.415745 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7eb2f1ed-5a9b-441e-8215-2f1fa42fde2b None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:04.416947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7eb2f1ed-5a9b-441e-8215-2f1fa42fde2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:04.487868 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 24/48] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:04.510673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b5848-4047-46f2-854e-fbf0c60a9749 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:04.613154 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b5848-4047-46f2-854e-fbf0c60a9749 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:04.645750 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478c73a-1b9b-484b-ab33-ca9b45f06d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:04.646493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478c73a-1b9b-484b-ab33-ca9b45f06d5f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:04.646784 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478c73a-1b9b-484b-ab33-ca9b45f06d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:04.647063 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478c73a-1b9b-484b-ab33-ca9b45f06d5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:04.657664 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478c73a-1b9b-484b-ab33-ca9b45f06d5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:04.665782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a478c73a-1b9b-484b-ab33-ca9b45f06d5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:04.665782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:04.665782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:04.665782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:04.665782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:04.665782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:04.665782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:04.665782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:04.665782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:04.665782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:04.665782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:04.665782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:04.665782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:04.665782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:04.665782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:04.665782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:04.666855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:04.666855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:04.666855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:04.666855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:04.666855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:04.666855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:04.666855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:04.666855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:04.666855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:04.666855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:04.666855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:04.666855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:04.666855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:04.666855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:04.666855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:04.666855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:04.668362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:04.668362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:04.668362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:04.668362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:04.668362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:04.668362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:04.668362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:04.668362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:04.668362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:04.668362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:04.668362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:04.668362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:04.668362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 25/49] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:10:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:04.675226 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2f1ed-5a9b-441e-8215-2f1fa42fde2b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:04.686115 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:04.777119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2f1ed-5a9b-441e-8215-2f1fa42fde2b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:04.818533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb327ac1-95b7-4990-8c29-a5a96050d7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:04.819217 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb327ac1-95b7-4990-8c29-a5a96050d7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:04.819508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb327ac1-95b7-4990-8c29-a5a96050d7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:04.819790 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb327ac1-95b7-4990-8c29-a5a96050d7e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:04.820557 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb327ac1-95b7-4990-8c29-a5a96050d7e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:04.820866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb327ac1-95b7-4990-8c29-a5a96050d7e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:04.822280 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb327ac1-95b7-4990-8c29-a5a96050d7e9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:04.831947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 25/50] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:04.837673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478c73a-1b9b-484b-ab33-ca9b45f06d5f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:04.842218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:04.941168 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478c73a-1b9b-484b-ab33-ca9b45f06d5f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:04.979965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb721137-15c9-425b-ae28-1bd21d088aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:04.981018 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb721137-15c9-425b-ae28-1bd21d088aec None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:04.981446 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb721137-15c9-425b-ae28-1bd21d088aec None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:04.981737 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb721137-15c9-425b-ae28-1bd21d088aec None admin] PATH_INFO: `/v3/users/b8c2d1f725864ea29520d2932bc19d10` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:04.983357 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb721137-15c9-425b-ae28-1bd21d088aec None admin] RBAC: Authorizing `identity:get_user(user_id=b8c2d1f725864ea29520d2932bc19d10)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:04.985650 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb721137-15c9-425b-ae28-1bd21d088aec None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:04.987340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 26/51] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:04 2022] GET /identity/v3/users/b8c2d1f725864ea29520d2932bc19d10 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:04.992789 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb327ac1-95b7-4990-8c29-a5a96050d7e9 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:05.063521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:05.095402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb327ac1-95b7-4990-8c29-a5a96050d7e9 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:05.129124 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd50b35-c982-41b3-9b1d-1ec317e60cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:05.129936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd50b35-c982-41b3-9b1d-1ec317e60cbe None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:05.130222 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd50b35-c982-41b3-9b1d-1ec317e60cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:05.130528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd50b35-c982-41b3-9b1d-1ec317e60cbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:05.131725 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd50b35-c982-41b3-9b1d-1ec317e60cbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:05.133198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd50b35-c982-41b3-9b1d-1ec317e60cbe None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:05.134883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 26/52] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:05.141270 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb721137-15c9-425b-ae28-1bd21d088aec None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:05.180810 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca7d85-0f49-4631-927d-f2176e00e4d8 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:05.181256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca7d85-0f49-4631-927d-f2176e00e4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:05.181747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca7d85-0f49-4631-927d-f2176e00e4d8 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:05.184418 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 27/53] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:05.189635 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fef02-b49f-47e4-83f2-13e48610a0f8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:05.189928 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fef02-b49f-47e4-83f2-13e48610a0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:05.190218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fef02-b49f-47e4-83f2-13e48610a0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:05.214163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d19fef02-b49f-47e4-83f2-13e48610a0f8 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:05.215336 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d19fef02-b49f-47e4-83f2-13e48610a0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:05.220320 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:05.253273 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb721137-15c9-425b-ae28-1bd21d088aec None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:05.290127 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 28/54] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:05.290350 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7f1bc-b722-47b2-a09e-eb770c616b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:05.291041 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7f1bc-b722-47b2-a09e-eb770c616b8e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:05.291403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7f1bc-b722-47b2-a09e-eb770c616b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:05.291694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7f1bc-b722-47b2-a09e-eb770c616b8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:05.292542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7f1bc-b722-47b2-a09e-eb770c616b8e None admin] RBAC: Adding query filter params (role.id=6322f657162c45ca85f019a408655ff3, scope.domain.id=default, user.id=b8c2d1f725864ea29520d2932bc19d10) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:05.292859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7f1bc-b722-47b2-a09e-eb770c616b8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:05.294377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7f1bc-b722-47b2-a09e-eb770c616b8e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:05.302492 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1322 bytes} [Wed Jul 20 19:10:05 2022] GET /identity/v3/role_assignments?user.id=b8c2d1f725864ea29520d2932bc19d10&scope.domain.id=default&role.id=6322f657162c45ca85f019a408655ff3 => generated 530 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:05.314073 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fef02-b49f-47e4-83f2-13e48610a0f8 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:05.384507 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:05.420882 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fef02-b49f-47e4-83f2-13e48610a0f8 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:05.457852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38e25e5-e33c-4594-a9e6-da3c7206e56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:05.458697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e25e5-e33c-4594-a9e6-da3c7206e56e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:05.458986 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e25e5-e33c-4594-a9e6-da3c7206e56e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:05.459269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e25e5-e33c-4594-a9e6-da3c7206e56e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:05.460521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e25e5-e33c-4594-a9e6-da3c7206e56e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:05.462003 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38e25e5-e33c-4594-a9e6-da3c7206e56e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:05.465166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 29/56] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:05.474283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7f1bc-b722-47b2-a09e-eb770c616b8e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:05.577009 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7f1bc-b722-47b2-a09e-eb770c616b8e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:05.609874 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f87bd-d198-4155-b61c-32f1557aa261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:05.610566 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f87bd-d198-4155-b61c-32f1557aa261 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:05.610856 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f87bd-d198-4155-b61c-32f1557aa261 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:05.611136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f87bd-d198-4155-b61c-32f1557aa261 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:05.611851 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f87bd-d198-4155-b61c-32f1557aa261 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:05.613293 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f87bd-d198-4155-b61c-32f1557aa261 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:05.617590 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:05.640356 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 28/57] 10.222.0.18 () {60 vars in 1140 bytes} [Wed Jul 20 19:10:05 2022] POST /identity/v3/projects => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:07.689428 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95173270-6313-48b2-891d-68c5849d88aa None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:07.689971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95173270-6313-48b2-891d-68c5849d88aa None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:07.689971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95173270-6313-48b2-891d-68c5849d88aa None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:07.691397 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 30/58] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:07.696515 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cd0fb-b8e9-4635-a19b-08e539eae7d9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:07.696913 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cd0fb-b8e9-4635-a19b-08e539eae7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:07.697075 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cd0fb-b8e9-4635-a19b-08e539eae7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:07.714258 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5d3cd0fb-b8e9-4635-a19b-08e539eae7d9 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:07.715770 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5d3cd0fb-b8e9-4635-a19b-08e539eae7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:07.780222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 29/59] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:07.804478 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95173270-6313-48b2-891d-68c5849d88aa None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:07.907817 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95173270-6313-48b2-891d-68c5849d88aa None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:07.943481 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbf99b-3438-4ca2-8c02-5055ecf0c139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:07.944288 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbf99b-3438-4ca2-8c02-5055ecf0c139 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:07.944580 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbf99b-3438-4ca2-8c02-5055ecf0c139 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:07.944867 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbf99b-3438-4ca2-8c02-5055ecf0c139 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:07.946058 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbf99b-3438-4ca2-8c02-5055ecf0c139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:07.947549 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbf99b-3438-4ca2-8c02-5055ecf0c139 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:07.949410 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 31/60] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:07.955422 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cd0fb-b8e9-4635-a19b-08e539eae7d9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:08.054929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cd0fb-b8e9-4635-a19b-08e539eae7d9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:08.072864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:08.091220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa699ff-ae98-49f9-92a0-695861def491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:08.091899 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa699ff-ae98-49f9-92a0-695861def491 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:08.092190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa699ff-ae98-49f9-92a0-695861def491 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:08.092474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa699ff-ae98-49f9-92a0-695861def491 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:08.093238 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa699ff-ae98-49f9-92a0-695861def491 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:08.095020 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa699ff-ae98-49f9-92a0-695861def491 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:08.123830 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 30/61] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 20 19:10:07 2022] POST /identity/v3/users => generated 275 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:11.294560 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd35a1-f558-4399-8d33-142e6a004d68 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:11.295074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd35a1-f558-4399-8d33-142e6a004d68 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:11.295148 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd35a1-f558-4399-8d33-142e6a004d68 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:11.296507 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 32/62] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:11.302525 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fe2ee-0d56-4830-ac03-bde34aac38ea None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:11.302995 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fe2ee-0d56-4830-ac03-bde34aac38ea None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:11.303103 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fe2ee-0d56-4830-ac03-bde34aac38ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:11.326597 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ea8fe2ee-0d56-4830-ac03-bde34aac38ea None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:11.328114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ea8fe2ee-0d56-4830-ac03-bde34aac38ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:11.409248 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03793d-dc2c-49e1-822d-478d9b617172 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:11.409248 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03793d-dc2c-49e1-822d-478d9b617172 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:11.409248 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03793d-dc2c-49e1-822d-478d9b617172 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:11.409248 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 33/63] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:10:11.416444 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f190a-6830-413d-a1cb-6e43d46f8d9e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:11.417522 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f190a-6830-413d-a1cb-6e43d46f8d9e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:11.418334 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f190a-6830-413d-a1cb-6e43d46f8d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:11.427033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 31/64] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:11.432983 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:11.444800 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1d1f190a-6830-413d-a1cb-6e43d46f8d9e None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:11.446026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1d1f190a-6830-413d-a1cb-6e43d46f8d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:11.452047 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fe2ee-0d56-4830-ac03-bde34aac38ea None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:11.578621 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 34/65] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:11.602253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fe2ee-0d56-4830-ac03-bde34aac38ea None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:11.610200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:11.611176 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f190a-6830-413d-a1cb-6e43d46f8d9e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:11.675560 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981b8b2-0706-4d5b-a8fe-bd0532844d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:11.676381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981b8b2-0706-4d5b-a8fe-bd0532844d41 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:11.676669 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981b8b2-0706-4d5b-a8fe-bd0532844d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:11.676951 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981b8b2-0706-4d5b-a8fe-bd0532844d41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:11.695422 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981b8b2-0706-4d5b-a8fe-bd0532844d41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:11.703809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-4981b8b2-0706-4d5b-a8fe-bd0532844d41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:11.703809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:11.703809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:11.703809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:11.703809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:11.703809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:11.703809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:11.703809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:11.703809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:11.703809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:11.703809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:11.703809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:11.703809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:11.703809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:11.703809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:11.703809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:11.704879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:11.704879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:11.704879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:11.704879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:11.704879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:11.704879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:11.704879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:11.704879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:11.704879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:11.704879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:11.704879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:11.704879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:11.704879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:11.704879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:11.704879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:11.704879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:11.705854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:11.705854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:11.705854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:11.705854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:11.705854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:11.705854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:11.705854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:11.705854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:11.705854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:11.705854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:11.705854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:11.705854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:11.707928 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 32/66] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:10:11.709311 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf3df1-a4dc-4b9d-b841-4c2dcc6669c8 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:11.709801 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf3df1-a4dc-4b9d-b841-4c2dcc6669c8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:11.710255 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf3df1-a4dc-4b9d-b841-4c2dcc6669c8 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:11.711752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 33/67] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:11.715602 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf3df1-a4dc-4b9d-b841-4c2dcc6669c8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:11.758727 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f190a-6830-413d-a1cb-6e43d46f8d9e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:11.797722 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41776cd-9ee2-4d55-b23f-2514330638cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:11.798664 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41776cd-9ee2-4d55-b23f-2514330638cc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:11.799017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41776cd-9ee2-4d55-b23f-2514330638cc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:11.799367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41776cd-9ee2-4d55-b23f-2514330638cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:11.801586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:11.813280 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41776cd-9ee2-4d55-b23f-2514330638cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:11.821520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-c41776cd-9ee2-4d55-b23f-2514330638cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:11.821520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:11.821520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:11.821520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:11.821520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:11.821520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:11.821520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:11.821520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:11.821520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:11.821520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:11.821520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:11.821520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:11.821520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:11.821520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:11.821520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:11.821520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:11.822414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:11.822414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:11.822414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:11.822414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:11.822414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:11.822414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:11.822414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:11.822414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:11.822414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:11.822414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:11.822414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:11.822414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:11.822414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:11.822414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:11.822414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:11.822414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:11.823741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:11.823741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:11.823741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:11.823741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:11.823741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:11.823741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:11.823741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:11.823741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:11.823741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:11.823741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:11.823741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:11.823741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:11.823741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 35/68] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:10:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:11.825403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af80ab-d673-4072-96c0-223ebdeb1b9f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:11.825762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af80ab-d673-4072-96c0-223ebdeb1b9f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:11.826127 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af80ab-d673-4072-96c0-223ebdeb1b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:11.827981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf3df1-a4dc-4b9d-b841-4c2dcc6669c8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:11.844420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-66af80ab-d673-4072-96c0-223ebdeb1b9f None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:11.845689 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-66af80ab-d673-4072-96c0-223ebdeb1b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:11.865366 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609aa00b-ebfd-49a5-88fb-4cff5a894f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:11.866352 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609aa00b-ebfd-49a5-88fb-4cff5a894f5e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:11.866819 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609aa00b-ebfd-49a5-88fb-4cff5a894f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:11.867267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609aa00b-ebfd-49a5-88fb-4cff5a894f5e None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:11.868236 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609aa00b-ebfd-49a5-88fb-4cff5a894f5e None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:11.868722 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609aa00b-ebfd-49a5-88fb-4cff5a894f5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:11.870370 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609aa00b-ebfd-49a5-88fb-4cff5a894f5e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:11.879730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 34/69] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:11.880916 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609aa00b-ebfd-49a5-88fb-4cff5a894f5e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:11.910898 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:11.927313 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 36/70] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:11.928175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af80ab-d673-4072-96c0-223ebdeb1b9f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:11.993641 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609aa00b-ebfd-49a5-88fb-4cff5a894f5e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:12.030656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed54586-334c-467c-9b75-f6c074b38119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:12.031327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed54586-334c-467c-9b75-f6c074b38119 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:12.031617 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed54586-334c-467c-9b75-f6c074b38119 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:12.031903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed54586-334c-467c-9b75-f6c074b38119 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:12.032662 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed54586-334c-467c-9b75-f6c074b38119 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:12.032973 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed54586-334c-467c-9b75-f6c074b38119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:12.034387 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed54586-334c-467c-9b75-f6c074b38119 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:12.042679 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:12.043973 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4fd3d-dba6-40bc-b132-386bbcf6fcb6 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:12.044270 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4fd3d-dba6-40bc-b132-386bbcf6fcb6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:12.044553 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4fd3d-dba6-40bc-b132-386bbcf6fcb6 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:12.045718 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af80ab-d673-4072-96c0-223ebdeb1b9f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:12.045834 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 36/72] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:12.046490 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4fd3d-dba6-40bc-b132-386bbcf6fcb6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:12.074831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:12.086526 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806916e-b34a-4004-8601-c337d41570a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:12.087548 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806916e-b34a-4004-8601-c337d41570a5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:12.087952 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806916e-b34a-4004-8601-c337d41570a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:12.088317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806916e-b34a-4004-8601-c337d41570a5 None admin] PATH_INFO: `/v3/users/22ebe6448aef4c2db9814012429e92af` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:12.103650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7806916e-b34a-4004-8601-c337d41570a5 None admin] RBAC: Authorizing `identity:get_user(user_id=22ebe6448aef4c2db9814012429e92af)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:12.105072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7806916e-b34a-4004-8601-c337d41570a5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:12.106841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 37/73] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:11 2022] GET /identity/v3/users/22ebe6448aef4c2db9814012429e92af => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:12.114363 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391a9e3-eb2a-4304-a8f1-83584f071a27 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:12.114363 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391a9e3-eb2a-4304-a8f1-83584f071a27 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:12.114363 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391a9e3-eb2a-4304-a8f1-83584f071a27 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:12.114363 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 38/74] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:12.114363 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391a9e3-eb2a-4304-a8f1-83584f071a27 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:12.153441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:12.166877 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4fd3d-dba6-40bc-b132-386bbcf6fcb6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:12.204019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c82585-5b4d-4c16-94ce-cb7f99eb8da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:12.204841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c82585-5b4d-4c16-94ce-cb7f99eb8da9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:12.205131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c82585-5b4d-4c16-94ce-cb7f99eb8da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:12.205413 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c82585-5b4d-4c16-94ce-cb7f99eb8da9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:12.215075 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391a9e3-eb2a-4304-a8f1-83584f071a27 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:12.217012 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c82585-5b4d-4c16-94ce-cb7f99eb8da9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:12.225155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-68c82585-5b4d-4c16-94ce-cb7f99eb8da9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:12.225155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:12.225155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:12.225155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:12.225155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:12.225155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:12.225155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:12.225155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:12.225155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:12.225155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:12.225155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:12.225155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:12.225155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:12.225155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:12.225155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:12.225155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:12.226027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:12.226027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:12.226027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:12.226027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:12.226027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:12.226027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:12.226027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:12.226027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:12.226027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:12.226027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:12.226027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:12.226027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:12.226027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:12.226027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:12.226027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:12.226027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:12.226826 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:12.226826 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:12.226826 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:12.226826 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:12.226826 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:12.226826 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:12.226826 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:12.226826 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:12.226826 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:12.226826 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:12.226826 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:12.226826 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:12.226826 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 20 19:10:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:12.227680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ff4ad-472d-485c-ab2a-bf66b94800bf None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:12.227866 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ff4ad-472d-485c-ab2a-bf66b94800bf None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:12.228153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ff4ad-472d-485c-ab2a-bf66b94800bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:12.246508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e77ff4ad-472d-485c-ab2a-bf66b94800bf None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:12.247718 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e77ff4ad-472d-485c-ab2a-bf66b94800bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:12.253070 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d66cd9-e150-4142-b89c-301e03b04272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:12.253942 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d66cd9-e150-4142-b89c-301e03b04272 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:12.254230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d66cd9-e150-4142-b89c-301e03b04272 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:12.254537 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d66cd9-e150-4142-b89c-301e03b04272 None admin] PATH_INFO: `/v3/users/b8c2d1f725864ea29520d2932bc19d10` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:12.255787 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d66cd9-e150-4142-b89c-301e03b04272 None admin] RBAC: Authorizing `identity:get_user(user_id=b8c2d1f725864ea29520d2932bc19d10)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:12.258429 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d66cd9-e150-4142-b89c-301e03b04272 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:12.260109 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 39/76] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:12 2022] GET /identity/v3/users/b8c2d1f725864ea29520d2932bc19d10 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:12.261443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d66cd9-e150-4142-b89c-301e03b04272 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:12.328417 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 38/77] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:12.329796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad82d1-2b44-47aa-b047-da2757ef2e3d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:12.330084 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad82d1-2b44-47aa-b047-da2757ef2e3d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:12.330401 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad82d1-2b44-47aa-b047-da2757ef2e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:12.351073 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:12.359441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bbad82d1-2b44-47aa-b047-da2757ef2e3d None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:12.361464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bbad82d1-2b44-47aa-b047-da2757ef2e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:12.406206 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d66cd9-e150-4142-b89c-301e03b04272 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:12.436947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 39/78] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:12.437809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad82d1-2b44-47aa-b047-da2757ef2e3d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:12.447763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:12.453772 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e1138-ef95-417e-a259-0f1a2643ed23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:12.454461 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e1138-ef95-417e-a259-0f1a2643ed23 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:12.454746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e1138-ef95-417e-a259-0f1a2643ed23 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:12.455019 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e1138-ef95-417e-a259-0f1a2643ed23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:12.532911 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e1138-ef95-417e-a259-0f1a2643ed23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:12.534512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e1138-ef95-417e-a259-0f1a2643ed23 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:12.541199 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad82d1-2b44-47aa-b047-da2757ef2e3d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:12.583484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa2dc8-660c-4112-819d-7b5883733368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:12.584173 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa2dc8-660c-4112-819d-7b5883733368 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:12.584461 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa2dc8-660c-4112-819d-7b5883733368 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:12.584741 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa2dc8-660c-4112-819d-7b5883733368 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:12.585507 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa2dc8-660c-4112-819d-7b5883733368 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:12.585809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa2dc8-660c-4112-819d-7b5883733368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:12.587255 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa2dc8-660c-4112-819d-7b5883733368 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:12.590700 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:12.596673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 40/79] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:10:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:12.597486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa2dc8-660c-4112-819d-7b5883733368 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:12.664356 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 40/80] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:12.665644 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e1138-ef95-417e-a259-0f1a2643ed23 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:12.700081 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:12.734812 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa2dc8-660c-4112-819d-7b5883733368 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:12.767661 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e1138-ef95-417e-a259-0f1a2643ed23 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:12.774408 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73ae61-d3dc-427d-9835-257c08b2db5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:12.775073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73ae61-d3dc-427d-9835-257c08b2db5e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:12.775365 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73ae61-d3dc-427d-9835-257c08b2db5e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:12.775663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73ae61-d3dc-427d-9835-257c08b2db5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:12.803625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc4e4e-95e9-48b6-92b3-2202e196408d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:12.804425 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc4e4e-95e9-48b6-92b3-2202e196408d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:12.804712 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc4e4e-95e9-48b6-92b3-2202e196408d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:12.804990 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc4e4e-95e9-48b6-92b3-2202e196408d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:12.815557 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc4e4e-95e9-48b6-92b3-2202e196408d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:12.823536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-3dfc4e4e-95e9-48b6-92b3-2202e196408d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:12.823536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:12.823536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:12.823536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:12.823536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:12.823536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:12.823536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:12.823536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:12.823536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:12.823536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:12.823536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:12.823536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:12.823536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:12.823536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:12.823536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:12.823536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:12.824377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:12.824377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:12.824377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:12.824377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:12.824377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:12.824377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:12.824377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:12.824377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:12.824377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:12.824377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:12.824377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:12.824377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:12.824377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:12.824377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:12.824377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:12.824377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:12.825135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:12.825135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:12.825135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:12.825135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:12.825135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:12.825135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:12.825135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:12.825135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:12.825135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:12.825135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:12.825135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:12.825135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:12.825135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 41/81] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:12.825763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc4e4e-95e9-48b6-92b3-2202e196408d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:12.839795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:12.850190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73ae61-d3dc-427d-9835-257c08b2db5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:12.852788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73ae61-d3dc-427d-9835-257c08b2db5e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:12.919723 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:12.928077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc4e4e-95e9-48b6-92b3-2202e196408d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:12.953820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 41/82] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:12.955278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73ae61-d3dc-427d-9835-257c08b2db5e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:12.964484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212c937-7e16-4f05-b78d-110a7ba7c992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:12.965291 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212c937-7e16-4f05-b78d-110a7ba7c992 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:12.965579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212c937-7e16-4f05-b78d-110a7ba7c992 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:12.965870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212c937-7e16-4f05-b78d-110a7ba7c992 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:12.967206 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212c937-7e16-4f05-b78d-110a7ba7c992 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:12.968677 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212c937-7e16-4f05-b78d-110a7ba7c992 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:12.970340 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 42/83] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:12.970340 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212c937-7e16-4f05-b78d-110a7ba7c992 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:13.049415 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:13.059319 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73ae61-d3dc-427d-9835-257c08b2db5e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:13.071153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212c937-7e16-4f05-b78d-110a7ba7c992 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:13.093320 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd7b61-f306-49a5-8be7-721b5a4eb1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:13.094240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd7b61-f306-49a5-8be7-721b5a4eb1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:13.094560 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd7b61-f306-49a5-8be7-721b5a4eb1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:13.094839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd7b61-f306-49a5-8be7-721b5a4eb1e5 None admin] PATH_INFO: `/v3/users/22ebe6448aef4c2db9814012429e92af` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:13.096076 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd7b61-f306-49a5-8be7-721b5a4eb1e5 None admin] RBAC: Authorizing `identity:get_user(user_id=22ebe6448aef4c2db9814012429e92af)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:13.097530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd7b61-f306-49a5-8be7-721b5a4eb1e5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:13.099256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 42/84] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:12 2022] GET /identity/v3/users/22ebe6448aef4c2db9814012429e92af => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:13.100011 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd7b61-f306-49a5-8be7-721b5a4eb1e5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:13.109230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e034dab-e3ac-4930-8c0b-072da832aa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:13.110100 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e034dab-e3ac-4930-8c0b-072da832aa99 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:13.110426 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e034dab-e3ac-4930-8c0b-072da832aa99 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:13.110709 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e034dab-e3ac-4930-8c0b-072da832aa99 None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:13.111894 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e034dab-e3ac-4930-8c0b-072da832aa99 None admin] RBAC: Authorizing `identity:get_project(project_id=00c44395b45b4dbc8c543b0837e2af1b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:13.113339 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e034dab-e3ac-4930-8c0b-072da832aa99 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:13.115088 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 43/85] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:12 2022] GET /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:13.115836 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e034dab-e3ac-4930-8c0b-072da832aa99 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:13.140608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:13.201668 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd7b61-f306-49a5-8be7-721b5a4eb1e5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:13.217095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e034dab-e3ac-4930-8c0b-072da832aa99 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:13.235287 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb36eb-02d3-4aa1-a35e-a5af91fa4040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:13.235966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb36eb-02d3-4aa1-a35e-a5af91fa4040 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:13.236252 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb36eb-02d3-4aa1-a35e-a5af91fa4040 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:13.236539 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb36eb-02d3-4aa1-a35e-a5af91fa4040 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:13.237282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb36eb-02d3-4aa1-a35e-a5af91fa4040 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:13.237590 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb36eb-02d3-4aa1-a35e-a5af91fa4040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:13.239011 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfb36eb-02d3-4aa1-a35e-a5af91fa4040 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:13.247786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 43/86] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:13.248560 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb36eb-02d3-4aa1-a35e-a5af91fa4040 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:13.254005 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2798b-33d2-43de-b4c0-321127adbc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:13.254926 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2798b-33d2-43de-b4c0-321127adbc55 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:13.255214 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2798b-33d2-43de-b4c0-321127adbc55 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:13.255493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2798b-33d2-43de-b4c0-321127adbc55 None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:13.256683 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2798b-33d2-43de-b4c0-321127adbc55 None admin] RBAC: Authorizing `identity:get_project(project_id=00c44395b45b4dbc8c543b0837e2af1b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:13.258139 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2798b-33d2-43de-b4c0-321127adbc55 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:13.259885 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 44/87] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:13 2022] GET /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:13.263472 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2798b-33d2-43de-b4c0-321127adbc55 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:13.278793 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:13.345257 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:13.348925 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb36eb-02d3-4aa1-a35e-a5af91fa4040 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:13.363821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2798b-33d2-43de-b4c0-321127adbc55 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:13.382863 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebacfd-1479-490d-b9a6-6d2c0aee0857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:13.383551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebacfd-1479-490d-b9a6-6d2c0aee0857 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:13.383844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebacfd-1479-490d-b9a6-6d2c0aee0857 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:13.384129 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebacfd-1479-490d-b9a6-6d2c0aee0857 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:13.384861 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebacfd-1479-490d-b9a6-6d2c0aee0857 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:13.386371 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebacfd-1479-490d-b9a6-6d2c0aee0857 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:13.398670 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834662c7-b1f9-43c9-9985-52a6c1fac53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:13.399340 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834662c7-b1f9-43c9-9985-52a6c1fac53c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:13.399662 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834662c7-b1f9-43c9-9985-52a6c1fac53c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:13.399919 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834662c7-b1f9-43c9-9985-52a6c1fac53c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:13.405564 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 44/88] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 20 19:10:13 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:13.406411 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebacfd-1479-490d-b9a6-6d2c0aee0857 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:13.496947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834662c7-b1f9-43c9-9985-52a6c1fac53c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:13.498986 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834662c7-b1f9-43c9-9985-52a6c1fac53c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:13.515685 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:13.530418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebacfd-1479-490d-b9a6-6d2c0aee0857 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:13.568551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4224a-3850-4d82-9087-a76d4899ed61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:13.569220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4224a-3850-4d82-9087-a76d4899ed61 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:13.569517 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4224a-3850-4d82-9087-a76d4899ed61 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:13.569848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4224a-3850-4d82-9087-a76d4899ed61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:13.570785 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4224a-3850-4d82-9087-a76d4899ed61 None admin] RBAC: Adding query filter params (role.id=8b31123e2813440db5a70f87fa5bd932, scope.project.id=00c44395b45b4dbc8c543b0837e2af1b, user.id=22ebe6448aef4c2db9814012429e92af) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:13.571146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4224a-3850-4d82-9087-a76d4899ed61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:13.573422 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4224a-3850-4d82-9087-a76d4899ed61 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:13.582624 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 45/89] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:13 2022] GET /identity/v3/role_assignments?user.id=22ebe6448aef4c2db9814012429e92af&scope.project.id=00c44395b45b4dbc8c543b0837e2af1b&role.id=8b31123e2813440db5a70f87fa5bd932 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:13.583472 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4224a-3850-4d82-9087-a76d4899ed61 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:13.616282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:13.650359 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 45/90] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:13.650744 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834662c7-b1f9-43c9-9985-52a6c1fac53c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:13.732403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4224a-3850-4d82-9087-a76d4899ed61 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:13.779626 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564ba00-9cd9-4106-8f8e-5768daec08b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:13.780285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834662c7-b1f9-43c9-9985-52a6c1fac53c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:13.780474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564ba00-9cd9-4106-8f8e-5768daec08b2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:13.780709 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564ba00-9cd9-4106-8f8e-5768daec08b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:13.780985 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564ba00-9cd9-4106-8f8e-5768daec08b2 None admin] PATH_INFO: `/v3/users/22ebe6448aef4c2db9814012429e92af` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:13.782220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564ba00-9cd9-4106-8f8e-5768daec08b2 None admin] RBAC: Authorizing `identity:get_user(user_id=22ebe6448aef4c2db9814012429e92af)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:13.783712 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564ba00-9cd9-4106-8f8e-5768daec08b2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:13.785634 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 46/91] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:13 2022] GET /identity/v3/users/22ebe6448aef4c2db9814012429e92af => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:13.786426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564ba00-9cd9-4106-8f8e-5768daec08b2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:13.809244 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:13.847030 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae45bc3-d78f-46af-bf80-7f2ec0aa9468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:13.847712 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae45bc3-d78f-46af-bf80-7f2ec0aa9468 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:13.847993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae45bc3-d78f-46af-bf80-7f2ec0aa9468 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:13.848270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae45bc3-d78f-46af-bf80-7f2ec0aa9468 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:13.849109 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae45bc3-d78f-46af-bf80-7f2ec0aa9468 None admin] RBAC: Adding query filter params (role.id=6322f657162c45ca85f019a408655ff3, scope.project.id=00c44395b45b4dbc8c543b0837e2af1b, user.id=b8c2d1f725864ea29520d2932bc19d10) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:13.849420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae45bc3-d78f-46af-bf80-7f2ec0aa9468 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:13.850926 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae45bc3-d78f-46af-bf80-7f2ec0aa9468 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:13.862931 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 46/92] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:13 2022] GET /identity/v3/role_assignments?user.id=b8c2d1f725864ea29520d2932bc19d10&scope.project.id=00c44395b45b4dbc8c543b0837e2af1b&role.id=6322f657162c45ca85f019a408655ff3 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:13.864839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae45bc3-d78f-46af-bf80-7f2ec0aa9468 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:13.914788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:13.930782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564ba00-9cd9-4106-8f8e-5768daec08b2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:13.980132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bb885-f868-49c7-975e-416451688099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:13.982156 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bb885-f868-49c7-975e-416451688099 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:13.983029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bb885-f868-49c7-975e-416451688099 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:13.983799 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bb885-f868-49c7-975e-416451688099 None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:13.986475 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bb885-f868-49c7-975e-416451688099 None admin] RBAC: Authorizing `identity:get_project(project_id=00c44395b45b4dbc8c543b0837e2af1b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:13.989515 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bb885-f868-49c7-975e-416451688099 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:13.992569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 47/93] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:13 2022] GET /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:13.998911 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bb885-f868-49c7-975e-416451688099 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:14.004860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae45bc3-d78f-46af-bf80-7f2ec0aa9468 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:14.051349 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a70c7e-73c9-4489-a237-ad383b79b618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:14.051929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a70c7e-73c9-4489-a237-ad383b79b618 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:14.052216 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a70c7e-73c9-4489-a237-ad383b79b618 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:14.052494 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a70c7e-73c9-4489-a237-ad383b79b618 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:14.113489 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:14.115907 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bb885-f868-49c7-975e-416451688099 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:14.139396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a70c7e-73c9-4489-a237-ad383b79b618 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:14.140581 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a70c7e-73c9-4489-a237-ad383b79b618 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:14.155534 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b93cc-7933-4c64-a201-80eede206aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:14.156583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b93cc-7933-4c64-a201-80eede206aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:14.157065 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b93cc-7933-4c64-a201-80eede206aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:14.157577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b93cc-7933-4c64-a201-80eede206aa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:14.158691 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b93cc-7933-4c64-a201-80eede206aa8 None admin] RBAC: Adding query filter params (role.id=61bf7de1301f489ab3311c954d548da5, scope.project.id=00c44395b45b4dbc8c543b0837e2af1b, user.id=22ebe6448aef4c2db9814012429e92af) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:14.159232 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b93cc-7933-4c64-a201-80eede206aa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:14.161342 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b93cc-7933-4c64-a201-80eede206aa8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:14.168043 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 48/94] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:13 2022] GET /identity/v3/role_assignments?user.id=22ebe6448aef4c2db9814012429e92af&scope.project.id=00c44395b45b4dbc8c543b0837e2af1b&role.id=61bf7de1301f489ab3311c954d548da5 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:14.259026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 47/95] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:14.265646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b93cc-7933-4c64-a201-80eede206aa8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:14.296142 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:14.394347 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b93cc-7933-4c64-a201-80eede206aa8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:14.432117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b21ef-a5b1-4ff1-af86-335d8be075bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:14.433991 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b21ef-a5b1-4ff1-af86-335d8be075bc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:14.434497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b21ef-a5b1-4ff1-af86-335d8be075bc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:14.434975 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b21ef-a5b1-4ff1-af86-335d8be075bc None admin] PATH_INFO: `/v3/projects/93f4cc5404d0485787ba09642a4976ad` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:14.436646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b21ef-a5b1-4ff1-af86-335d8be075bc None admin] RBAC: Authorizing `identity:get_project(project_id=93f4cc5404d0485787ba09642a4976ad)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:14.438281 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b21ef-a5b1-4ff1-af86-335d8be075bc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:14.440569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 49/96] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:14 2022] GET /identity/v3/projects/93f4cc5404d0485787ba09642a4976ad => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:14.446678 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a70c7e-73c9-4489-a237-ad383b79b618 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:14.532247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:14.563628 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a70c7e-73c9-4489-a237-ad383b79b618 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:14.603066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938447d-d4e3-4f20-9d34-1d9d63b37efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:14.603739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938447d-d4e3-4f20-9d34-1d9d63b37efd None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:14.604537 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938447d-d4e3-4f20-9d34-1d9d63b37efd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:14.604824 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938447d-d4e3-4f20-9d34-1d9d63b37efd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:14.605656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938447d-d4e3-4f20-9d34-1d9d63b37efd None admin] RBAC: Adding query filter params (role.id=8b31123e2813440db5a70f87fa5bd932, scope.project.id=93f4cc5404d0485787ba09642a4976ad, user.id=22ebe6448aef4c2db9814012429e92af) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:14.605968 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938447d-d4e3-4f20-9d34-1d9d63b37efd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:14.607452 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938447d-d4e3-4f20-9d34-1d9d63b37efd None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:14.613631 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 48/97] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:14 2022] GET /identity/v3/role_assignments?user.id=22ebe6448aef4c2db9814012429e92af&scope.project.id=93f4cc5404d0485787ba09642a4976ad&role.id=8b31123e2813440db5a70f87fa5bd932 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:16.475452 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38c3d4-a2a0-4a63-ae95-123a4404fecb None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:16.476071 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38c3d4-a2a0-4a63-ae95-123a4404fecb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:16.476071 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38c3d4-a2a0-4a63-ae95-123a4404fecb None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:16.478133 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 50/98] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:16.496821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26ef1f-b0e3-453e-9722-8951fd195335 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:16.497331 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26ef1f-b0e3-453e-9722-8951fd195335 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:16.497686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26ef1f-b0e3-453e-9722-8951fd195335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:16.519038 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-dd26ef1f-b0e3-453e-9722-8951fd195335 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:16.520388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-dd26ef1f-b0e3-453e-9722-8951fd195335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:16.560904 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ea615-f1c1-4d87-8aa6-e1cabc3927b4 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:16.561221 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ea615-f1c1-4d87-8aa6-e1cabc3927b4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:16.561466 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ea615-f1c1-4d87-8aa6-e1cabc3927b4 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:16.562884 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 51/99] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:16.571367 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c988d26-3293-42b6-aa29-49402554ad7f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:16.571693 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c988d26-3293-42b6-aa29-49402554ad7f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:16.571925 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c988d26-3293-42b6-aa29-49402554ad7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:16.602858 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9c988d26-3293-42b6-aa29-49402554ad7f None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:16.604105 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9c988d26-3293-42b6-aa29-49402554ad7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:16.663724 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 49/100] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:16.694342 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 52/101] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:16.707795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26ef1f-b0e3-453e-9722-8951fd195335 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:16.756156 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c988d26-3293-42b6-aa29-49402554ad7f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:16.788514 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:16.864975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:16.915300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26ef1f-b0e3-453e-9722-8951fd195335 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:16.942345 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c988d26-3293-42b6-aa29-49402554ad7f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:16.979558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc0a77-e56e-43ff-a05d-2efb0d3c071c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:16.980381 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc0a77-e56e-43ff-a05d-2efb0d3c071c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:16.980669 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc0a77-e56e-43ff-a05d-2efb0d3c071c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:16.980946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc0a77-e56e-43ff-a05d-2efb0d3c071c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:16.992022 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc0a77-e56e-43ff-a05d-2efb0d3c071c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:17.000276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-f3bc0a77-e56e-43ff-a05d-2efb0d3c071c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:17.000276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:17.000276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:17.000276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:17.000276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:17.000276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:17.000276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:17.000276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:17.000276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:17.000276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:17.000276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:17.000276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:17.000276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:17.000276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:17.000276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:17.000276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:17.001181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:17.001181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:17.001181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:17.001181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:17.001181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:17.001181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:17.001181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:17.001181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:17.001181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:17.001181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:17.001181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:17.001181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:17.001181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:17.001181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:17.001181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:17.001181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:17.001971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:17.001971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:17.001971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:17.001971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:17.001971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:17.001971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:17.001971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:17.001971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:17.001971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:17.001971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:17.001971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:17.001971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:17.001971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 50/102] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:17.008305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc0a77-e56e-43ff-a05d-2efb0d3c071c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:17.026704 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63f7b8-5928-4c58-b66e-cc89cc7a459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:17.027527 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63f7b8-5928-4c58-b66e-cc89cc7a459b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:17.027815 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63f7b8-5928-4c58-b66e-cc89cc7a459b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:17.028098 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63f7b8-5928-4c58-b66e-cc89cc7a459b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:17.054660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63f7b8-5928-4c58-b66e-cc89cc7a459b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:17.070774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-2e63f7b8-5928-4c58-b66e-cc89cc7a459b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:17.070774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:17.070774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:17.070774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:17.070774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:17.070774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:17.070774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:17.070774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:17.070774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:17.070774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:17.070774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:17.070774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:17.070774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:17.070774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:17.070774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:17.070774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:17.071703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:17.071703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:17.071703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:17.071703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:17.071703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:17.071703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:17.071703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:17.071703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:17.071703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:17.071703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:17.071703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:17.071703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:17.071703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:17.071703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:17.071703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:17.071703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:17.072471 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:17.072471 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:17.072471 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:17.072471 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:17.072471 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:17.072471 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:17.072471 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:17.072471 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:17.072471 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:17.072471 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:17.072471 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:17.072471 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:17.072471 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 53/103] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:17.078448 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63f7b8-5928-4c58-b66e-cc89cc7a459b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:17.134999 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc0a77-e56e-43ff-a05d-2efb0d3c071c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:17.168020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:17.183577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b34a5b-6af7-497a-ad61-5fbc0872d619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:17.184267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b34a5b-6af7-497a-ad61-5fbc0872d619 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:17.184550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b34a5b-6af7-497a-ad61-5fbc0872d619 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:17.184829 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b34a5b-6af7-497a-ad61-5fbc0872d619 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:17.185589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b34a5b-6af7-497a-ad61-5fbc0872d619 None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:17.185898 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b34a5b-6af7-497a-ad61-5fbc0872d619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:17.187343 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b34a5b-6af7-497a-ad61-5fbc0872d619 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:17.204869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 51/104] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:17.206212 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b4632-b0de-47b2-b4b2-1b87073b6d2b None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:17.206531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b4632-b0de-47b2-b4b2-1b87073b6d2b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:17.206815 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b4632-b0de-47b2-b4b2-1b87073b6d2b None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:17.208075 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 52/105] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:17.214593 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:17.217623 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601b97a-48b8-4ed0-87a8-fbbfbefa1e0f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:17.217920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601b97a-48b8-4ed0-87a8-fbbfbefa1e0f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:17.218197 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601b97a-48b8-4ed0-87a8-fbbfbefa1e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:17.250556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1601b97a-48b8-4ed0-87a8-fbbfbefa1e0f None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:17.251778 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1601b97a-48b8-4ed0-87a8-fbbfbefa1e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:17.259980 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63f7b8-5928-4c58-b66e-cc89cc7a459b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:17.297327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d0046-b47b-4a98-8f69-9fafe0321f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:17.298118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d0046-b47b-4a98-8f69-9fafe0321f62 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:17.298510 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d0046-b47b-4a98-8f69-9fafe0321f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:17.298803 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d0046-b47b-4a98-8f69-9fafe0321f62 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:17.299630 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d0046-b47b-4a98-8f69-9fafe0321f62 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:17.299950 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d0046-b47b-4a98-8f69-9fafe0321f62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:17.301339 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d0046-b47b-4a98-8f69-9fafe0321f62 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:17.312307 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 54/106] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:17.313212 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d0046-b47b-4a98-8f69-9fafe0321f62 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:17.330445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 53/107] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:17.331802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead7243-ae3b-4fd8-a63c-fd80686591c7 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:17.332175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead7243-ae3b-4fd8-a63c-fd80686591c7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:17.332471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead7243-ae3b-4fd8-a63c-fd80686591c7 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:17.333836 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 54/108] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:17.339175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffd93d-99e8-4a3a-8a5c-937017314fc1 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:17.339175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffd93d-99e8-4a3a-8a5c-937017314fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:17.339175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffd93d-99e8-4a3a-8a5c-937017314fc1 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:17.339175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 55/109] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:17.339175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffd93d-99e8-4a3a-8a5c-937017314fc1 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:17.439087 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d0046-b47b-4a98-8f69-9fafe0321f62 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:17.446793 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffd93d-99e8-4a3a-8a5c-937017314fc1 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:17.471631 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:17.476762 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b430019-d890-4494-accf-dc7d96f50c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:17.477656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b430019-d890-4494-accf-dc7d96f50c9a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:17.477945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b430019-d890-4494-accf-dc7d96f50c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:17.478227 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b430019-d890-4494-accf-dc7d96f50c9a None admin] PATH_INFO: `/v3/users/22ebe6448aef4c2db9814012429e92af` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:17.480018 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b430019-d890-4494-accf-dc7d96f50c9a None admin] RBAC: Authorizing `identity:get_user(user_id=22ebe6448aef4c2db9814012429e92af)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:17.481486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b430019-d890-4494-accf-dc7d96f50c9a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:17.483356 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 55/110] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:17 2022] GET /identity/v3/users/22ebe6448aef4c2db9814012429e92af => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:17.487562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80142d-b940-426f-93c8-f4a0a9962f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:17.488515 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80142d-b940-426f-93c8-f4a0a9962f04 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:17.488803 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80142d-b940-426f-93c8-f4a0a9962f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:17.489096 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80142d-b940-426f-93c8-f4a0a9962f04 None admin] PATH_INFO: `/v3/users/3f93e30a141a4cbe9c60dd8a25a63719` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:17.489865 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93c71e-a280-45e3-b9c2-9069a270806b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:17.490137 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93c71e-a280-45e3-b9c2-9069a270806b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:17.490466 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93c71e-a280-45e3-b9c2-9069a270806b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:17.503902 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80142d-b940-426f-93c8-f4a0a9962f04 None admin] RBAC: Authorizing `identity:get_user(user_id=3f93e30a141a4cbe9c60dd8a25a63719)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:17.505391 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80142d-b940-426f-93c8-f4a0a9962f04 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:17.507377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 56/111] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:17 2022] GET /identity/v3/users/3f93e30a141a4cbe9c60dd8a25a63719 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:17.508409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cc039-0d5e-4370-af07-b7765c5ebc73 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:17.508698 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cc039-0d5e-4370-af07-b7765c5ebc73 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:17.508981 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cc039-0d5e-4370-af07-b7765c5ebc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:17.519806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ba93c71e-a280-45e3-b9c2-9069a270806b None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:17.520938 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ba93c71e-a280-45e3-b9c2-9069a270806b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:17.523216 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:17.526922 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-bb7cc039-0d5e-4370-af07-b7765c5ebc73 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:17.528141 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bb7cc039-0d5e-4370-af07-b7765c5ebc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:17.598351 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 56/112] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:17.599544 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93c71e-a280-45e3-b9c2-9069a270806b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:17.619173 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 57/113] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:17.620522 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cc039-0d5e-4370-af07-b7765c5ebc73 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:17.711605 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93c71e-a280-45e3-b9c2-9069a270806b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:17.734162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cc039-0d5e-4370-af07-b7765c5ebc73 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:17.746040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3a083-d4cc-4a52-9fe9-6c87d37d8b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:17.746875 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3a083-d4cc-4a52-9fe9-6c87d37d8b9b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:17.747174 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3a083-d4cc-4a52-9fe9-6c87d37d8b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:17.747359 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:17.747466 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3a083-d4cc-4a52-9fe9-6c87d37d8b9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:17.754915 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:17.759279 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3a083-d4cc-4a52-9fe9-6c87d37d8b9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:17.769333 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e73bc-3ca4-40b4-a421-3d5e13f934b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:17.770491 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e73bc-3ca4-40b4-a421-3d5e13f934b2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:17.770888 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e73bc-3ca4-40b4-a421-3d5e13f934b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:17.771044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-51a3a083-d4cc-4a52-9fe9-6c87d37d8b9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:17.771044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:17.771044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:17.771044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:17.771044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:17.771044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:17.771044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:17.771044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:17.771044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:17.771044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:17.771044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:17.771044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:17.771044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:17.771044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:17.771044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:17.771044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:17.772772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:17.772772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:17.772772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:17.772772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:17.772772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:17.772772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:17.772772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:17.772772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:17.772772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:17.772772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:17.772772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:17.772772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:17.772772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:17.772772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:17.772772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:17.772772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:17.774266 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:17.774266 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:17.774266 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:17.774266 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:17.774266 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:17.774266 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:17.774266 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:17.774266 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:17.774266 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:17.774266 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:17.774266 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:17.774266 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:17.775430 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e73bc-3ca4-40b4-a421-3d5e13f934b2 None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:17.775563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 57/114] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:10:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:17.775563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3a083-d4cc-4a52-9fe9-6c87d37d8b9b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:17.777454 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e73bc-3ca4-40b4-a421-3d5e13f934b2 None admin] RBAC: Authorizing `identity:get_project(project_id=00c44395b45b4dbc8c543b0837e2af1b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:17.779313 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e73bc-3ca4-40b4-a421-3d5e13f934b2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:17.781189 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 58/115] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:17 2022] GET /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:17.782238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e73bc-3ca4-40b4-a421-3d5e13f934b2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:17.910467 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3a083-d4cc-4a52-9fe9-6c87d37d8b9b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:17.912269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e73bc-3ca4-40b4-a421-3d5e13f934b2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:17.945841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d8a4d-7492-4c0d-a157-d24b83af035c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:17.946359 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb2eae-c3c3-4c0c-9054-a5608ce661c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:17.946525 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d8a4d-7492-4c0d-a157-d24b83af035c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:17.946802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d8a4d-7492-4c0d-a157-d24b83af035c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:17.947085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d8a4d-7492-4c0d-a157-d24b83af035c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:17.947171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb2eae-c3c3-4c0c-9054-a5608ce661c2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:17.947457 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb2eae-c3c3-4c0c-9054-a5608ce661c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:17.948370 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb2eae-c3c3-4c0c-9054-a5608ce661c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:17.958454 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb2eae-c3c3-4c0c-9054-a5608ce661c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:17.966112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-3aeb2eae-c3c3-4c0c-9054-a5608ce661c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:17.966112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:17.966112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:17.966112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:17.966112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:17.966112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:17.966112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:17.966112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:17.966112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:17.966112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:17.966112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:17.966112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:17.966112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:17.966112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:17.966112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:17.966112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:17.967020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:17.967020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:17.967020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:17.967020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:17.967020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:17.967020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:17.967020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:17.967020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:17.967020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:17.967020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:17.967020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:17.967020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:17.967020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:17.967020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:17.967020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:17.967020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:17.967788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:17.967788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:17.967788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:17.967788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:17.967788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:17.967788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:17.967788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:17.967788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:17.967788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:17.967788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:17.967788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:17.967788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:17.967788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 59/116] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:17.968433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb2eae-c3c3-4c0c-9054-a5608ce661c2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:18.012914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:18.016564 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:18.021273 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d8a4d-7492-4c0d-a157-d24b83af035c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:18.022717 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d8a4d-7492-4c0d-a157-d24b83af035c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:18.071594 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb2eae-c3c3-4c0c-9054-a5608ce661c2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:18.105116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb260bbb-dd1a-4599-8317-06807ad05f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:18.105913 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb260bbb-dd1a-4599-8317-06807ad05f05 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:18.106199 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb260bbb-dd1a-4599-8317-06807ad05f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:18.106530 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb260bbb-dd1a-4599-8317-06807ad05f05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:18.107723 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb260bbb-dd1a-4599-8317-06807ad05f05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:18.109194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb260bbb-dd1a-4599-8317-06807ad05f05 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:18.110881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 60/117] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:18.116336 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b81d99-ca0b-473a-8638-90d415c0e25b None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:18.116821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b81d99-ca0b-473a-8638-90d415c0e25b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:18.117337 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b81d99-ca0b-473a-8638-90d415c0e25b None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:18.120312 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 61/118] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:18.123545 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b81d99-ca0b-473a-8638-90d415c0e25b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:18.148124 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 58/119] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:18.154125 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d8a4d-7492-4c0d-a157-d24b83af035c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:18.230065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b81d99-ca0b-473a-8638-90d415c0e25b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:18.238952 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:18.253007 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:18.258430 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d8a4d-7492-4c0d-a157-d24b83af035c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:18.272703 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f565f0-09c0-4824-9b71-c9fb4f37f550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:18.273677 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f565f0-09c0-4824-9b71-c9fb4f37f550 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:18.274205 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f565f0-09c0-4824-9b71-c9fb4f37f550 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:18.274532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f565f0-09c0-4824-9b71-c9fb4f37f550 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:18.275302 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f565f0-09c0-4824-9b71-c9fb4f37f550 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:18.275625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f565f0-09c0-4824-9b71-c9fb4f37f550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:18.277060 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f565f0-09c0-4824-9b71-c9fb4f37f550 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:18.289232 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 62/120] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:18.291807 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f565f0-09c0-4824-9b71-c9fb4f37f550 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:18.297807 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c02101-f603-46bb-a1bd-5afa18461241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:18.298792 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c02101-f603-46bb-a1bd-5afa18461241 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:18.299910 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c02101-f603-46bb-a1bd-5afa18461241 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:18.299910 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c02101-f603-46bb-a1bd-5afa18461241 None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b/users/22ebe6448aef4c2db9814012429e92af/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:18.301417 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c02101-f603-46bb-a1bd-5afa18461241 None admin] RBAC: Authorizing `identity:create_grant(project_id=00c44395b45b4dbc8c543b0837e2af1b, user_id=22ebe6448aef4c2db9814012429e92af, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:18.302904 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c02101-f603-46bb-a1bd-5afa18461241 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:18.317690 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 59/121] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:10:18 2022] PUT /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b/users/22ebe6448aef4c2db9814012429e92af/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:10:18.318750 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c02101-f603-46bb-a1bd-5afa18461241 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:18.422050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f565f0-09c0-4824-9b71-c9fb4f37f550 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:18.440624 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c02101-f603-46bb-a1bd-5afa18461241 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:18.466187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006ed49-9fb0-4f72-a389-6d90c71703aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:18.467097 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006ed49-9fb0-4f72-a389-6d90c71703aa None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:18.467463 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006ed49-9fb0-4f72-a389-6d90c71703aa None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:18.467945 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006ed49-9fb0-4f72-a389-6d90c71703aa None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:18.468690 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006ed49-9fb0-4f72-a389-6d90c71703aa None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:18.469098 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006ed49-9fb0-4f72-a389-6d90c71703aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:18.471117 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006ed49-9fb0-4f72-a389-6d90c71703aa None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:18.482910 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 63/122] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:18.484138 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251d405-ac95-4604-aac7-cc05c6902139 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:18.484628 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251d405-ac95-4604-aac7-cc05c6902139 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:18.485019 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251d405-ac95-4604-aac7-cc05c6902139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:18.490265 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bcf99-f987-42a0-a1ba-94b9ba3989d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:18.490787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bcf99-f987-42a0-a1ba-94b9ba3989d0 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:18.492148 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bcf99-f987-42a0-a1ba-94b9ba3989d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:18.492148 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bcf99-f987-42a0-a1ba-94b9ba3989d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:18.493280 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bcf99-f987-42a0-a1ba-94b9ba3989d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:18.496684 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bcf99-f987-42a0-a1ba-94b9ba3989d0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:18.507439 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7251d405-ac95-4604-aac7-cc05c6902139 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:18.508652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7251d405-ac95-4604-aac7-cc05c6902139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:18.524875 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 60/123] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 20 19:10:18 2022] POST /identity/v3/projects => generated 302 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:18.531390 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bcf99-f987-42a0-a1ba-94b9ba3989d0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:18.544999 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:18.552605 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:18.627816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 64/124] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:18.629302 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251d405-ac95-4604-aac7-cc05c6902139 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:18.663527 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bcf99-f987-42a0-a1ba-94b9ba3989d0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:18.701489 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cf253-03f1-4882-804c-94f05c4b6cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:18.702126 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cf253-03f1-4882-804c-94f05c4b6cfc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:18.702458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cf253-03f1-4882-804c-94f05c4b6cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:18.702739 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cf253-03f1-4882-804c-94f05c4b6cfc None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:18.704272 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37cf253-03f1-4882-804c-94f05c4b6cfc None admin] RBAC: Authorizing `identity:get_project(project_id=00c44395b45b4dbc8c543b0837e2af1b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:18.705788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37cf253-03f1-4882-804c-94f05c4b6cfc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:18.707781 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 61/125] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:18 2022] GET /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:18.708600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cf253-03f1-4882-804c-94f05c4b6cfc None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:18.770509 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251d405-ac95-4604-aac7-cc05c6902139 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:18.811222 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840f8ad-29d9-4ff2-85b5-c19c7045ecc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:18.812411 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840f8ad-29d9-4ff2-85b5-c19c7045ecc7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:18.812884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840f8ad-29d9-4ff2-85b5-c19c7045ecc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:18.813349 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840f8ad-29d9-4ff2-85b5-c19c7045ecc7 None admin] PATH_INFO: `/v3/users/b8c2d1f725864ea29520d2932bc19d10` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:18.814910 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840f8ad-29d9-4ff2-85b5-c19c7045ecc7 None admin] RBAC: Authorizing `identity:get_user(user_id=b8c2d1f725864ea29520d2932bc19d10)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:18.816639 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840f8ad-29d9-4ff2-85b5-c19c7045ecc7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:18.819291 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 65/126] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:18 2022] GET /identity/v3/users/b8c2d1f725864ea29520d2932bc19d10 => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:18.820139 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840f8ad-29d9-4ff2-85b5-c19c7045ecc7 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:18.821540 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:18.857064 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cf253-03f1-4882-804c-94f05c4b6cfc None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:18.860758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:18.903019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dde0e7-bbeb-4c81-bc24-25f996f7f443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:18.904076 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dde0e7-bbeb-4c81-bc24-25f996f7f443 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:18.904520 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dde0e7-bbeb-4c81-bc24-25f996f7f443 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:18.904809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dde0e7-bbeb-4c81-bc24-25f996f7f443 None admin] PATH_INFO: `/v3/users/22ebe6448aef4c2db9814012429e92af` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:18.906870 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dde0e7-bbeb-4c81-bc24-25f996f7f443 None admin] RBAC: Authorizing `identity:get_user(user_id=22ebe6448aef4c2db9814012429e92af)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:18.908340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dde0e7-bbeb-4c81-bc24-25f996f7f443 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:18.910455 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 62/127] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:18 2022] GET /identity/v3/users/22ebe6448aef4c2db9814012429e92af => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:18.911049 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dde0e7-bbeb-4c81-bc24-25f996f7f443 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:18.945786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840f8ad-29d9-4ff2-85b5-c19c7045ecc7 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:18.993920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b75abc-b996-4253-8246-abeb62bab5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:18.995565 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b75abc-b996-4253-8246-abeb62bab5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:18.996289 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b75abc-b996-4253-8246-abeb62bab5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:18.996763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b75abc-b996-4253-8246-abeb62bab5c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:19.011293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b75abc-b996-4253-8246-abeb62bab5c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:19.024247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-17b75abc-b996-4253-8246-abeb62bab5c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:19.024247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:19.024247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:19.024247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:19.024247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:19.024247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:19.024247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:19.024247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:19.024247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:19.024247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:19.024247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:19.024247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:19.024247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:19.024247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:19.024247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:19.024247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:19.025367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:19.025367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:19.025367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:19.025367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:19.025367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:19.025367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:19.025367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:19.025367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:19.025367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:19.025367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:19.025367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:19.025367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:19.025367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:19.025367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:19.025367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:19.025367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:19.026252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:19.026252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:19.026252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:19.026252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:19.026252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:19.026252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:19.026252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:19.026252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:19.026252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:19.026252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:19.026252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:19.026252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:19.026252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 66/128] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 20 19:10:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:19.027144 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b75abc-b996-4253-8246-abeb62bab5c6 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:19.048433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dde0e7-bbeb-4c81-bc24-25f996f7f443 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:19.098457 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b7185-0a13-4baa-ba47-87776956b817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:19.099144 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b7185-0a13-4baa-ba47-87776956b817 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:19.099531 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b7185-0a13-4baa-ba47-87776956b817 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:19.099886 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b7185-0a13-4baa-ba47-87776956b817 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:19.100805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b7185-0a13-4baa-ba47-87776956b817 None admin] RBAC: Adding query filter params (role.id=afe0f864483d4f3186a49ce8d33ecd74, scope.project.id=00c44395b45b4dbc8c543b0837e2af1b, user.id=3f93e30a141a4cbe9c60dd8a25a63719) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:19.101188 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b7185-0a13-4baa-ba47-87776956b817 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:19.103262 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b7185-0a13-4baa-ba47-87776956b817 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:19.112164 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 63/129] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:18 2022] GET /identity/v3/role_assignments?user.id=3f93e30a141a4cbe9c60dd8a25a63719&scope.project.id=00c44395b45b4dbc8c543b0837e2af1b&role.id=afe0f864483d4f3186a49ce8d33ecd74 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:19.113618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b7185-0a13-4baa-ba47-87776956b817 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:19.131536 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:19.165559 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:19.199590 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b75abc-b996-4253-8246-abeb62bab5c6 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:19.259716 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b7185-0a13-4baa-ba47-87776956b817 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:19.298384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee5bca-c830-4837-82ce-d7968093c19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:19.299618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee5bca-c830-4837-82ce-d7968093c19f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:19.300009 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee5bca-c830-4837-82ce-d7968093c19f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:19.300412 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee5bca-c830-4837-82ce-d7968093c19f None admin] PATH_INFO: `/v3/projects/93f4cc5404d0485787ba09642a4976ad` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:19.301978 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee5bca-c830-4837-82ce-d7968093c19f None admin] RBAC: Authorizing `identity:get_project(project_id=93f4cc5404d0485787ba09642a4976ad)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:19.304052 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee5bca-c830-4837-82ce-d7968093c19f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:19.306108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 64/130] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:19 2022] GET /identity/v3/projects/93f4cc5404d0485787ba09642a4976ad => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:19.307734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee5bca-c830-4837-82ce-d7968093c19f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:19.329781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755167b-238c-4f3b-a8e5-e33d40b8f940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:19.330990 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755167b-238c-4f3b-a8e5-e33d40b8f940 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:19.331428 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755167b-238c-4f3b-a8e5-e33d40b8f940 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:19.331857 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755167b-238c-4f3b-a8e5-e33d40b8f940 None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:19.334984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755167b-238c-4f3b-a8e5-e33d40b8f940 None admin] RBAC: Authorizing `identity:get_project(project_id=00c44395b45b4dbc8c543b0837e2af1b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:19.336776 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755167b-238c-4f3b-a8e5-e33d40b8f940 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:19.339148 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 67/131] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:19 2022] GET /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b => generated 298 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:19.342365 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755167b-238c-4f3b-a8e5-e33d40b8f940 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:19.403783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:19.428636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee5bca-c830-4837-82ce-d7968093c19f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:19.472394 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021620be-7fd1-492d-a136-8826f14e5a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:19.473699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021620be-7fd1-492d-a136-8826f14e5a75 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:19.474326 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021620be-7fd1-492d-a136-8826f14e5a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:19.474828 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021620be-7fd1-492d-a136-8826f14e5a75 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:19.475989 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021620be-7fd1-492d-a136-8826f14e5a75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:19.476509 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021620be-7fd1-492d-a136-8826f14e5a75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:19.478386 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021620be-7fd1-492d-a136-8826f14e5a75 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:19.489515 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 65/132] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:10:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:19.490880 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021620be-7fd1-492d-a136-8826f14e5a75 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:19.605161 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021620be-7fd1-492d-a136-8826f14e5a75 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:19.632280 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755167b-238c-4f3b-a8e5-e33d40b8f940 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:19.642119 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e742cac-c043-4b7a-892c-b26fcfdc8f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:19.643203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e742cac-c043-4b7a-892c-b26fcfdc8f0e None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:19.643591 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e742cac-c043-4b7a-892c-b26fcfdc8f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:19.643972 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e742cac-c043-4b7a-892c-b26fcfdc8f0e None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b/users/b8c2d1f725864ea29520d2932bc19d10/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:19.646061 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e742cac-c043-4b7a-892c-b26fcfdc8f0e None admin] RBAC: Authorizing `identity:create_grant(project_id=00c44395b45b4dbc8c543b0837e2af1b, user_id=b8c2d1f725864ea29520d2932bc19d10, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:19.647636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e742cac-c043-4b7a-892c-b26fcfdc8f0e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:19.675898 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:19.689256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 66/133] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:10:19 2022] PUT /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b/users/b8c2d1f725864ea29520d2932bc19d10/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:10:19.690289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e742cac-c043-4b7a-892c-b26fcfdc8f0e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:19.691886 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2afe7-a151-4f83-b04c-1d0d3a4d844b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:19.692875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2afe7-a151-4f83-b04c-1d0d3a4d844b None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:19.693387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2afe7-a151-4f83-b04c-1d0d3a4d844b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:19.693678 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2afe7-a151-4f83-b04c-1d0d3a4d844b None admin] PATH_INFO: `/v3/projects/93f4cc5404d0485787ba09642a4976ad/users/22ebe6448aef4c2db9814012429e92af/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:19.697226 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2afe7-a151-4f83-b04c-1d0d3a4d844b None admin] RBAC: Authorizing `identity:create_grant(project_id=93f4cc5404d0485787ba09642a4976ad, user_id=22ebe6448aef4c2db9814012429e92af, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:19.699002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2afe7-a151-4f83-b04c-1d0d3a4d844b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:19.729520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 68/134] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:10:19 2022] PUT /identity/v3/projects/93f4cc5404d0485787ba09642a4976ad/users/22ebe6448aef4c2db9814012429e92af/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:10:19.822062 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e742cac-c043-4b7a-892c-b26fcfdc8f0e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:19.860753 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d17c83-0f33-41bd-90f3-50cae62bb0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:19.861730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d17c83-0f33-41bd-90f3-50cae62bb0ea None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:19.862021 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d17c83-0f33-41bd-90f3-50cae62bb0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:19.862322 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d17c83-0f33-41bd-90f3-50cae62bb0ea None admin] PATH_INFO: `/v3/users/22ebe6448aef4c2db9814012429e92af` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:19.863758 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d17c83-0f33-41bd-90f3-50cae62bb0ea None admin] RBAC: Authorizing `identity:get_user(user_id=22ebe6448aef4c2db9814012429e92af)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:19.865392 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d17c83-0f33-41bd-90f3-50cae62bb0ea None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:19.867263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 67/135] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:19 2022] GET /identity/v3/users/22ebe6448aef4c2db9814012429e92af => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:19.875242 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2afe7-a151-4f83-b04c-1d0d3a4d844b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:19.908698 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:20.014774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2afe7-a151-4f83-b04c-1d0d3a4d844b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:20.060012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98442e95-422d-402f-91e8-4e8f86bbbbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:20.060900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98442e95-422d-402f-91e8-4e8f86bbbbf7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:20.061192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98442e95-422d-402f-91e8-4e8f86bbbbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:20.061475 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98442e95-422d-402f-91e8-4e8f86bbbbf7 None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:20.062707 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98442e95-422d-402f-91e8-4e8f86bbbbf7 None admin] RBAC: Authorizing `identity:get_project(project_id=00c44395b45b4dbc8c543b0837e2af1b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:20.064166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98442e95-422d-402f-91e8-4e8f86bbbbf7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:20.066183 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 69/136] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:19 2022] GET /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:20.072328 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d17c83-0f33-41bd-90f3-50cae62bb0ea None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:20.174546 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:20.209310 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d17c83-0f33-41bd-90f3-50cae62bb0ea None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:20.252435 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f41635-8047-4278-8cda-271093eafc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:20.253351 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f41635-8047-4278-8cda-271093eafc5a None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:20.253615 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f41635-8047-4278-8cda-271093eafc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:20.253911 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f41635-8047-4278-8cda-271093eafc5a None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b/users/22ebe6448aef4c2db9814012429e92af/roles/61bf7de1301f489ab3311c954d548da5` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:20.256354 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f41635-8047-4278-8cda-271093eafc5a None admin] RBAC: Authorizing `identity:create_grant(project_id=00c44395b45b4dbc8c543b0837e2af1b, user_id=22ebe6448aef4c2db9814012429e92af, role_id=61bf7de1301f489ab3311c954d548da5)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:20.258462 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f41635-8047-4278-8cda-271093eafc5a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:20.280458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 68/137] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:10:20 2022] PUT /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b/users/22ebe6448aef4c2db9814012429e92af/roles/61bf7de1301f489ab3311c954d548da5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:10:20.979844 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963903b-45db-4b6e-bdd1-4dddb4e32cbd None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:20.980533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963903b-45db-4b6e-bdd1-4dddb4e32cbd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:20.980533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963903b-45db-4b6e-bdd1-4dddb4e32cbd None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:20.981909 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 70/138] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:20.996097 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d32ef-b042-4d7c-8a3a-363ce74e8d7e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:20.996720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d32ef-b042-4d7c-8a3a-363ce74e8d7e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:20.996720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d32ef-b042-4d7c-8a3a-363ce74e8d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:21.017746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-947d32ef-b042-4d7c-8a3a-363ce74e8d7e None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:21.018988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-947d32ef-b042-4d7c-8a3a-363ce74e8d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:21.089481 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 69/139] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:21.122910 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963903b-45db-4b6e-bdd1-4dddb4e32cbd None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:21.239532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:21.261565 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963903b-45db-4b6e-bdd1-4dddb4e32cbd None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:21.268138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d006dc2-a211-4865-9895-7a8f719d28d7 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:21.268434 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d006dc2-a211-4865-9895-7a8f719d28d7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:21.268719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d006dc2-a211-4865-9895-7a8f719d28d7 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:21.270274 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 70/140] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:21.277454 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab293671-dd96-436f-b41f-4adb793e5ae9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:21.278008 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab293671-dd96-436f-b41f-4adb793e5ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:21.278516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab293671-dd96-436f-b41f-4adb793e5ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:21.307819 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ab293671-dd96-436f-b41f-4adb793e5ae9 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:21.315900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ab293671-dd96-436f-b41f-4adb793e5ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:21.336524 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecdc91-4232-446f-9cc1-40fcb47d4a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:21.337686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecdc91-4232-446f-9cc1-40fcb47d4a01 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:21.338774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecdc91-4232-446f-9cc1-40fcb47d4a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:21.339283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecdc91-4232-446f-9cc1-40fcb47d4a01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:21.368062 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aecdc91-4232-446f-9cc1-40fcb47d4a01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:21.380050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-0aecdc91-4232-446f-9cc1-40fcb47d4a01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:21.380050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:21.380050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:21.380050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:21.380050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:21.380050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:21.380050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:21.380050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:21.380050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:21.380050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:21.380050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:21.380050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:21.380050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:21.380050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:21.380050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:21.380050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:21.380958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:21.380958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:21.380958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:21.380958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:21.380958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:21.380958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:21.380958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:21.380958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:21.380958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:21.380958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:21.380958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:21.380958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:21.380958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:21.380958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:21.380958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:21.380958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:21.381729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:21.381729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:21.381729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:21.381729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:21.381729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:21.381729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:21.381729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:21.381729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:21.381729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:21.381729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:21.381729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:21.381729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:21.387974 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 71/141] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:21.394007 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecdc91-4232-446f-9cc1-40fcb47d4a01 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:21.465215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:21.502431 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 71/142] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:21.549500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab293671-dd96-436f-b41f-4adb793e5ae9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:21.606172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecdc91-4232-446f-9cc1-40fcb47d4a01 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:21.649912 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e095ec-36cf-4630-bdbf-c332be059802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:21.651237 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e095ec-36cf-4630-bdbf-c332be059802 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:21.651613 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e095ec-36cf-4630-bdbf-c332be059802 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:21.651901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e095ec-36cf-4630-bdbf-c332be059802 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:21.652683 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e095ec-36cf-4630-bdbf-c332be059802 None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:21.653000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e095ec-36cf-4630-bdbf-c332be059802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:21.654450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e095ec-36cf-4630-bdbf-c332be059802 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:21.672627 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 72/143] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:21.678695 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e095ec-36cf-4630-bdbf-c332be059802 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:21.718696 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:21.779281 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab293671-dd96-436f-b41f-4adb793e5ae9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:21.882710 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b220b1-ad4f-4f90-9ef3-034a7139b3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:21.883953 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b220b1-ad4f-4f90-9ef3-034a7139b3dd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:21.884439 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b220b1-ad4f-4f90-9ef3-034a7139b3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:21.885585 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b220b1-ad4f-4f90-9ef3-034a7139b3dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:21.891044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b220b1-ad4f-4f90-9ef3-034a7139b3dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:21.892733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b220b1-ad4f-4f90-9ef3-034a7139b3dd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:21.894631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 72/144] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:21.906189 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b220b1-ad4f-4f90-9ef3-034a7139b3dd None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:21.930327 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e095ec-36cf-4630-bdbf-c332be059802 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:21.988358 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c61b64-836e-45ad-b5f2-ff6611c6c0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:21.989370 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c61b64-836e-45ad-b5f2-ff6611c6c0ba None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:21.989763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c61b64-836e-45ad-b5f2-ff6611c6c0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:21.990051 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c61b64-836e-45ad-b5f2-ff6611c6c0ba None admin] PATH_INFO: `/v3/users/22ebe6448aef4c2db9814012429e92af` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:21.994793 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c61b64-836e-45ad-b5f2-ff6611c6c0ba None admin] RBAC: Authorizing `identity:get_user(user_id=22ebe6448aef4c2db9814012429e92af)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:21.994793 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c61b64-836e-45ad-b5f2-ff6611c6c0ba None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:21.996725 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 73/145] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:21 2022] GET /identity/v3/users/22ebe6448aef4c2db9814012429e92af => generated 275 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:22.006332 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c61b64-836e-45ad-b5f2-ff6611c6c0ba None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:22.044745 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:22.127665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b220b1-ad4f-4f90-9ef3-034a7139b3dd None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:22.155421 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:22.192934 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb882bdf-3805-441b-889c-a98937f71667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:22.193632 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb882bdf-3805-441b-889c-a98937f71667 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:22.193920 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb882bdf-3805-441b-889c-a98937f71667 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:22.194201 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb882bdf-3805-441b-889c-a98937f71667 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:22.194415 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c61b64-836e-45ad-b5f2-ff6611c6c0ba None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:22.194959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb882bdf-3805-441b-889c-a98937f71667 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:22.196432 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb882bdf-3805-441b-889c-a98937f71667 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:22.240499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 73/146] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 20 19:10:21 2022] POST /identity/v3/users => generated 283 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:10:22.241931 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4354c3-33f2-42ff-b3cb-ae489f6c8d1e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:22.242273 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4354c3-33f2-42ff-b3cb-ae489f6c8d1e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:22.242611 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4354c3-33f2-42ff-b3cb-ae489f6c8d1e None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:22.245268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 74/147] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:22.253062 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2910b7-8461-42fc-b36f-354b2e81ffa9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:22.253357 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2910b7-8461-42fc-b36f-354b2e81ffa9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:22.253623 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2910b7-8461-42fc-b36f-354b2e81ffa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:22.256942 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947f573-fb8f-4ed7-a1fe-95a9689fd9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:22.257605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947f573-fb8f-4ed7-a1fe-95a9689fd9ae None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:22.257888 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947f573-fb8f-4ed7-a1fe-95a9689fd9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:22.258167 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947f573-fb8f-4ed7-a1fe-95a9689fd9ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:22.294560 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ba2910b7-8461-42fc-b36f-354b2e81ffa9 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:22.295870 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ba2910b7-8461-42fc-b36f-354b2e81ffa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:22.375780 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947f573-fb8f-4ed7-a1fe-95a9689fd9ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:22.377395 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947f573-fb8f-4ed7-a1fe-95a9689fd9ae None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:22.477168 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 75/148] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:22.516426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2910b7-8461-42fc-b36f-354b2e81ffa9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:22.578801 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:22.592764 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:22.641819 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2910b7-8461-42fc-b36f-354b2e81ffa9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:22.645258 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 74/149] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 19:10:22.651585 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947f573-fb8f-4ed7-a1fe-95a9689fd9ae None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:22.684351 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb1232-0dff-470e-83d1-98eb6b1f85a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:22.685567 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb1232-0dff-470e-83d1-98eb6b1f85a5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:22.686055 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb1232-0dff-470e-83d1-98eb6b1f85a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:22.686560 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb1232-0dff-470e-83d1-98eb6b1f85a5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:22.699436 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb1232-0dff-470e-83d1-98eb6b1f85a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:22.707599 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ecdb1232-0dff-470e-83d1-98eb6b1f85a5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:22.707599 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:22.707599 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:22.707599 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:22.707599 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:22.707599 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:22.707599 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:22.707599 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:22.707599 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:22.707599 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:22.707599 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:22.707599 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:22.707599 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:22.707599 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:22.707599 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:22.707599 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:22.708482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:22.708482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:22.708482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:22.708482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:22.708482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:22.708482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:22.708482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:22.708482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:22.708482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:22.708482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:22.708482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:22.708482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:22.708482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:22.708482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:22.708482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:22.708482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:22.709242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:22.709242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:22.709242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:22.709242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:22.709242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:22.709242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:22.709242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:22.709242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:22.709242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:22.709242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:22.709242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:22.709242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:22.712086 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 76/150] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:22.718074 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb1232-0dff-470e-83d1-98eb6b1f85a5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:22.859014 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947f573-fb8f-4ed7-a1fe-95a9689fd9ae None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:22.894694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb1232-0dff-470e-83d1-98eb6b1f85a5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:22.903365 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4e837-0fc8-43bb-95f7-e97e35e4c3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:22.904243 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4e837-0fc8-43bb-95f7-e97e35e4c3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:22.904531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4e837-0fc8-43bb-95f7-e97e35e4c3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:22.904814 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4e837-0fc8-43bb-95f7-e97e35e4c3e7 None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:22.906339 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4e837-0fc8-43bb-95f7-e97e35e4c3e7 None admin] RBAC: Authorizing `identity:get_project(project_id=00c44395b45b4dbc8c543b0837e2af1b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:22.906753 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:22.908534 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4e837-0fc8-43bb-95f7-e97e35e4c3e7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:22.911038 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 75/151] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:22 2022] GET /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:22.912385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ebe6f-23e7-47c7-b747-00ffdd837ffa None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:22.912678 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ebe6f-23e7-47c7-b747-00ffdd837ffa None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:22.912958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ebe6f-23e7-47c7-b747-00ffdd837ffa None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:22.914215 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 76/152] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:22.917428 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ebe6f-23e7-47c7-b747-00ffdd837ffa None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:22.949683 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bb823-c0e9-4318-b9de-0d39befb6034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:22.950704 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bb823-c0e9-4318-b9de-0d39befb6034 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:22.951001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bb823-c0e9-4318-b9de-0d39befb6034 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:22.951283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bb823-c0e9-4318-b9de-0d39befb6034 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:22.952057 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bb823-c0e9-4318-b9de-0d39befb6034 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:22.952370 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bb823-c0e9-4318-b9de-0d39befb6034 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:22.954042 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bb823-c0e9-4318-b9de-0d39befb6034 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:22.966273 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 77/153] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:22.967616 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af2cb9-8e08-482b-a960-f1808be19d1d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:22.967910 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af2cb9-8e08-482b-a960-f1808be19d1d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:22.968195 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af2cb9-8e08-482b-a960-f1808be19d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:22.989098 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e3af2cb9-8e08-482b-a960-f1808be19d1d None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:22.990364 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e3af2cb9-8e08-482b-a960-f1808be19d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:22.994813 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:23.057728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ebe6f-23e7-47c7-b747-00ffdd837ffa None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:23.079397 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 78/154] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:23.080380 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af2cb9-8e08-482b-a960-f1808be19d1d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:23.099913 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d61940-783d-4e51-8b51-b7bfe796ce43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:23.100582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d61940-783d-4e51-8b51-b7bfe796ce43 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:23.100864 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d61940-783d-4e51-8b51-b7bfe796ce43 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:23.101138 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d61940-783d-4e51-8b51-b7bfe796ce43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:23.102602 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d61940-783d-4e51-8b51-b7bfe796ce43 None admin] RBAC: Adding query filter params (role.id=8b31123e2813440db5a70f87fa5bd932, scope.project.id=00c44395b45b4dbc8c543b0837e2af1b, user.id=22ebe6448aef4c2db9814012429e92af) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:23.102919 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d61940-783d-4e51-8b51-b7bfe796ce43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:23.104524 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d61940-783d-4e51-8b51-b7bfe796ce43 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:23.112214 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 77/155] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:22 2022] GET /identity/v3/role_assignments?user.id=22ebe6448aef4c2db9814012429e92af&scope.project.id=00c44395b45b4dbc8c543b0837e2af1b&role.id=8b31123e2813440db5a70f87fa5bd932 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:23.121459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d61940-783d-4e51-8b51-b7bfe796ce43 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:23.258562 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:23.264907 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af2cb9-8e08-482b-a960-f1808be19d1d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:23.315712 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc5f00-f223-49d8-b8e0-26ea5ea28f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:23.316610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc5f00-f223-49d8-b8e0-26ea5ea28f60 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:23.316958 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc5f00-f223-49d8-b8e0-26ea5ea28f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:23.317207 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc5f00-f223-49d8-b8e0-26ea5ea28f60 None admin] PATH_INFO: `/v3/users/3f93e30a141a4cbe9c60dd8a25a63719` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:23.323202 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc5f00-f223-49d8-b8e0-26ea5ea28f60 None admin] RBAC: Authorizing `identity:get_user(user_id=3f93e30a141a4cbe9c60dd8a25a63719)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:23.324904 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc5f00-f223-49d8-b8e0-26ea5ea28f60 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:23.326835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 79/156] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:23 2022] GET /identity/v3/users/3f93e30a141a4cbe9c60dd8a25a63719 => generated 289 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:23.329239 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d61940-783d-4e51-8b51-b7bfe796ce43 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:23.333186 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc5f00-f223-49d8-b8e0-26ea5ea28f60 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:23.342366 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:23.425038 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578d298-0449-4ab3-b676-6e995730c1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:23.425774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578d298-0449-4ab3-b676-6e995730c1dd None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:23.426059 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578d298-0449-4ab3-b676-6e995730c1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:23.426416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578d298-0449-4ab3-b676-6e995730c1dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:23.462545 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578d298-0449-4ab3-b676-6e995730c1dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:23.470578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-f578d298-0449-4ab3-b676-6e995730c1dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:23.470578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:23.470578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:23.470578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:23.470578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:23.470578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:23.470578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:23.470578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:23.470578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:23.470578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:23.470578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:23.470578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:23.470578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:23.470578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:23.470578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:23.470578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:23.471643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:23.471643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:23.471643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:23.471643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:23.471643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:23.471643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:23.471643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:23.471643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:23.471643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:23.471643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:23.471643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:23.471643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:23.471643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:23.471643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:23.471643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:23.471643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:23.472883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:23.472883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:23.472883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:23.472883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:23.472883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:23.472883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:23.472883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:23.472883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:23.472883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:23.472883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:23.472883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:23.472883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:23.472883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 78/157] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:10:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:10:23.473586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c7398-9aa6-422a-a056-9274a364b76e None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:23.473586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c7398-9aa6-422a-a056-9274a364b76e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:23.473586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c7398-9aa6-422a-a056-9274a364b76e None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:23.478558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 79/158] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:23.478850 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc5f00-f223-49d8-b8e0-26ea5ea28f60 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:23.484680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c741d8-807e-4dfb-9d63-cb5ff4f68914 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:23.484967 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c741d8-807e-4dfb-9d63-cb5ff4f68914 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:23.485247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c741d8-807e-4dfb-9d63-cb5ff4f68914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:23.515765 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-33c741d8-807e-4dfb-9d63-cb5ff4f68914 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:23.517371 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-33c741d8-807e-4dfb-9d63-cb5ff4f68914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:23.537710 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a29c1-058c-4def-8140-d86c9614747b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:23.538804 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a29c1-058c-4def-8140-d86c9614747b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:23.539084 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a29c1-058c-4def-8140-d86c9614747b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:23.539356 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a29c1-058c-4def-8140-d86c9614747b None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:23.543133 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a29c1-058c-4def-8140-d86c9614747b None admin] RBAC: Authorizing `identity:get_project(project_id=00c44395b45b4dbc8c543b0837e2af1b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:23.544623 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a29c1-058c-4def-8140-d86c9614747b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:23.546503 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 80/159] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:23 2022] GET /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:23.547290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a29c1-058c-4def-8140-d86c9614747b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:23.610637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:23.628431 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 80/160] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:23.629886 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52137c7-f97f-4625-95c2-b4a3bc416272 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:23.630182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52137c7-f97f-4625-95c2-b4a3bc416272 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:23.631018 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52137c7-f97f-4625-95c2-b4a3bc416272 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:23.632505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 81/161] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:23.633745 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52137c7-f97f-4625-95c2-b4a3bc416272 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:23.733656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a29c1-058c-4def-8140-d86c9614747b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:23.768670 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:23.776690 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f21522-b5c3-4de3-b953-7f57be05f0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:23.777437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f21522-b5c3-4de3-b953-7f57be05f0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:23.777721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f21522-b5c3-4de3-b953-7f57be05f0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:23.777993 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f21522-b5c3-4de3-b953-7f57be05f0b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:23.778789 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f21522-b5c3-4de3-b953-7f57be05f0b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:23.779098 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f21522-b5c3-4de3-b953-7f57be05f0b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:23.780488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f21522-b5c3-4de3-b953-7f57be05f0b4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:23.782491 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52137c7-f97f-4625-95c2-b4a3bc416272 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:23.790025 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 81/162] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:23.792278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94a1f5-d406-4706-9406-5d485567e75c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:23.792573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94a1f5-d406-4706-9406-5d485567e75c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:23.792852 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94a1f5-d406-4706-9406-5d485567e75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:23.811052 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4f94a1f5-d406-4706-9406-5d485567e75c None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:23.812264 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4f94a1f5-d406-4706-9406-5d485567e75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:23.848507 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b8977-b22b-4027-82ed-a1c16943f2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:23.849531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b8977-b22b-4027-82ed-a1c16943f2ca None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:23.849813 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b8977-b22b-4027-82ed-a1c16943f2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:23.850087 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b8977-b22b-4027-82ed-a1c16943f2ca None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b/users/3f93e30a141a4cbe9c60dd8a25a63719/roles/afe0f864483d4f3186a49ce8d33ecd74` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:23.852319 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b8977-b22b-4027-82ed-a1c16943f2ca None admin] RBAC: Authorizing `identity:create_grant(project_id=00c44395b45b4dbc8c543b0837e2af1b, user_id=3f93e30a141a4cbe9c60dd8a25a63719, role_id=afe0f864483d4f3186a49ce8d33ecd74)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:23.854414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b8977-b22b-4027-82ed-a1c16943f2ca None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:23.880286 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 82/163] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:10:23 2022] PUT /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b/users/3f93e30a141a4cbe9c60dd8a25a63719/roles/afe0f864483d4f3186a49ce8d33ecd74 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:10:23.880898 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b8977-b22b-4027-82ed-a1c16943f2ca None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:23.884141 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 82/164] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:23.885058 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94a1f5-d406-4706-9406-5d485567e75c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:23.913199 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:23.997619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94a1f5-d406-4706-9406-5d485567e75c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:24.036761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26726f18-cb53-41d1-8c63-29eb9eb5c65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:24.037890 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26726f18-cb53-41d1-8c63-29eb9eb5c65e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:24.038364 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26726f18-cb53-41d1-8c63-29eb9eb5c65e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:24.038786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26726f18-cb53-41d1-8c63-29eb9eb5c65e None admin] PATH_INFO: `/v3/users/b8c2d1f725864ea29520d2932bc19d10` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:24.040197 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26726f18-cb53-41d1-8c63-29eb9eb5c65e None admin] RBAC: Authorizing `identity:get_user(user_id=b8c2d1f725864ea29520d2932bc19d10)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:24.042421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26726f18-cb53-41d1-8c63-29eb9eb5c65e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:24.044310 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 83/165] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:23 2022] GET /identity/v3/users/b8c2d1f725864ea29520d2932bc19d10 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:24.045281 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26726f18-cb53-41d1-8c63-29eb9eb5c65e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:24.076719 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b8977-b22b-4027-82ed-a1c16943f2ca None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:24.148510 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:24.158098 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e4ca7-d165-4e40-ad27-a9137a2fec92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:24.159303 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e4ca7-d165-4e40-ad27-a9137a2fec92 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:24.159742 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e4ca7-d165-4e40-ad27-a9137a2fec92 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:24.160376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26726f18-cb53-41d1-8c63-29eb9eb5c65e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:24.160562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e4ca7-d165-4e40-ad27-a9137a2fec92 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:24.183259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e4ca7-d165-4e40-ad27-a9137a2fec92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:24.197049 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a889f-2aee-4776-b8a0-5203f289f7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:24.197977 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-e79e4ca7-d165-4e40-ad27-a9137a2fec92 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:24.197977 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:24.197977 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:24.197977 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:24.197977 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:24.197977 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:24.197977 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:24.197977 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:24.197977 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:24.197977 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:24.197977 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:24.197977 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:24.197977 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:24.197977 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:24.197977 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:24.197977 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:24.199078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:24.199078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:24.199078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:24.199078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:24.199078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:24.199078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:24.199078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:24.199078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:24.199078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:24.199078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:24.199078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:24.199078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:24.199078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:24.199078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:24.199078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:24.199078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:24.200077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:24.200077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:24.200077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:24.200077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:24.200077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:24.200077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:24.200077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:24.200077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:24.200077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:24.200077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:24.200077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:24.200077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:24.201031 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a889f-2aee-4776-b8a0-5203f289f7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:24.201031 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a889f-2aee-4776-b8a0-5203f289f7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:24.201031 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a889f-2aee-4776-b8a0-5203f289f7e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:24.202895 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 83/166] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 20 19:10:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:24.203982 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e4ca7-d165-4e40-ad27-a9137a2fec92 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:24.217044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a889f-2aee-4776-b8a0-5203f289f7e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:24.225242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e18a889f-2aee-4776-b8a0-5203f289f7e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:24.225242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:24.225242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:24.225242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:24.225242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:24.225242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:24.225242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:24.225242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:24.225242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:24.225242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:24.225242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:24.225242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:24.225242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:24.225242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:24.225242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:24.225242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:24.226437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:24.226437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:24.226437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:24.226437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:24.226437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:24.226437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:24.226437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:24.226437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:24.226437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:24.226437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:24.226437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:24.226437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:24.226437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:24.226437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:24.226437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:24.226437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:24.227421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:24.227421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:24.227421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:24.227421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:24.227421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:24.227421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:24.227421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:24.227421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:24.227421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:24.227421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:24.227421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:24.227421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:24.229174 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 84/167] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:24.230137 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a889f-2aee-4776-b8a0-5203f289f7e5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:24.242554 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:24.339497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a889f-2aee-4776-b8a0-5203f289f7e5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:24.364572 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e4ca7-d165-4e40-ad27-a9137a2fec92 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:24.395431 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238dedd-f765-4922-83c0-c9d0e67becea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:24.396389 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238dedd-f765-4922-83c0-c9d0e67becea None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:24.396974 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238dedd-f765-4922-83c0-c9d0e67becea None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:24.398584 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238dedd-f765-4922-83c0-c9d0e67becea None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:24.400214 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238dedd-f765-4922-83c0-c9d0e67becea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:24.401897 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238dedd-f765-4922-83c0-c9d0e67becea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:24.403544 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238dedd-f765-4922-83c0-c9d0e67becea None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:24.420584 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 85/168] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:10:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:24.422053 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a03f01-1e10-4292-a627-724699643dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:24.422922 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a03f01-1e10-4292-a627-724699643dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:24.423355 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a03f01-1e10-4292-a627-724699643dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:24.423805 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a03f01-1e10-4292-a627-724699643dd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:24.430326 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238dedd-f765-4922-83c0-c9d0e67becea None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:24.465186 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:24.589207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a03f01-1e10-4292-a627-724699643dd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:24.590782 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a03f01-1e10-4292-a627-724699643dd8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:24.610294 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:24.683781 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238dedd-f765-4922-83c0-c9d0e67becea None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:24.700121 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 84/169] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:24.700979 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a03f01-1e10-4292-a627-724699643dd8 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:24.775709 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032dd5c-90dd-4974-bc57-5c4cc4757dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:24.776402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032dd5c-90dd-4974-bc57-5c4cc4757dcb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:24.776690 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032dd5c-90dd-4974-bc57-5c4cc4757dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:24.776968 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032dd5c-90dd-4974-bc57-5c4cc4757dcb None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:24.777737 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032dd5c-90dd-4974-bc57-5c4cc4757dcb None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:24.778042 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032dd5c-90dd-4974-bc57-5c4cc4757dcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:24.779464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032dd5c-90dd-4974-bc57-5c4cc4757dcb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:24.793065 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 86/170] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:24.796102 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032dd5c-90dd-4974-bc57-5c4cc4757dcb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:24.817141 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a03f01-1e10-4292-a627-724699643dd8 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:24.836735 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:24.861285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e156d1a-a5f6-4232-9b33-bb63a94ed8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:24.862239 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e156d1a-a5f6-4232-9b33-bb63a94ed8ee None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:24.862551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e156d1a-a5f6-4232-9b33-bb63a94ed8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:24.862817 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e156d1a-a5f6-4232-9b33-bb63a94ed8ee None admin] PATH_INFO: `/v3/users/22ebe6448aef4c2db9814012429e92af` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:24.865717 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e156d1a-a5f6-4232-9b33-bb63a94ed8ee None admin] RBAC: Authorizing `identity:get_user(user_id=22ebe6448aef4c2db9814012429e92af)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:24.867203 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e156d1a-a5f6-4232-9b33-bb63a94ed8ee None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:24.868877 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 85/171] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:24 2022] GET /identity/v3/users/22ebe6448aef4c2db9814012429e92af => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:24.870236 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e156d1a-a5f6-4232-9b33-bb63a94ed8ee None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:24.933139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:24.991201 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032dd5c-90dd-4974-bc57-5c4cc4757dcb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:25.044678 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e156d1a-a5f6-4232-9b33-bb63a94ed8ee None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:25.072964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191e974-8861-464d-8d18-f08e90835d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:25.073954 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191e974-8861-464d-8d18-f08e90835d1f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:25.074243 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191e974-8861-464d-8d18-f08e90835d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:25.074544 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191e974-8861-464d-8d18-f08e90835d1f None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:25.075827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191e974-8861-464d-8d18-f08e90835d1f None admin] RBAC: Authorizing `identity:get_project(project_id=00c44395b45b4dbc8c543b0837e2af1b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:25.077509 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191e974-8861-464d-8d18-f08e90835d1f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:25.082773 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 87/172] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:24 2022] GET /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:25.082773 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191e974-8861-464d-8d18-f08e90835d1f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:25.102721 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330f047-d651-47e0-bf7a-e0be05ba9733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:25.104878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330f047-d651-47e0-bf7a-e0be05ba9733 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:25.105319 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330f047-d651-47e0-bf7a-e0be05ba9733 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:25.105739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330f047-d651-47e0-bf7a-e0be05ba9733 None admin] PATH_INFO: `/v3/users/22ebe6448aef4c2db9814012429e92af` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:25.107160 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330f047-d651-47e0-bf7a-e0be05ba9733 None admin] RBAC: Authorizing `identity:get_user(user_id=22ebe6448aef4c2db9814012429e92af)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:25.108820 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330f047-d651-47e0-bf7a-e0be05ba9733 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:25.111012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 86/173] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:24 2022] GET /identity/v3/users/22ebe6448aef4c2db9814012429e92af => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:25.112031 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330f047-d651-47e0-bf7a-e0be05ba9733 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:25.210330 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:25.260807 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191e974-8861-464d-8d18-f08e90835d1f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:25.270134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330f047-d651-47e0-bf7a-e0be05ba9733 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:25.298191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9b3f3-edf9-4f03-bbe4-10075884baf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:25.299408 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9b3f3-edf9-4f03-bbe4-10075884baf1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:25.299695 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9b3f3-edf9-4f03-bbe4-10075884baf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:25.299973 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9b3f3-edf9-4f03-bbe4-10075884baf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:25.325450 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:25.337031 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e914b3-0460-41d8-a7b2-83d8394415c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:25.337706 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e914b3-0460-41d8-a7b2-83d8394415c2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:25.338030 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e914b3-0460-41d8-a7b2-83d8394415c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:25.338329 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e914b3-0460-41d8-a7b2-83d8394415c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:25.339164 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e914b3-0460-41d8-a7b2-83d8394415c2 None admin] RBAC: Adding query filter params (role.id=6322f657162c45ca85f019a408655ff3, scope.project.id=00c44395b45b4dbc8c543b0837e2af1b, user.id=b8c2d1f725864ea29520d2932bc19d10) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:25.339477 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e914b3-0460-41d8-a7b2-83d8394415c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:25.343602 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e914b3-0460-41d8-a7b2-83d8394415c2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:25.354351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 87/174] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:25 2022] GET /identity/v3/role_assignments?user.id=b8c2d1f725864ea29520d2932bc19d10&scope.project.id=00c44395b45b4dbc8c543b0837e2af1b&role.id=6322f657162c45ca85f019a408655ff3 => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:25.359182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e914b3-0460-41d8-a7b2-83d8394415c2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:25.400082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9b3f3-edf9-4f03-bbe4-10075884baf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:25.402473 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9b3f3-edf9-4f03-bbe4-10075884baf1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:25.520676 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 88/175] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:25.527368 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9b3f3-edf9-4f03-bbe4-10075884baf1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:25.575132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:25.591680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e914b3-0460-41d8-a7b2-83d8394415c2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:25.625018 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:25.637504 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9b3f3-edf9-4f03-bbe4-10075884baf1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:25.665742 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f52d4-0b90-4b95-9523-e3b28f911a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:25.666905 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f52d4-0b90-4b95-9523-e3b28f911a4f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:25.667189 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f52d4-0b90-4b95-9523-e3b28f911a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:25.667464 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f52d4-0b90-4b95-9523-e3b28f911a4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:25.677499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb41704-a91f-4057-9039-c3038d575c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:25.678536 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb41704-a91f-4057-9039-c3038d575c20 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:25.678891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb41704-a91f-4057-9039-c3038d575c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:25.679237 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb41704-a91f-4057-9039-c3038d575c20 None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:25.680580 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb41704-a91f-4057-9039-c3038d575c20 None admin] RBAC: Authorizing `identity:get_project(project_id=00c44395b45b4dbc8c543b0837e2af1b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:25.682159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb41704-a91f-4057-9039-c3038d575c20 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:25.684219 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 89/176] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:25 2022] GET /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:25.690283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb41704-a91f-4057-9039-c3038d575c20 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:25.796854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb41704-a91f-4057-9039-c3038d575c20 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:25.809790 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:25.820695 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f52d4-0b90-4b95-9523-e3b28f911a4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:25.822770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f52d4-0b90-4b95-9523-e3b28f911a4f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:25.854471 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39357e-dc52-4a15-8265-ef0a41894d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:25.855366 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39357e-dc52-4a15-8265-ef0a41894d5d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:25.855804 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39357e-dc52-4a15-8265-ef0a41894d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:25.856229 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39357e-dc52-4a15-8265-ef0a41894d5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:25.857462 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39357e-dc52-4a15-8265-ef0a41894d5d None admin] RBAC: Adding query filter params (role.id=61bf7de1301f489ab3311c954d548da5, scope.project.id=00c44395b45b4dbc8c543b0837e2af1b, user.id=22ebe6448aef4c2db9814012429e92af) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:25.857925 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39357e-dc52-4a15-8265-ef0a41894d5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:25.860095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39357e-dc52-4a15-8265-ef0a41894d5d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:25.870159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 90/177] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:25 2022] GET /identity/v3/role_assignments?user.id=22ebe6448aef4c2db9814012429e92af&scope.project.id=00c44395b45b4dbc8c543b0837e2af1b&role.id=61bf7de1301f489ab3311c954d548da5 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:25.977179 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 88/178] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:25.984917 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39357e-dc52-4a15-8265-ef0a41894d5d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:25.985558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d1caf-be6a-4d4c-91cb-e12e1c5825d3 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:25.985850 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d1caf-be6a-4d4c-91cb-e12e1c5825d3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:25.986124 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d1caf-be6a-4d4c-91cb-e12e1c5825d3 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:25.987536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 89/179] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:10:25.993091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f18a41-5c0f-4343-899a-5786c94b40f2 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:25.993380 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f18a41-5c0f-4343-899a-5786c94b40f2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:25.993661 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f18a41-5c0f-4343-899a-5786c94b40f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:26.012651 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-33f18a41-5c0f-4343-899a-5786c94b40f2 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:26.013965 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-33f18a41-5c0f-4343-899a-5786c94b40f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:26.042115 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:26.102576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 90/180] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:26.128761 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f18a41-5c0f-4343-899a-5786c94b40f2 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:26.178374 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39357e-dc52-4a15-8265-ef0a41894d5d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:26.259459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2236e-efbc-4af2-aabf-6e371b9c4305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:26.263691 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2236e-efbc-4af2-aabf-6e371b9c4305 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:26.263691 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2236e-efbc-4af2-aabf-6e371b9c4305 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:26.263691 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2236e-efbc-4af2-aabf-6e371b9c4305 None admin] PATH_INFO: `/v3/projects/93f4cc5404d0485787ba09642a4976ad` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:26.263691 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2236e-efbc-4af2-aabf-6e371b9c4305 None admin] RBAC: Authorizing `identity:get_project(project_id=93f4cc5404d0485787ba09642a4976ad)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:26.264449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2236e-efbc-4af2-aabf-6e371b9c4305 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:26.265959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 91/181] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:25 2022] GET /identity/v3/projects/93f4cc5404d0485787ba09642a4976ad => generated 312 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:26.274784 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2236e-efbc-4af2-aabf-6e371b9c4305 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:26.311445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f18a41-5c0f-4343-899a-5786c94b40f2 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:26.353039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a8645-a14d-4d67-930d-2dcfeeda9f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:26.353890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a8645-a14d-4d67-930d-2dcfeeda9f71 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:26.354176 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a8645-a14d-4d67-930d-2dcfeeda9f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:26.354490 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a8645-a14d-4d67-930d-2dcfeeda9f71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:26.367922 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a8645-a14d-4d67-930d-2dcfeeda9f71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:26.373981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:26.381650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-9c3a8645-a14d-4d67-930d-2dcfeeda9f71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:26.381650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:26.381650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:26.381650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:26.381650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:26.381650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:26.381650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:26.381650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:26.381650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:26.381650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:26.381650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:26.381650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:26.381650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:26.381650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:26.381650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:26.381650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:26.382600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:26.382600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:26.382600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:26.382600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:26.382600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:26.382600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:26.382600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:26.382600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:26.382600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:26.382600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:26.382600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:26.382600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:26.382600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:26.382600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:26.382600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:26.382600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:26.383406 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:26.383406 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:26.383406 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:26.383406 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:26.383406 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:26.383406 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:26.383406 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:26.383406 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:26.383406 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:26.383406 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:26.383406 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:26.383406 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:26.383406 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 91/182] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:10:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:10:26.390151 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a8645-a14d-4d67-930d-2dcfeeda9f71 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:26.418687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:26.539174 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a8645-a14d-4d67-930d-2dcfeeda9f71 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:26.545231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2236e-efbc-4af2-aabf-6e371b9c4305 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:26.610708 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c4a56-09dd-4890-8cee-6d75c6de04cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:26.611404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c4a56-09dd-4890-8cee-6d75c6de04cc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:26.611774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c4a56-09dd-4890-8cee-6d75c6de04cc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:26.612055 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c4a56-09dd-4890-8cee-6d75c6de04cc None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:26.612876 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c4a56-09dd-4890-8cee-6d75c6de04cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:26.613176 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c4a56-09dd-4890-8cee-6d75c6de04cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:26.614596 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c4a56-09dd-4890-8cee-6d75c6de04cc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:26.615892 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868de898-533c-4a42-acd7-eeaf2db5a137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:26.616885 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868de898-533c-4a42-acd7-eeaf2db5a137 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:26.617170 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868de898-533c-4a42-acd7-eeaf2db5a137 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:26.617448 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868de898-533c-4a42-acd7-eeaf2db5a137 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:26.618316 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868de898-533c-4a42-acd7-eeaf2db5a137 None admin] RBAC: Adding query filter params (role.id=8b31123e2813440db5a70f87fa5bd932, scope.project.id=93f4cc5404d0485787ba09642a4976ad, user.id=22ebe6448aef4c2db9814012429e92af) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:26.618633 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868de898-533c-4a42-acd7-eeaf2db5a137 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:26.621162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868de898-533c-4a42-acd7-eeaf2db5a137 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:26.626466 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 92/183] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:26.628019 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f30a2-5762-4c9a-ae26-bdf48e11a468 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:26.628513 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f30a2-5762-4c9a-ae26-bdf48e11a468 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:26.629012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f30a2-5762-4c9a-ae26-bdf48e11a468 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:26.630757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 93/184] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:26.631660 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f30a2-5762-4c9a-ae26-bdf48e11a468 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:26.636463 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 92/185] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:26 2022] GET /identity/v3/role_assignments?user.id=22ebe6448aef4c2db9814012429e92af&scope.project.id=93f4cc5404d0485787ba09642a4976ad&role.id=8b31123e2813440db5a70f87fa5bd932 => generated 608 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:26.642340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f4194-a24e-4240-8166-382ed6909d07 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:26.642340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f4194-a24e-4240-8166-382ed6909d07 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:26.642340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f4194-a24e-4240-8166-382ed6909d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:26.660949 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-df4f4194-a24e-4240-8166-382ed6909d07 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:26.662192 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-df4f4194-a24e-4240-8166-382ed6909d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:26.758848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:26.793799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f30a2-5762-4c9a-ae26-bdf48e11a468 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:26.830744 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7a328-74b8-4080-9542-e7b7671d872b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:26.831769 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7a328-74b8-4080-9542-e7b7671d872b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:26.832057 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7a328-74b8-4080-9542-e7b7671d872b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:26.832334 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7a328-74b8-4080-9542-e7b7671d872b None admin] PATH_INFO: `/v3/users/30918c7b389345be855d5dee052d0f85` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:26.834401 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 93/186] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:26.852777 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7a328-74b8-4080-9542-e7b7671d872b None admin] RBAC: Authorizing `identity:get_user(user_id=30918c7b389345be855d5dee052d0f85)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:26.855134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7a328-74b8-4080-9542-e7b7671d872b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:26.857091 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f4194-a24e-4240-8166-382ed6909d07 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:26.857932 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 94/187] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:26 2022] GET /identity/v3/users/30918c7b389345be855d5dee052d0f85 => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:26.867685 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7a328-74b8-4080-9542-e7b7671d872b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:26.918802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:26.995568 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7a328-74b8-4080-9542-e7b7671d872b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:26.997076 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f4194-a24e-4240-8166-382ed6909d07 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:27.024372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:27.036141 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e815c11-0231-449d-bd0f-b77faea72305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:27.036968 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e815c11-0231-449d-bd0f-b77faea72305 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:27.037255 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e815c11-0231-449d-bd0f-b77faea72305 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:27.037536 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e815c11-0231-449d-bd0f-b77faea72305 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:27.040746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167f111-785c-4d51-9b07-819d20158ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:27.042090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167f111-785c-4d51-9b07-819d20158ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:27.042413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167f111-785c-4d51-9b07-819d20158ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:27.042701 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167f111-785c-4d51-9b07-819d20158ff5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:27.050099 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e815c11-0231-449d-bd0f-b77faea72305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:27.059447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1e815c11-0231-449d-bd0f-b77faea72305 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:27.059447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:27.059447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:27.059447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:27.059447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:27.059447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:27.059447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:27.059447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:27.059447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:27.059447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:27.059447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:27.059447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:27.059447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:27.059447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:27.059447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:27.059447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:27.060583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:27.060583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:27.060583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:27.060583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:27.060583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:27.060583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:27.060583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:27.060583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:27.060583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:27.060583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:27.060583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:27.060583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:27.060583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:27.060583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:27.060583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:27.060583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:27.061768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:27.061768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:27.061768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:27.061768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:27.061768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:27.061768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:27.061768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:27.061768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:27.061768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:27.061768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:27.061768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:27.061768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:27.061768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 94/188] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 20 19:10:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:10:27.062836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc9a87-6441-481a-bc55-b845fec28ee4 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:27.062836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc9a87-6441-481a-bc55-b845fec28ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:27.062836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc9a87-6441-481a-bc55-b845fec28ee4 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:27.064334 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 95/189] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:27.068926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc9a87-6441-481a-bc55-b845fec28ee4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:27.132170 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167f111-785c-4d51-9b07-819d20158ff5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:27.134049 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167f111-785c-4d51-9b07-819d20158ff5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:27.173485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:27.180860 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc9a87-6441-481a-bc55-b845fec28ee4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:27.217374 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff3909-5dab-4615-9fca-e7d61f6abb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:27.218051 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff3909-5dab-4615-9fca-e7d61f6abb4c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:27.218362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff3909-5dab-4615-9fca-e7d61f6abb4c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:27.218647 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff3909-5dab-4615-9fca-e7d61f6abb4c None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:27.219409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff3909-5dab-4615-9fca-e7d61f6abb4c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:27.219717 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff3909-5dab-4615-9fca-e7d61f6abb4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:27.221122 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff3909-5dab-4615-9fca-e7d61f6abb4c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:27.234498 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 96/190] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:10:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:27.234498 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c8fce-b062-460d-8d54-db76cb960dc7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:27.234498 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c8fce-b062-460d-8d54-db76cb960dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:27.234498 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c8fce-b062-460d-8d54-db76cb960dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:27.254537 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 95/191] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:27.259373 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c70c8fce-b062-460d-8d54-db76cb960dc7 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:27.259373 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c70c8fce-b062-460d-8d54-db76cb960dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:27.259513 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167f111-785c-4d51-9b07-819d20158ff5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:27.292240 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:27.331339 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 97/192] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:27.332183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c8fce-b062-460d-8d54-db76cb960dc7 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:27.379792 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167f111-785c-4d51-9b07-819d20158ff5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:27.419236 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbdfe0-5f6a-4645-9a50-debc7da19ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:27.420109 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbdfe0-5f6a-4645-9a50-debc7da19ece None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:27.420396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbdfe0-5f6a-4645-9a50-debc7da19ece None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:27.420668 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbdfe0-5f6a-4645-9a50-debc7da19ece None admin] PATH_INFO: `/v3/users/30918c7b389345be855d5dee052d0f85` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:27.421866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbdfe0-5f6a-4645-9a50-debc7da19ece None admin] RBAC: Authorizing `identity:get_user(user_id=30918c7b389345be855d5dee052d0f85)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:27.423400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdbdfe0-5f6a-4645-9a50-debc7da19ece None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:27.423628 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:27.425036 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 96/193] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:27 2022] GET /identity/v3/users/30918c7b389345be855d5dee052d0f85 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:27.426380 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080bbe7-7eea-4809-bf27-fb56abba27da None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:27.426682 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080bbe7-7eea-4809-bf27-fb56abba27da None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:27.426967 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080bbe7-7eea-4809-bf27-fb56abba27da None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:27.428210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 97/194] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:27.431094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080bbe7-7eea-4809-bf27-fb56abba27da None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:27.438143 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c8fce-b062-460d-8d54-db76cb960dc7 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:27.473402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bc751-2702-49a5-82f5-bea680df6cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:27.474271 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bc751-2702-49a5-82f5-bea680df6cde None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:27.474589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bc751-2702-49a5-82f5-bea680df6cde None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:27.474869 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313bc751-2702-49a5-82f5-bea680df6cde None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:27.476065 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bc751-2702-49a5-82f5-bea680df6cde None admin] RBAC: Authorizing `identity:get_project(project_id=1cf408d461524402acb8b395a622adc4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:27.477801 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313bc751-2702-49a5-82f5-bea680df6cde None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:27.479603 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 98/195] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:27 2022] GET /identity/v3/projects/1cf408d461524402acb8b395a622adc4 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:27.480394 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bc751-2702-49a5-82f5-bea680df6cde None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:27.532311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:27.540540 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080bbe7-7eea-4809-bf27-fb56abba27da None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:27.576946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cbbb6-eaaf-4df7-b4e5-3e414f69d10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:27.577748 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cbbb6-eaaf-4df7-b4e5-3e414f69d10a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:27.578031 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cbbb6-eaaf-4df7-b4e5-3e414f69d10a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:27.578321 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cbbb6-eaaf-4df7-b4e5-3e414f69d10a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:27.579574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cbbb6-eaaf-4df7-b4e5-3e414f69d10a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:27.580998 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cbbb6-eaaf-4df7-b4e5-3e414f69d10a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:27.582680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 98/196] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:27.583369 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313bc751-2702-49a5-82f5-bea680df6cde None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:27.587655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22eae9-64eb-48b7-b7e2-954fef68d000 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:27.588484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22eae9-64eb-48b7-b7e2-954fef68d000 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:27.588763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22eae9-64eb-48b7-b7e2-954fef68d000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:27.607309 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-cb22eae9-64eb-48b7-b7e2-954fef68d000 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:27.608517 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cb22eae9-64eb-48b7-b7e2-954fef68d000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:27.618716 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406f750-43a4-454d-82ab-af9eec9c0a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:27.619402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406f750-43a4-454d-82ab-af9eec9c0a36 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:27.619681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406f750-43a4-454d-82ab-af9eec9c0a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:27.619956 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406f750-43a4-454d-82ab-af9eec9c0a36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:27.646280 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:27.684132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 99/197] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:27.685034 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22eae9-64eb-48b7-b7e2-954fef68d000 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:27.691433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406f750-43a4-454d-82ab-af9eec9c0a36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:27.693134 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406f750-43a4-454d-82ab-af9eec9c0a36 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:27.786235 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:27.794116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22eae9-64eb-48b7-b7e2-954fef68d000 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:27.805009 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 99/198] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:27.805009 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406f750-43a4-454d-82ab-af9eec9c0a36 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:27.829385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05aec15-749e-446d-ae7c-7344bef76047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:27.830040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05aec15-749e-446d-ae7c-7344bef76047 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:27.830345 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05aec15-749e-446d-ae7c-7344bef76047 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:27.830625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05aec15-749e-446d-ae7c-7344bef76047 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:27.831444 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05aec15-749e-446d-ae7c-7344bef76047 None admin] RBAC: Adding query filter params (role.id=6322f657162c45ca85f019a408655ff3, scope.project.id=1cf408d461524402acb8b395a622adc4, user.id=30918c7b389345be855d5dee052d0f85) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:27.831753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05aec15-749e-446d-ae7c-7344bef76047 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:27.833238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05aec15-749e-446d-ae7c-7344bef76047 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:27.838540 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 100/199] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:27 2022] GET /identity/v3/role_assignments?user.id=30918c7b389345be855d5dee052d0f85&scope.project.id=1cf408d461524402acb8b395a622adc4&role.id=6322f657162c45ca85f019a408655ff3 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:27.839310 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05aec15-749e-446d-ae7c-7344bef76047 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:27.869995 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:27.926196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406f750-43a4-454d-82ab-af9eec9c0a36 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:27.973278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8bc33-50e5-4231-861a-73c2e75bc003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:27.973970 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8bc33-50e5-4231-861a-73c2e75bc003 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:27.974259 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8bc33-50e5-4231-861a-73c2e75bc003 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:27.974570 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8bc33-50e5-4231-861a-73c2e75bc003 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:27.975312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8bc33-50e5-4231-861a-73c2e75bc003 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:27.976798 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8bc33-50e5-4231-861a-73c2e75bc003 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:28.010345 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 100/200] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 20 19:10:27 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:28.010345 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8bc33-50e5-4231-861a-73c2e75bc003 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:28.024659 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05aec15-749e-446d-ae7c-7344bef76047 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:28.088697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e383f-683f-4477-906d-300ae82cd211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:28.089423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e383f-683f-4477-906d-300ae82cd211 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:28.089752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e383f-683f-4477-906d-300ae82cd211 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:28.090061 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e383f-683f-4477-906d-300ae82cd211 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:28.109591 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e383f-683f-4477-906d-300ae82cd211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:28.120860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-764e383f-683f-4477-906d-300ae82cd211 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:28.120860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:28.120860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:28.120860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:28.120860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:28.120860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:28.120860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:28.120860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:28.120860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:28.120860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:28.120860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:28.120860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:28.120860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:28.120860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:28.120860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:28.120860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:28.122625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:28.122625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:28.122625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:28.122625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:28.122625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:28.122625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:28.122625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:28.122625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:28.122625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:28.122625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:28.122625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:28.122625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:28.122625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:28.122625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:28.122625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:28.122625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:28.124194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:28.124194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:28.124194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:28.124194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:28.124194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:28.124194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:28.124194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:28.124194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:28.124194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:28.124194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:28.124194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:28.124194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:28.124194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 101/201] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:28.129146 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e383f-683f-4477-906d-300ae82cd211 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:28.152127 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8bc33-50e5-4231-861a-73c2e75bc003 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:28.158323 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:28.169436 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:28.197096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d542a-615c-4a95-8e5f-5c4ea606c283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:28.198144 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d542a-615c-4a95-8e5f-5c4ea606c283 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:28.198673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d542a-615c-4a95-8e5f-5c4ea606c283 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:28.199074 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d542a-615c-4a95-8e5f-5c4ea606c283 None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:28.200572 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d542a-615c-4a95-8e5f-5c4ea606c283 None admin] RBAC: Authorizing `identity:get_project(project_id=1cf408d461524402acb8b395a622adc4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:28.202166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d542a-615c-4a95-8e5f-5c4ea606c283 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:28.204317 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 101/202] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:28 2022] GET /identity/v3/projects/1cf408d461524402acb8b395a622adc4 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:28.210404 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d542a-615c-4a95-8e5f-5c4ea606c283 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:28.289330 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e383f-683f-4477-906d-300ae82cd211 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:28.346377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f59436-2862-45d3-a632-0289bdb76674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:28.347229 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f59436-2862-45d3-a632-0289bdb76674 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:28.347712 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f59436-2862-45d3-a632-0289bdb76674 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:28.348055 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f59436-2862-45d3-a632-0289bdb76674 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:28.349229 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f59436-2862-45d3-a632-0289bdb76674 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:28.349993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f59436-2862-45d3-a632-0289bdb76674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:28.351712 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f59436-2862-45d3-a632-0289bdb76674 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:28.356224 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d542a-615c-4a95-8e5f-5c4ea606c283 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:28.364795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 102/203] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:28.370914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f59436-2862-45d3-a632-0289bdb76674 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:28.399665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223f003-b5b0-4ff3-aafa-75247aba9800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:28.400854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223f003-b5b0-4ff3-aafa-75247aba9800 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:28.401140 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223f003-b5b0-4ff3-aafa-75247aba9800 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:28.401410 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223f003-b5b0-4ff3-aafa-75247aba9800 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:28.402553 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223f003-b5b0-4ff3-aafa-75247aba9800 None admin] RBAC: Adding query filter params (role.id=61bf7de1301f489ab3311c954d548da5, scope.project.id=1cf408d461524402acb8b395a622adc4, user.id=30918c7b389345be855d5dee052d0f85) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:28.402891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223f003-b5b0-4ff3-aafa-75247aba9800 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:28.404304 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223f003-b5b0-4ff3-aafa-75247aba9800 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:28.411369 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 102/204] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:28 2022] GET /identity/v3/role_assignments?user.id=30918c7b389345be855d5dee052d0f85&scope.project.id=1cf408d461524402acb8b395a622adc4&role.id=61bf7de1301f489ab3311c954d548da5 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:28.491105 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:28.521927 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f59436-2862-45d3-a632-0289bdb76674 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:28.565851 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76feac-7ca3-4e42-944b-ba76ab1714e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:28.566810 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76feac-7ca3-4e42-944b-ba76ab1714e0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:28.567099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76feac-7ca3-4e42-944b-ba76ab1714e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:28.567376 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76feac-7ca3-4e42-944b-ba76ab1714e0 None admin] PATH_INFO: `/v3/users/3f93e30a141a4cbe9c60dd8a25a63719` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:28.568912 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76feac-7ca3-4e42-944b-ba76ab1714e0 None admin] RBAC: Authorizing `identity:get_user(user_id=3f93e30a141a4cbe9c60dd8a25a63719)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:28.570737 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76feac-7ca3-4e42-944b-ba76ab1714e0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:28.574123 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 103/205] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:28 2022] GET /identity/v3/users/3f93e30a141a4cbe9c60dd8a25a63719 => generated 289 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:28.579658 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223f003-b5b0-4ff3-aafa-75247aba9800 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:28.641258 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:28.700163 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223f003-b5b0-4ff3-aafa-75247aba9800 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:28.746341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d99bf8-56df-47a2-92f1-ad4b1febda16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:28.747011 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d99bf8-56df-47a2-92f1-ad4b1febda16 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:28.747296 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d99bf8-56df-47a2-92f1-ad4b1febda16 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:28.747577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d99bf8-56df-47a2-92f1-ad4b1febda16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:28.820660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d99bf8-56df-47a2-92f1-ad4b1febda16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:28.822182 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d99bf8-56df-47a2-92f1-ad4b1febda16 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:28.869571 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:28.928759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 103/206] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:28.935502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76feac-7ca3-4e42-944b-ba76ab1714e0 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:29.104765 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76feac-7ca3-4e42-944b-ba76ab1714e0 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:29.151114 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c83210-dcb5-449d-95f7-9b903034d735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:29.152260 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c83210-dcb5-449d-95f7-9b903034d735 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:29.152689 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c83210-dcb5-449d-95f7-9b903034d735 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:29.153123 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c83210-dcb5-449d-95f7-9b903034d735 None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:29.159043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c83210-dcb5-449d-95f7-9b903034d735 None admin] RBAC: Authorizing `identity:get_project(project_id=00c44395b45b4dbc8c543b0837e2af1b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:29.161620 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c83210-dcb5-449d-95f7-9b903034d735 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:29.163588 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 104/207] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:28 2022] GET /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:29.170630 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d99bf8-56df-47a2-92f1-ad4b1febda16 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:29.314950 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d99bf8-56df-47a2-92f1-ad4b1febda16 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:29.368026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29204ee7-0b97-4b92-82a4-fd977b62759f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:29.368691 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29204ee7-0b97-4b92-82a4-fd977b62759f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:29.369013 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29204ee7-0b97-4b92-82a4-fd977b62759f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:29.369296 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29204ee7-0b97-4b92-82a4-fd977b62759f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:29.370150 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29204ee7-0b97-4b92-82a4-fd977b62759f None admin] RBAC: Adding query filter params (role.id=afe0f864483d4f3186a49ce8d33ecd74, scope.project.id=00c44395b45b4dbc8c543b0837e2af1b, user.id=3f93e30a141a4cbe9c60dd8a25a63719) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:29.370493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29204ee7-0b97-4b92-82a4-fd977b62759f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:29.371951 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29204ee7-0b97-4b92-82a4-fd977b62759f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:29.381606 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 104/208] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:29 2022] GET /identity/v3/role_assignments?user.id=3f93e30a141a4cbe9c60dd8a25a63719&scope.project.id=00c44395b45b4dbc8c543b0837e2af1b&role.id=afe0f864483d4f3186a49ce8d33ecd74 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:30.361741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d9c45-d9ba-4573-8fba-032f714fe998 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:30.362784 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d9c45-d9ba-4573-8fba-032f714fe998 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:30.363268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d9c45-d9ba-4573-8fba-032f714fe998 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:30.364849 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 105/209] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:10:30.371361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c50cc-f40b-4e8e-a09d-7ba0cbd30a38 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:30.372246 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c50cc-f40b-4e8e-a09d-7ba0cbd30a38 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:30.372748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c50cc-f40b-4e8e-a09d-7ba0cbd30a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:30.390819 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-db1c50cc-f40b-4e8e-a09d-7ba0cbd30a38 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:30.392634 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-db1c50cc-f40b-4e8e-a09d-7ba0cbd30a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:30.395128 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:30.485414 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 105/210] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:30.508896 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d9c45-d9ba-4573-8fba-032f714fe998 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:30.529432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:30.621058 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d9c45-d9ba-4573-8fba-032f714fe998 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:30.656185 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428de94f-c5a1-49f3-8b27-dd9196cb300e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:30.656985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428de94f-c5a1-49f3-8b27-dd9196cb300e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:30.657278 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428de94f-c5a1-49f3-8b27-dd9196cb300e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:30.657557 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428de94f-c5a1-49f3-8b27-dd9196cb300e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:30.669224 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428de94f-c5a1-49f3-8b27-dd9196cb300e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:30.677191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-428de94f-c5a1-49f3-8b27-dd9196cb300e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:30.677191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:30.677191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:30.677191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:30.677191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:30.677191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:30.677191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:30.677191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:30.677191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:30.677191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:30.677191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:30.677191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:30.677191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:30.677191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:30.677191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:30.677191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:30.678132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:30.678132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:30.678132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:30.678132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:30.678132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:30.678132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:30.678132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:30.678132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:30.678132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:30.678132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:30.678132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:30.678132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:30.678132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:30.678132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:30.678132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:30.678132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:30.679005 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:30.679005 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:30.679005 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:30.679005 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:30.679005 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:30.679005 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:30.679005 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:30.679005 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:30.679005 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:30.679005 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:30.679005 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:30.679005 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:30.679005 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 106/211] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:10:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:30.684774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c50cc-f40b-4e8e-a09d-7ba0cbd30a38 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:30.735512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004a797-02c0-4db5-859a-9cc7b03abfc3 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:30.735817 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004a797-02c0-4db5-859a-9cc7b03abfc3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:30.736084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004a797-02c0-4db5-859a-9cc7b03abfc3 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:30.738741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 107/212] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:10:30.746269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c2779-0b25-4629-822f-0f43f63f37ec None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:30.746269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c2779-0b25-4629-822f-0f43f63f37ec None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:30.746727 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c2779-0b25-4629-822f-0f43f63f37ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:30.764827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c41c2779-0b25-4629-822f-0f43f63f37ec None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:30.766335 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c41c2779-0b25-4629-822f-0f43f63f37ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:30.836815 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c50cc-f40b-4e8e-a09d-7ba0cbd30a38 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:30.844679 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 108/213] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:30.847839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64298e-d51f-4f6d-b85a-8ab2bd49d370 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:30.848124 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64298e-d51f-4f6d-b85a-8ab2bd49d370 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:30.848399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64298e-d51f-4f6d-b85a-8ab2bd49d370 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:30.850264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 109/214] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:30.856300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7272a-d2f4-4841-8fac-55767a4cd6f6 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:30.856571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7272a-d2f4-4841-8fac-55767a4cd6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:30.856855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7272a-d2f4-4841-8fac-55767a4cd6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:30.868209 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:30.876088 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-45f7272a-d2f4-4841-8fac-55767a4cd6f6 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:30.877222 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-45f7272a-d2f4-4841-8fac-55767a4cd6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:30.883796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3e32a-3be7-4dae-a381-8c815aad67b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:30.884527 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3e32a-3be7-4dae-a381-8c815aad67b7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:30.884808 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3e32a-3be7-4dae-a381-8c815aad67b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:30.885089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3e32a-3be7-4dae-a381-8c815aad67b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:30.885854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3e32a-3be7-4dae-a381-8c815aad67b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:30.886167 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3e32a-3be7-4dae-a381-8c815aad67b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:30.887600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3e32a-3be7-4dae-a381-8c815aad67b7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:30.893645 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:30.897922 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 106/215] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:30.903285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3e32a-3be7-4dae-a381-8c815aad67b7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:30.951923 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 110/216] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:30.952778 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7272a-d2f4-4841-8fac-55767a4cd6f6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:31.015200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3e32a-3be7-4dae-a381-8c815aad67b7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:31.049385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abab07b-4fe6-4835-94ba-875194d6fc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:31.050177 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abab07b-4fe6-4835-94ba-875194d6fc6f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:31.050500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abab07b-4fe6-4835-94ba-875194d6fc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:31.050775 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abab07b-4fe6-4835-94ba-875194d6fc6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:31.051940 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abab07b-4fe6-4835-94ba-875194d6fc6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:31.053376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abab07b-4fe6-4835-94ba-875194d6fc6f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:31.055132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 107/217] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:31.056337 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a003376-554d-4f5a-880c-6537110d6ddb None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:31.056745 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a003376-554d-4f5a-880c-6537110d6ddb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:31.057138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a003376-554d-4f5a-880c-6537110d6ddb None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:31.057760 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7272a-d2f4-4841-8fac-55767a4cd6f6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:31.062344 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 108/218] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:31.062344 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a003376-554d-4f5a-880c-6537110d6ddb None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:31.104373 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f89581-11f2-47f1-989d-1f78fac918dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:31.105256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f89581-11f2-47f1-989d-1f78fac918dd None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:31.105538 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f89581-11f2-47f1-989d-1f78fac918dd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:31.105812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f89581-11f2-47f1-989d-1f78fac918dd None admin] PATH_INFO: `/v3/users/30918c7b389345be855d5dee052d0f85` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:31.107024 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f89581-11f2-47f1-989d-1f78fac918dd None admin] RBAC: Authorizing `identity:get_user(user_id=30918c7b389345be855d5dee052d0f85)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:31.108783 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f89581-11f2-47f1-989d-1f78fac918dd None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:31.110477 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 111/219] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:30 2022] GET /identity/v3/users/30918c7b389345be855d5dee052d0f85 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:31.111226 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f89581-11f2-47f1-989d-1f78fac918dd None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:31.115655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:31.144228 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:31.181354 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a003376-554d-4f5a-880c-6537110d6ddb None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:31.215737 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cb67d-bba7-4ccc-a6db-9263a7f44066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:31.216531 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cb67d-bba7-4ccc-a6db-9263a7f44066 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:31.216815 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cb67d-bba7-4ccc-a6db-9263a7f44066 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:31.217093 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cb67d-bba7-4ccc-a6db-9263a7f44066 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:31.227420 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cb67d-bba7-4ccc-a6db-9263a7f44066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:31.229606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f89581-11f2-47f1-989d-1f78fac918dd None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:31.235222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f36cb67d-bba7-4ccc-a6db-9263a7f44066 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:31.235222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:31.235222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:31.235222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:31.235222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:31.235222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:31.235222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:31.235222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:31.235222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:31.235222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:31.235222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:31.235222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:31.235222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:31.235222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:31.235222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:31.235222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:31.236249 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:31.236249 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:31.236249 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:31.236249 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:31.236249 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:31.236249 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:31.236249 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:31.236249 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:31.236249 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:31.236249 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:31.236249 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:31.236249 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:31.236249 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:31.236249 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:31.236249 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:31.236249 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:31.237044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:31.237044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:31.237044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:31.237044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:31.237044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:31.237044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:31.237044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:31.237044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:31.237044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:31.237044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:31.237044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:31.237044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:31.238593 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 109/220] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:31.240257 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3797f-f175-49a6-b67f-1a5972408684 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:31.240872 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3797f-f175-49a6-b67f-1a5972408684 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:31.241397 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3797f-f175-49a6-b67f-1a5972408684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:31.257791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-39b3797f-f175-49a6-b67f-1a5972408684 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:31.259008 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-39b3797f-f175-49a6-b67f-1a5972408684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:31.273973 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91f4c6-81df-4b6c-8282-2ffb97fd3ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:31.274687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91f4c6-81df-4b6c-8282-2ffb97fd3ba6 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:31.274993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91f4c6-81df-4b6c-8282-2ffb97fd3ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:31.275802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91f4c6-81df-4b6c-8282-2ffb97fd3ba6 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:31.276517 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91f4c6-81df-4b6c-8282-2ffb97fd3ba6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:31.277985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91f4c6-81df-4b6c-8282-2ffb97fd3ba6 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:31.312715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 112/221] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 20 19:10:31 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:31.319683 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91f4c6-81df-4b6c-8282-2ffb97fd3ba6 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:31.330483 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 110/222] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:31.331757 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3797f-f175-49a6-b67f-1a5972408684 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:31.404447 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:31.409006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:31.464512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91f4c6-81df-4b6c-8282-2ffb97fd3ba6 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:31.465545 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3797f-f175-49a6-b67f-1a5972408684 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:31.507766 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415d195-cafe-4b1d-8c6f-11ee686c1426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:31.508439 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415d195-cafe-4b1d-8c6f-11ee686c1426 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:31.508855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415d195-cafe-4b1d-8c6f-11ee686c1426 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:31.509104 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415d195-cafe-4b1d-8c6f-11ee686c1426 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:31.512546 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415d195-cafe-4b1d-8c6f-11ee686c1426 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:31.512546 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415d195-cafe-4b1d-8c6f-11ee686c1426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:31.512546 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415d195-cafe-4b1d-8c6f-11ee686c1426 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:31.517094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144779bd-31d8-441d-a5b1-549395c89639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:31.518483 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144779bd-31d8-441d-a5b1-549395c89639 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:31.518786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144779bd-31d8-441d-a5b1-549395c89639 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:31.519219 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144779bd-31d8-441d-a5b1-549395c89639 None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:31.520451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144779bd-31d8-441d-a5b1-549395c89639 None admin] RBAC: Authorizing `identity:get_project(project_id=1cf408d461524402acb8b395a622adc4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:31.521559 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 111/223] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:31.522454 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144779bd-31d8-441d-a5b1-549395c89639 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:31.525060 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 113/224] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:31 2022] GET /identity/v3/projects/1cf408d461524402acb8b395a622adc4 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:31.526448 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415d195-cafe-4b1d-8c6f-11ee686c1426 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:31.527360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144779bd-31d8-441d-a5b1-549395c89639 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:31.655896 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144779bd-31d8-441d-a5b1-549395c89639 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:31.658929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415d195-cafe-4b1d-8c6f-11ee686c1426 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:31.682809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:31.687904 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:31.702159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0ed7c-5240-418e-80c8-f147ac772fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:31.703132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0ed7c-5240-418e-80c8-f147ac772fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:31.703412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0ed7c-5240-418e-80c8-f147ac772fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:31.703684 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0ed7c-5240-418e-80c8-f147ac772fe9 None admin] PATH_INFO: `/v3/users/4b15ca047099497a88329e4d3e07dd35` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:31.708198 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1ce01-d610-4eec-b6a3-fc8e5639f403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:31.708848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1ce01-d610-4eec-b6a3-fc8e5639f403 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:31.709125 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1ce01-d610-4eec-b6a3-fc8e5639f403 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:31.709395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1ce01-d610-4eec-b6a3-fc8e5639f403 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:31.724933 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0ed7c-5240-418e-80c8-f147ac772fe9 None admin] RBAC: Authorizing `identity:get_user(user_id=4b15ca047099497a88329e4d3e07dd35)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:31.726283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1ce01-d610-4eec-b6a3-fc8e5639f403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:31.727714 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0ed7c-5240-418e-80c8-f147ac772fe9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:31.730240 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 114/225] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:31 2022] GET /identity/v3/users/4b15ca047099497a88329e4d3e07dd35 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:31.731022 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0ed7c-5240-418e-80c8-f147ac772fe9 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:31.735761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-47e1ce01-d610-4eec-b6a3-fc8e5639f403 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:31.735761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:31.735761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:31.735761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:31.735761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:31.735761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:31.735761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:31.735761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:31.735761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:31.735761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:31.735761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:31.735761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:31.735761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:31.735761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:31.735761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:31.735761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:31.736677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:31.736677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:31.736677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:31.736677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:31.736677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:31.736677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:31.736677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:31.736677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:31.736677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:31.736677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:31.736677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:31.736677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:31.736677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:31.736677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:31.736677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:31.736677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:31.737502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:31.737502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:31.737502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:31.737502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:31.737502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:31.737502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:31.737502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:31.737502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:31.737502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:31.737502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:31.737502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:31.737502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:31.741148 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 112/226] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 20 19:10:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:31.742205 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1ce01-d610-4eec-b6a3-fc8e5639f403 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:31.856980 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0ed7c-5240-418e-80c8-f147ac772fe9 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:31.877784 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1ce01-d610-4eec-b6a3-fc8e5639f403 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:31.903328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89939b-1d6b-4186-aa80-bd1547585b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:31.904895 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89939b-1d6b-4186-aa80-bd1547585b80 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:31.905179 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89939b-1d6b-4186-aa80-bd1547585b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:31.905454 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89939b-1d6b-4186-aa80-bd1547585b80 None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4/users/30918c7b389345be855d5dee052d0f85/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:31.908023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89939b-1d6b-4186-aa80-bd1547585b80 None admin] RBAC: Authorizing `identity:create_grant(project_id=1cf408d461524402acb8b395a622adc4, user_id=30918c7b389345be855d5dee052d0f85, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:31.910121 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89939b-1d6b-4186-aa80-bd1547585b80 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:31.916418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1834df-db1c-45a9-90c8-21fee835d785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:31.917327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1834df-db1c-45a9-90c8-21fee835d785 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:31.917669 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1834df-db1c-45a9-90c8-21fee835d785 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:31.918010 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1834df-db1c-45a9-90c8-21fee835d785 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:31.927441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 115/227] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:10:31 2022] PUT /identity/v3/projects/1cf408d461524402acb8b395a622adc4/users/30918c7b389345be855d5dee052d0f85/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:10:31.929174 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89939b-1d6b-4186-aa80-bd1547585b80 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:31.996718 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:32.044610 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:32.045399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1834df-db1c-45a9-90c8-21fee835d785 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:32.047041 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1834df-db1c-45a9-90c8-21fee835d785 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:32.134018 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89939b-1d6b-4186-aa80-bd1547585b80 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:32.185146 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57657e9e-8754-4da1-9c91-10cf096d6f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:32.185760 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57657e9e-8754-4da1-9c91-10cf096d6f15 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:32.186413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57657e9e-8754-4da1-9c91-10cf096d6f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:32.186712 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57657e9e-8754-4da1-9c91-10cf096d6f15 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:32.187474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57657e9e-8754-4da1-9c91-10cf096d6f15 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:32.188125 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57657e9e-8754-4da1-9c91-10cf096d6f15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:32.189941 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57657e9e-8754-4da1-9c91-10cf096d6f15 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:32.201582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 116/228] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:10:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:32.208232 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57657e9e-8754-4da1-9c91-10cf096d6f15 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:32.211816 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 113/229] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:32.218034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1834df-db1c-45a9-90c8-21fee835d785 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:32.332516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:32.339429 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57657e9e-8754-4da1-9c91-10cf096d6f15 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:32.357590 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:32.358555 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1834df-db1c-45a9-90c8-21fee835d785 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:32.418154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605978b1-9d74-4ec0-a017-c8feffbd7ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:32.422247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605978b1-9d74-4ec0-a017-c8feffbd7ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:32.422247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605978b1-9d74-4ec0-a017-c8feffbd7ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:32.422247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605978b1-9d74-4ec0-a017-c8feffbd7ac3 None admin] PATH_INFO: `/v3/users/30918c7b389345be855d5dee052d0f85` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:32.422247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605978b1-9d74-4ec0-a017-c8feffbd7ac3 None admin] RBAC: Authorizing `identity:get_user(user_id=30918c7b389345be855d5dee052d0f85)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:32.424628 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605978b1-9d74-4ec0-a017-c8feffbd7ac3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:32.429363 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741d83a-4ada-4caf-bce7-90da43214871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:32.430675 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741d83a-4ada-4caf-bce7-90da43214871 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:32.430962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741d83a-4ada-4caf-bce7-90da43214871 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:32.431293 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741d83a-4ada-4caf-bce7-90da43214871 None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:32.432819 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 117/230] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:32 2022] GET /identity/v3/users/30918c7b389345be855d5dee052d0f85 => generated 283 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:32.433522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741d83a-4ada-4caf-bce7-90da43214871 None admin] RBAC: Authorizing `identity:get_project(project_id=1cf408d461524402acb8b395a622adc4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:32.434998 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741d83a-4ada-4caf-bce7-90da43214871 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:32.437188 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 114/231] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:32 2022] GET /identity/v3/projects/1cf408d461524402acb8b395a622adc4 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:32.438280 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605978b1-9d74-4ec0-a017-c8feffbd7ac3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:32.443173 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741d83a-4ada-4caf-bce7-90da43214871 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:32.620637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741d83a-4ada-4caf-bce7-90da43214871 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:32.659294 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c141d-5757-4170-87d9-b54ffe319fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:32.660591 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c141d-5757-4170-87d9-b54ffe319fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:32.661719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c141d-5757-4170-87d9-b54ffe319fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:32.662396 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c141d-5757-4170-87d9-b54ffe319fc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:32.664611 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c141d-5757-4170-87d9-b54ffe319fc9 None admin] RBAC: Adding query filter params (role.id=8b31123e2813440db5a70f87fa5bd932, scope.project.id=1cf408d461524402acb8b395a622adc4, user.id=4b15ca047099497a88329e4d3e07dd35) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:32.666371 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c141d-5757-4170-87d9-b54ffe319fc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:32.668745 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c141d-5757-4170-87d9-b54ffe319fc9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:32.673223 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605978b1-9d74-4ec0-a017-c8feffbd7ac3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:32.683984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 115/232] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:32 2022] GET /identity/v3/role_assignments?user.id=4b15ca047099497a88329e4d3e07dd35&scope.project.id=1cf408d461524402acb8b395a622adc4&role.id=8b31123e2813440db5a70f87fa5bd932 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:32.734868 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494e886-29ab-4535-8529-d14e4b4d60e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:32.736179 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494e886-29ab-4535-8529-d14e4b4d60e0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:32.736760 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494e886-29ab-4535-8529-d14e4b4d60e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:32.737300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494e886-29ab-4535-8529-d14e4b4d60e0 None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:32.743458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494e886-29ab-4535-8529-d14e4b4d60e0 None admin] RBAC: Authorizing `identity:get_project(project_id=1cf408d461524402acb8b395a622adc4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:32.745909 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494e886-29ab-4535-8529-d14e4b4d60e0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:32.748712 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 118/233] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:32 2022] GET /identity/v3/projects/1cf408d461524402acb8b395a622adc4 => generated 302 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:32.755050 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c141d-5757-4170-87d9-b54ffe319fc9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:32.773035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:32.887938 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c141d-5757-4170-87d9-b54ffe319fc9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:32.926117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae461155-502c-4d02-be13-0d2e07293ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:32.927069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae461155-502c-4d02-be13-0d2e07293ec6 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:32.927350 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae461155-502c-4d02-be13-0d2e07293ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:32.927617 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae461155-502c-4d02-be13-0d2e07293ec6 None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4/users/30918c7b389345be855d5dee052d0f85/roles/61bf7de1301f489ab3311c954d548da5` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:32.929873 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae461155-502c-4d02-be13-0d2e07293ec6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1cf408d461524402acb8b395a622adc4, user_id=30918c7b389345be855d5dee052d0f85, role_id=61bf7de1301f489ab3311c954d548da5)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:32.931420 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae461155-502c-4d02-be13-0d2e07293ec6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:32.949966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 116/234] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:10:32 2022] PUT /identity/v3/projects/1cf408d461524402acb8b395a622adc4/users/30918c7b389345be855d5dee052d0f85/roles/61bf7de1301f489ab3311c954d548da5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:10:33.796824 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebf20c-66bd-4122-a6fe-9442e1983db9 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:33.798122 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebf20c-66bd-4122-a6fe-9442e1983db9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:33.798790 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebf20c-66bd-4122-a6fe-9442e1983db9 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:33.801131 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 119/235] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:33.807730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b4a18-dd1e-4988-af30-66e5f7ad98e9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:33.808807 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b4a18-dd1e-4988-af30-66e5f7ad98e9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:33.809285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b4a18-dd1e-4988-af30-66e5f7ad98e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:33.828656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b23b4a18-dd1e-4988-af30-66e5f7ad98e9 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:33.830181 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b23b4a18-dd1e-4988-af30-66e5f7ad98e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:33.866468 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57756b45-ff9c-451e-977b-3da2b3479cff None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:33.866751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57756b45-ff9c-451e-977b-3da2b3479cff None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:33.866950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57756b45-ff9c-451e-977b-3da2b3479cff None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:33.869105 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 120/236] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:33.874508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01601eee-08da-4380-8d99-d38959593f96 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:33.874805 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01601eee-08da-4380-8d99-d38959593f96 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:33.875091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01601eee-08da-4380-8d99-d38959593f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:33.913062 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-01601eee-08da-4380-8d99-d38959593f96 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:33.916325 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-01601eee-08da-4380-8d99-d38959593f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:33.936383 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 117/237] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:33.993472 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:34.017460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b4a18-dd1e-4988-af30-66e5f7ad98e9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:34.020150 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:34.055512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 121/238] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:34.101736 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01601eee-08da-4380-8d99-d38959593f96 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:34.150522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b4a18-dd1e-4988-af30-66e5f7ad98e9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:34.194575 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00fc8d-ef8a-468e-9b13-698849dd5876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:34.195524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00fc8d-ef8a-468e-9b13-698849dd5876 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:34.195828 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00fc8d-ef8a-468e-9b13-698849dd5876 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:34.196111 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00fc8d-ef8a-468e-9b13-698849dd5876 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:34.197688 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00fc8d-ef8a-468e-9b13-698849dd5876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:34.199622 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00fc8d-ef8a-468e-9b13-698849dd5876 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:34.201990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 118/239] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:34.210452 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00fc8d-ef8a-468e-9b13-698849dd5876 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:34.249146 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01601eee-08da-4380-8d99-d38959593f96 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:34.296542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ad944-77a2-40f7-aeab-cb8a6107bd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:34.298260 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ad944-77a2-40f7-aeab-cb8a6107bd0f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:34.298872 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ad944-77a2-40f7-aeab-cb8a6107bd0f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:34.299652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ad944-77a2-40f7-aeab-cb8a6107bd0f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:34.319341 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ad944-77a2-40f7-aeab-cb8a6107bd0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:34.333134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-969ad944-77a2-40f7-aeab-cb8a6107bd0f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:34.333134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:34.333134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:34.333134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:34.333134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:34.333134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:34.333134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:34.333134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:34.333134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:34.333134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:34.333134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:34.333134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:34.333134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:34.333134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:34.333134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:34.333134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:34.334570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:34.334570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:34.334570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:34.334570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:34.334570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:34.334570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:34.334570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:34.334570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:34.334570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:34.334570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:34.334570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:34.334570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:34.334570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:34.334570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:34.334570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:34.334570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:34.335857 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:34.335857 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:34.335857 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:34.335857 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:34.335857 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:34.335857 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:34.335857 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:34.335857 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:34.335857 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:34.335857 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:34.335857 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:34.335857 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:34.340082 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 122/240] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:34.348591 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:34.348830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ad944-77a2-40f7-aeab-cb8a6107bd0f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:34.404776 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00fc8d-ef8a-468e-9b13-698849dd5876 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:34.406481 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:34.457314 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3786f54-ceed-418d-afd7-6d94268a6245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:34.458364 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3786f54-ceed-418d-afd7-6d94268a6245 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:34.458847 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3786f54-ceed-418d-afd7-6d94268a6245 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:34.459318 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3786f54-ceed-418d-afd7-6d94268a6245 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:34.460227 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3786f54-ceed-418d-afd7-6d94268a6245 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:34.464301 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3786f54-ceed-418d-afd7-6d94268a6245 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:34.496923 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ad944-77a2-40f7-aeab-cb8a6107bd0f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:34.509697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 119/241] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 20 19:10:34 2022] POST /identity/v3/users => generated 293 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:34.509697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d5377-6df0-480a-9e44-952ba9e14017 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:34.509697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d5377-6df0-480a-9e44-952ba9e14017 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:34.509697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d5377-6df0-480a-9e44-952ba9e14017 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:34.511162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 120/242] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:34.528437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fc1fc-d27d-498a-9215-bbef14d4ea20 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:34.528757 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fc1fc-d27d-498a-9215-bbef14d4ea20 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:34.529096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fc1fc-d27d-498a-9215-bbef14d4ea20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:34.563784 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4f8fc1fc-d27d-498a-9215-bbef14d4ea20 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:34.565031 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4f8fc1fc-d27d-498a-9215-bbef14d4ea20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:34.569645 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fcbfc-c531-43d5-b32c-65dfa656dde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:34.570706 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fcbfc-c531-43d5-b32c-65dfa656dde0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:34.571188 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fcbfc-c531-43d5-b32c-65dfa656dde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:34.571721 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fcbfc-c531-43d5-b32c-65dfa656dde0 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:34.572682 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fcbfc-c531-43d5-b32c-65dfa656dde0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:34.573187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fcbfc-c531-43d5-b32c-65dfa656dde0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:34.574866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fcbfc-c531-43d5-b32c-65dfa656dde0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:34.585321 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 123/243] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:34.596298 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fcbfc-c531-43d5-b32c-65dfa656dde0 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:34.688522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 121/244] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:34.727247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fc1fc-d27d-498a-9215-bbef14d4ea20 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:34.772688 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:34.780536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fcbfc-c531-43d5-b32c-65dfa656dde0 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:34.798455 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:34.826449 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094cc63-8f0f-434b-b51c-d6396fff2477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:34.828388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094cc63-8f0f-434b-b51c-d6396fff2477 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:34.829192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094cc63-8f0f-434b-b51c-d6396fff2477 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:34.829849 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094cc63-8f0f-434b-b51c-d6396fff2477 None admin] PATH_INFO: `/v3/users/4bff957a8cce49fba362caddf2ab2640` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:34.848666 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094cc63-8f0f-434b-b51c-d6396fff2477 None admin] RBAC: Authorizing `identity:get_user(user_id=4bff957a8cce49fba362caddf2ab2640)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:34.850957 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094cc63-8f0f-434b-b51c-d6396fff2477 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:34.854463 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 124/245] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:34 2022] GET /identity/v3/users/4bff957a8cce49fba362caddf2ab2640 => generated 297 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:34.861130 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fc1fc-d27d-498a-9215-bbef14d4ea20 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:34.866712 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094cc63-8f0f-434b-b51c-d6396fff2477 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:34.912881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6525fb3-7ed3-44a4-ada6-f0407f3e9f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:34.913748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6525fb3-7ed3-44a4-ada6-f0407f3e9f4f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:34.914037 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6525fb3-7ed3-44a4-ada6-f0407f3e9f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:34.914382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6525fb3-7ed3-44a4-ada6-f0407f3e9f4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:34.938818 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6525fb3-7ed3-44a4-ada6-f0407f3e9f4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:34.948285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e6525fb3-7ed3-44a4-ada6-f0407f3e9f4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:34.948285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:34.948285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:34.948285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:34.948285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:34.948285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:34.948285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:34.948285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:34.948285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:34.948285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:34.948285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:34.948285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:34.948285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:34.948285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:34.948285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:34.948285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:34.949218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:34.949218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:34.949218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:34.949218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:34.949218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:34.949218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:34.949218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:34.949218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:34.949218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:34.949218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:34.949218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:34.949218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:34.949218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:34.949218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:34.949218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:34.949218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:34.950026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:34.950026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:34.950026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:34.950026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:34.950026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:34.950026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:34.950026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:34.950026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:34.950026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:34.950026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:34.950026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:34.950026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:34.952833 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 122/246] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:10:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:34.961113 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6525fb3-7ed3-44a4-ada6-f0407f3e9f4f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:35.019355 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094cc63-8f0f-434b-b51c-d6396fff2477 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:35.065304 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b920f-5950-4831-b524-fa578acabeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:35.066536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b920f-5950-4831-b524-fa578acabeda None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:35.067129 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b920f-5950-4831-b524-fa578acabeda None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:35.067708 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b920f-5950-4831-b524-fa578acabeda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:35.105134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:35.114543 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6525fb3-7ed3-44a4-ada6-f0407f3e9f4f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:35.139050 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:35.163426 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b920f-5950-4831-b524-fa578acabeda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:35.164921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b920f-5950-4831-b524-fa578acabeda None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:35.172823 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafa8e9-047e-480b-b93f-bcfe0cd8963d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:35.173872 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafa8e9-047e-480b-b93f-bcfe0cd8963d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:35.174445 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafa8e9-047e-480b-b93f-bcfe0cd8963d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:35.174993 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafa8e9-047e-480b-b93f-bcfe0cd8963d None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:35.176274 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafa8e9-047e-480b-b93f-bcfe0cd8963d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:35.177518 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafa8e9-047e-480b-b93f-bcfe0cd8963d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:35.179808 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cafa8e9-047e-480b-b93f-bcfe0cd8963d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:35.192115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 123/247] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:35.199078 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafa8e9-047e-480b-b93f-bcfe0cd8963d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:35.319074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 125/248] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:35.326759 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b920f-5950-4831-b524-fa578acabeda None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:35.350874 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafa8e9-047e-480b-b93f-bcfe0cd8963d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:35.400728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:35.406895 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e309e-6c86-4658-a229-8ec39bd86780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:35.408395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e309e-6c86-4658-a229-8ec39bd86780 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:35.409468 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e309e-6c86-4658-a229-8ec39bd86780 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:35.410803 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e309e-6c86-4658-a229-8ec39bd86780 None admin] PATH_INFO: `/v3/users/30918c7b389345be855d5dee052d0f85` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:35.414387 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e309e-6c86-4658-a229-8ec39bd86780 None admin] RBAC: Authorizing `identity:get_user(user_id=30918c7b389345be855d5dee052d0f85)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:35.416909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e309e-6c86-4658-a229-8ec39bd86780 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:35.420062 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 124/249] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:35 2022] GET /identity/v3/users/30918c7b389345be855d5dee052d0f85 => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:35.425704 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e309e-6c86-4658-a229-8ec39bd86780 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:35.457956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b920f-5950-4831-b524-fa578acabeda None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:35.479401 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:35.497818 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237fac5-79c2-4af0-8436-fd9ed887f49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:35.498732 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237fac5-79c2-4af0-8436-fd9ed887f49e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:35.499084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237fac5-79c2-4af0-8436-fd9ed887f49e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:35.499364 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237fac5-79c2-4af0-8436-fd9ed887f49e None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:35.501457 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237fac5-79c2-4af0-8436-fd9ed887f49e None admin] RBAC: Authorizing `identity:get_project(project_id=1cf408d461524402acb8b395a622adc4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:35.503096 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237fac5-79c2-4af0-8436-fd9ed887f49e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:35.504850 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 126/250] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:35 2022] GET /identity/v3/projects/1cf408d461524402acb8b395a622adc4 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:35.506387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f8ee1-c493-4bc1-867e-36f26bc6cddf None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:35.506680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f8ee1-c493-4bc1-867e-36f26bc6cddf None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:35.506964 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f8ee1-c493-4bc1-867e-36f26bc6cddf None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:35.513040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 127/251] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:35.514859 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf39920-0a03-45e2-8f4a-22cc3fa0b07e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:35.515151 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf39920-0a03-45e2-8f4a-22cc3fa0b07e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:35.516576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf39920-0a03-45e2-8f4a-22cc3fa0b07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:35.543871 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-bcf39920-0a03-45e2-8f4a-22cc3fa0b07e None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:35.546176 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bcf39920-0a03-45e2-8f4a-22cc3fa0b07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:35.555174 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e309e-6c86-4658-a229-8ec39bd86780 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:35.608665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183038f-dc41-45d5-9459-0c9f060a23e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:35.609757 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183038f-dc41-45d5-9459-0c9f060a23e8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:35.610445 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183038f-dc41-45d5-9459-0c9f060a23e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:35.610960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183038f-dc41-45d5-9459-0c9f060a23e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:35.630741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 128/252] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:35.632218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf39920-0a03-45e2-8f4a-22cc3fa0b07e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:35.714965 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:35.742369 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183038f-dc41-45d5-9459-0c9f060a23e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:35.743883 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183038f-dc41-45d5-9459-0c9f060a23e8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:35.766960 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf39920-0a03-45e2-8f4a-22cc3fa0b07e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:35.790998 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:35.807591 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b06f43-8c37-4a13-b9ad-ff361870349a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:35.808263 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b06f43-8c37-4a13-b9ad-ff361870349a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:35.808548 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b06f43-8c37-4a13-b9ad-ff361870349a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:35.808825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b06f43-8c37-4a13-b9ad-ff361870349a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:35.809660 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b06f43-8c37-4a13-b9ad-ff361870349a None admin] RBAC: Adding query filter params (role.id=afe0f864483d4f3186a49ce8d33ecd74, scope.project.id=1cf408d461524402acb8b395a622adc4, user.id=4bff957a8cce49fba362caddf2ab2640) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:35.809976 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b06f43-8c37-4a13-b9ad-ff361870349a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:35.811710 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b06f43-8c37-4a13-b9ad-ff361870349a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:35.818097 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 129/253] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:35 2022] GET /identity/v3/role_assignments?user.id=4bff957a8cce49fba362caddf2ab2640&scope.project.id=1cf408d461524402acb8b395a622adc4&role.id=afe0f864483d4f3186a49ce8d33ecd74 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:35.818940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b06f43-8c37-4a13-b9ad-ff361870349a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:35.864207 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 125/254] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 19:10:35.872055 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3419cf-babe-467a-bf4d-eacdfe61a2c4 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:35.872366 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3419cf-babe-467a-bf4d-eacdfe61a2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:35.872618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3419cf-babe-467a-bf4d-eacdfe61a2c4 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:35.874517 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 126/255] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:35.875334 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3419cf-babe-467a-bf4d-eacdfe61a2c4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:35.977321 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b06f43-8c37-4a13-b9ad-ff361870349a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:36.007953 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:36.040327 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f400d1c-5664-4707-888d-de8eaffda427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:36.042117 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f400d1c-5664-4707-888d-de8eaffda427 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:36.042117 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f400d1c-5664-4707-888d-de8eaffda427 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:36.042117 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f400d1c-5664-4707-888d-de8eaffda427 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:36.055502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f400d1c-5664-4707-888d-de8eaffda427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:36.059884 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3419cf-babe-467a-bf4d-eacdfe61a2c4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:36.064589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-9f400d1c-5664-4707-888d-de8eaffda427 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:36.064589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:36.064589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:36.064589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:36.064589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:36.064589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:36.064589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:36.064589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:36.064589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:36.064589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:36.064589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:36.064589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:36.064589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:36.064589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:36.064589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:36.064589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:36.065509 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:36.065509 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:36.065509 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:36.065509 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:36.065509 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:36.065509 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:36.065509 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:36.065509 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:36.065509 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:36.065509 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:36.065509 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:36.065509 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:36.065509 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:36.065509 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:36.065509 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:36.065509 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:36.066438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:36.066438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:36.066438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:36.066438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:36.066438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:36.066438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:36.066438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:36.066438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:36.066438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:36.066438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:36.066438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:36.066438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:36.066438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 130/256] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:36.067642 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823db78e-39b9-42e7-9a71-0805330218eb None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:36.067642 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823db78e-39b9-42e7-9a71-0805330218eb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:36.067806 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823db78e-39b9-42e7-9a71-0805330218eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:36.091377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-823db78e-39b9-42e7-9a71-0805330218eb None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:36.092410 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-823db78e-39b9-42e7-9a71-0805330218eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:36.105431 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffc88e-a7cc-44fa-87ff-4fdae603b02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:36.107075 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffc88e-a7cc-44fa-87ff-4fdae603b02c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:36.107588 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffc88e-a7cc-44fa-87ff-4fdae603b02c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:36.108070 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffc88e-a7cc-44fa-87ff-4fdae603b02c None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:36.112933 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffc88e-a7cc-44fa-87ff-4fdae603b02c None admin] RBAC: Authorizing `identity:get_project(project_id=1cf408d461524402acb8b395a622adc4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:36.116018 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffc88e-a7cc-44fa-87ff-4fdae603b02c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:36.120418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 127/257] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:35 2022] GET /identity/v3/projects/1cf408d461524402acb8b395a622adc4 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:36.121428 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffc88e-a7cc-44fa-87ff-4fdae603b02c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:36.153937 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:36.252033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffc88e-a7cc-44fa-87ff-4fdae603b02c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:36.294876 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7467f9-4b01-4fb0-96cd-86baf50e1b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:36.295919 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7467f9-4b01-4fb0-96cd-86baf50e1b23 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:36.296451 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7467f9-4b01-4fb0-96cd-86baf50e1b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:36.296955 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7467f9-4b01-4fb0-96cd-86baf50e1b23 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:36.298032 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7467f9-4b01-4fb0-96cd-86baf50e1b23 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:36.298579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7467f9-4b01-4fb0-96cd-86baf50e1b23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:36.300657 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7467f9-4b01-4fb0-96cd-86baf50e1b23 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:36.311167 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 128/258] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:36.312324 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7467f9-4b01-4fb0-96cd-86baf50e1b23 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:36.327677 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 131/259] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:36.328542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823db78e-39b9-42e7-9a71-0805330218eb None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:36.408295 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:36.426215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7467f9-4b01-4fb0-96cd-86baf50e1b23 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:36.492177 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc934ae-a35f-4051-b454-c95b0f83eece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:36.493213 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc934ae-a35f-4051-b454-c95b0f83eece None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:36.493737 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc934ae-a35f-4051-b454-c95b0f83eece None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:36.494217 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc934ae-a35f-4051-b454-c95b0f83eece None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:36.495314 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc934ae-a35f-4051-b454-c95b0f83eece None admin] RBAC: Adding query filter params (role.id=6322f657162c45ca85f019a408655ff3, scope.project.id=1cf408d461524402acb8b395a622adc4, user.id=30918c7b389345be855d5dee052d0f85) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:36.495834 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc934ae-a35f-4051-b454-c95b0f83eece None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:36.497733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc934ae-a35f-4051-b454-c95b0f83eece None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:36.508760 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 129/260] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:36 2022] GET /identity/v3/role_assignments?user.id=30918c7b389345be855d5dee052d0f85&scope.project.id=1cf408d461524402acb8b395a622adc4&role.id=6322f657162c45ca85f019a408655ff3 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:36.512684 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc934ae-a35f-4051-b454-c95b0f83eece None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:36.596086 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823db78e-39b9-42e7-9a71-0805330218eb None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:36.608376 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:36.660472 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fe881-3b27-4e2b-994e-747e3ecd21c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:36.661373 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fe881-3b27-4e2b-994e-747e3ecd21c8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:36.661655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fe881-3b27-4e2b-994e-747e3ecd21c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:36.661925 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186fe881-3b27-4e2b-994e-747e3ecd21c8 None admin] PATH_INFO: `/v3/users/4b15ca047099497a88329e4d3e07dd35` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:36.667190 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186fe881-3b27-4e2b-994e-747e3ecd21c8 None admin] RBAC: Authorizing `identity:get_user(user_id=4b15ca047099497a88329e4d3e07dd35)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:36.668727 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186fe881-3b27-4e2b-994e-747e3ecd21c8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:36.670813 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 132/261] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:36 2022] GET /identity/v3/users/4b15ca047099497a88329e4d3e07dd35 => generated 297 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:36.676644 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fe881-3b27-4e2b-994e-747e3ecd21c8 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:36.715572 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc934ae-a35f-4051-b454-c95b0f83eece None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:36.758584 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4a556-8754-4d59-8373-5faca7e49147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:36.760214 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4a556-8754-4d59-8373-5faca7e49147 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:36.760596 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4a556-8754-4d59-8373-5faca7e49147 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:36.760985 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd4a556-8754-4d59-8373-5faca7e49147 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:36.770027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:36.775840 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd4a556-8754-4d59-8373-5faca7e49147 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:36.790231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-7fd4a556-8754-4d59-8373-5faca7e49147 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:36.790231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:36.790231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:36.790231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:36.790231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:36.790231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:36.790231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:36.790231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:36.790231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:36.790231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:36.790231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:36.790231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:36.790231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:36.790231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:36.790231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:36.790231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:36.791734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:36.791734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:36.791734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:36.791734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:36.791734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:36.791734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:36.791734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:36.791734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:36.791734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:36.791734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:36.791734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:36.791734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:36.791734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:36.791734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:36.791734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:36.791734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:36.792600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:36.792600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:36.792600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:36.792600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:36.792600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:36.792600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:36.792600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:36.792600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:36.792600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:36.792600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:36.792600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:36.792600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:36.792600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 130/262] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 20 19:10:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:36.803313 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4a556-8754-4d59-8373-5faca7e49147 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:36.844598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186fe881-3b27-4e2b-994e-747e3ecd21c8 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:36.888458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911790e5-bbc8-49f8-bdda-76958fe8599b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:36.889330 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911790e5-bbc8-49f8-bdda-76958fe8599b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:36.889604 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911790e5-bbc8-49f8-bdda-76958fe8599b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:36.889875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911790e5-bbc8-49f8-bdda-76958fe8599b None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:36.895824 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911790e5-bbc8-49f8-bdda-76958fe8599b None admin] RBAC: Authorizing `identity:get_project(project_id=1cf408d461524402acb8b395a622adc4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:36.897279 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911790e5-bbc8-49f8-bdda-76958fe8599b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:36.899259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 133/263] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:36 2022] GET /identity/v3/projects/1cf408d461524402acb8b395a622adc4 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:36.907100 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911790e5-bbc8-49f8-bdda-76958fe8599b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:36.997690 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd4a556-8754-4d59-8373-5faca7e49147 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:37.000303 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:37.045917 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bfb1d-456a-4f7d-9fa9-57663537234c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:37.047510 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bfb1d-456a-4f7d-9fa9-57663537234c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:37.047809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bfb1d-456a-4f7d-9fa9-57663537234c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:37.048088 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bfb1d-456a-4f7d-9fa9-57663537234c None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:37.049425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bfb1d-456a-4f7d-9fa9-57663537234c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:37.049425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bfb1d-456a-4f7d-9fa9-57663537234c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:37.052206 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bfb1d-456a-4f7d-9fa9-57663537234c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:37.060483 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 131/264] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:10:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:37.069052 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bfb1d-456a-4f7d-9fa9-57663537234c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:37.093503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911790e5-bbc8-49f8-bdda-76958fe8599b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:37.131982 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165880da-43fb-43e7-9e38-f4ca0b9837fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:37.133250 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165880da-43fb-43e7-9e38-f4ca0b9837fd None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:37.133764 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165880da-43fb-43e7-9e38-f4ca0b9837fd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:37.134335 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165880da-43fb-43e7-9e38-f4ca0b9837fd None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4/users/4b15ca047099497a88329e4d3e07dd35/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:37.136719 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165880da-43fb-43e7-9e38-f4ca0b9837fd None admin] RBAC: Authorizing `identity:create_grant(project_id=1cf408d461524402acb8b395a622adc4, user_id=4b15ca047099497a88329e4d3e07dd35, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:37.138495 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165880da-43fb-43e7-9e38-f4ca0b9837fd None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:37.156677 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 134/265] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:10:36 2022] PUT /identity/v3/projects/1cf408d461524402acb8b395a622adc4/users/4b15ca047099497a88329e4d3e07dd35/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:10:37.190554 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:37.263045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bfb1d-456a-4f7d-9fa9-57663537234c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:37.318430 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634a75d-877b-41ee-a5ce-bc1c0b5903b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:37.319254 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634a75d-877b-41ee-a5ce-bc1c0b5903b3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:37.319543 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634a75d-877b-41ee-a5ce-bc1c0b5903b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:37.319825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634a75d-877b-41ee-a5ce-bc1c0b5903b3 None admin] PATH_INFO: `/v3/users/30918c7b389345be855d5dee052d0f85` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:37.322252 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634a75d-877b-41ee-a5ce-bc1c0b5903b3 None admin] RBAC: Authorizing `identity:get_user(user_id=30918c7b389345be855d5dee052d0f85)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:37.323784 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634a75d-877b-41ee-a5ce-bc1c0b5903b3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:37.325758 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 132/266] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:37 2022] GET /identity/v3/users/30918c7b389345be855d5dee052d0f85 => generated 283 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:37.331859 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165880da-43fb-43e7-9e38-f4ca0b9837fd None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:37.461010 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165880da-43fb-43e7-9e38-f4ca0b9837fd None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:37.464693 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:37.504030 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f47714-b0a5-4728-b5ea-71881b6ccab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:37.504883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f47714-b0a5-4728-b5ea-71881b6ccab3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:37.505267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f47714-b0a5-4728-b5ea-71881b6ccab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:37.505644 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f47714-b0a5-4728-b5ea-71881b6ccab3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:37.582935 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f47714-b0a5-4728-b5ea-71881b6ccab3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:37.586330 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f47714-b0a5-4728-b5ea-71881b6ccab3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:37.691563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 135/267] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:37.697915 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634a75d-877b-41ee-a5ce-bc1c0b5903b3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:37.886641 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f96959-3b3e-477b-b1c5-cfedb08018c0 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:37.886962 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f96959-3b3e-477b-b1c5-cfedb08018c0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:37.887331 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634a75d-877b-41ee-a5ce-bc1c0b5903b3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:37.887440 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f96959-3b3e-477b-b1c5-cfedb08018c0 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:37.889528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 136/268] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:37.895290 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dba059-f439-438b-ac6d-2ccecffd52dd None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:37.895582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dba059-f439-438b-ac6d-2ccecffd52dd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:37.895853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dba059-f439-438b-ac6d-2ccecffd52dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:37.915819 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-99dba059-f439-438b-ac6d-2ccecffd52dd None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:37.917036 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-99dba059-f439-438b-ac6d-2ccecffd52dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:37.939642 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:37.950316 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:37.957579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f8898-790f-4505-b8f5-951ca88d7f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:37.958568 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f8898-790f-4505-b8f5-951ca88d7f47 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:37.958955 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f8898-790f-4505-b8f5-951ca88d7f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:37.959246 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f8898-790f-4505-b8f5-951ca88d7f47 None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:37.960510 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f8898-790f-4505-b8f5-951ca88d7f47 None admin] RBAC: Authorizing `identity:get_project(project_id=1cf408d461524402acb8b395a622adc4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:37.961994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f8898-790f-4505-b8f5-951ca88d7f47 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:37.964665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 133/269] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:37 2022] GET /identity/v3/projects/1cf408d461524402acb8b395a622adc4 => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:37.966120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419d611-7917-45ce-92e1-25a63485579b None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:37.966489 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419d611-7917-45ce-92e1-25a63485579b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:37.966773 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419d611-7917-45ce-92e1-25a63485579b None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:37.968044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 134/270] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:37.975682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419d611-7917-45ce-92e1-25a63485579b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:37.999574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 137/271] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:38.000898 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca20d7-9098-484d-b9d0-3227f8c6fb02 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:38.001427 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca20d7-9098-484d-b9d0-3227f8c6fb02 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:38.001427 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca20d7-9098-484d-b9d0-3227f8c6fb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:38.035939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f3ca20d7-9098-484d-b9d0-3227f8c6fb02 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:38.037153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f3ca20d7-9098-484d-b9d0-3227f8c6fb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:38.093302 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419d611-7917-45ce-92e1-25a63485579b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:38.126608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 138/272] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:38.127684 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca20d7-9098-484d-b9d0-3227f8c6fb02 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:38.145190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cfbe7-0a17-4fef-b688-a3cfd3a5e87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:38.145770 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cfbe7-0a17-4fef-b688-a3cfd3a5e87f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:38.146056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cfbe7-0a17-4fef-b688-a3cfd3a5e87f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:38.146498 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cfbe7-0a17-4fef-b688-a3cfd3a5e87f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:38.147358 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25cfbe7-0a17-4fef-b688-a3cfd3a5e87f None admin] RBAC: Adding query filter params (role.id=61bf7de1301f489ab3311c954d548da5, scope.project.id=1cf408d461524402acb8b395a622adc4, user.id=30918c7b389345be855d5dee052d0f85) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:38.147671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25cfbe7-0a17-4fef-b688-a3cfd3a5e87f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:38.149341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25cfbe7-0a17-4fef-b688-a3cfd3a5e87f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:38.162632 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 135/273] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:37 2022] GET /identity/v3/role_assignments?user.id=30918c7b389345be855d5dee052d0f85&scope.project.id=1cf408d461524402acb8b395a622adc4&role.id=61bf7de1301f489ab3311c954d548da5 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:38.172690 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cfbe7-0a17-4fef-b688-a3cfd3a5e87f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:38.216321 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:38.252267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:38.259846 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca20d7-9098-484d-b9d0-3227f8c6fb02 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:38.296629 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a7dca-b75d-41c4-a114-c95b872e1237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:38.297509 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a7dca-b75d-41c4-a114-c95b872e1237 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:38.297795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a7dca-b75d-41c4-a114-c95b872e1237 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:38.298072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a7dca-b75d-41c4-a114-c95b872e1237 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:38.300943 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cfbe7-0a17-4fef-b688-a3cfd3a5e87f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:38.310123 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a7dca-b75d-41c4-a114-c95b872e1237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:38.319192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-5b4a7dca-b75d-41c4-a114-c95b872e1237 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:38.319192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:38.319192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:38.319192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:38.319192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:38.319192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:38.319192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:38.319192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:38.319192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:38.319192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:38.319192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:38.319192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:38.319192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:38.319192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:38.319192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:38.319192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:38.321368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:38.321368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:38.321368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:38.321368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:38.321368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:38.321368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:38.321368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:38.321368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:38.321368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:38.321368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:38.321368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:38.321368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:38.321368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:38.321368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:38.321368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:38.321368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:38.323961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:38.323961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:38.323961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:38.323961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:38.323961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:38.323961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:38.323961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:38.323961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:38.323961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:38.323961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:38.323961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:38.323961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:38.323961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 139/274] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:38.330359 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a7dca-b75d-41c4-a114-c95b872e1237 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:38.348659 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1d3e2-b7a9-49f3-b4b0-38b0dc09d2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:38.349497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1d3e2-b7a9-49f3-b4b0-38b0dc09d2da None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:38.349719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1d3e2-b7a9-49f3-b4b0-38b0dc09d2da None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:38.349990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1d3e2-b7a9-49f3-b4b0-38b0dc09d2da None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:38.355209 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1d3e2-b7a9-49f3-b4b0-38b0dc09d2da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:38.356808 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1d3e2-b7a9-49f3-b4b0-38b0dc09d2da None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:38.358647 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 136/275] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:38.364258 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1d3e2-b7a9-49f3-b4b0-38b0dc09d2da None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:38.459434 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a7dca-b75d-41c4-a114-c95b872e1237 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:38.492960 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:38.506919 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f9e55-8c37-4715-a8d3-7002d31d28d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:38.507991 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f9e55-8c37-4715-a8d3-7002d31d28d0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:38.508504 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f9e55-8c37-4715-a8d3-7002d31d28d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:38.509591 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f9e55-8c37-4715-a8d3-7002d31d28d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:38.510644 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f9e55-8c37-4715-a8d3-7002d31d28d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:38.511167 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f9e55-8c37-4715-a8d3-7002d31d28d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:38.512806 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f9e55-8c37-4715-a8d3-7002d31d28d0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:38.526159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 140/276] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:38.528615 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb3bff-aa83-4107-bd98-e2d67b82a1d6 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:38.529126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb3bff-aa83-4107-bd98-e2d67b82a1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:38.529609 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb3bff-aa83-4107-bd98-e2d67b82a1d6 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:38.531801 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 141/277] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:38.534892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb3bff-aa83-4107-bd98-e2d67b82a1d6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:38.536894 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1d3e2-b7a9-49f3-b4b0-38b0dc09d2da None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:38.582581 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:38.594025 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3e421-4396-43d8-9817-586151110456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:38.594025 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3e421-4396-43d8-9817-586151110456 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:38.594284 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3e421-4396-43d8-9817-586151110456 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:38.594414 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3e421-4396-43d8-9817-586151110456 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:38.595160 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3e421-4396-43d8-9817-586151110456 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:38.596602 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3e421-4396-43d8-9817-586151110456 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:38.633048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 137/278] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 20 19:10:38 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:10:38.634813 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6d484-0f26-4cb9-a670-90b29bca4200 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:38.635403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6d484-0f26-4cb9-a670-90b29bca4200 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:38.635858 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6d484-0f26-4cb9-a670-90b29bca4200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:38.656208 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c1c6d484-0f26-4cb9-a670-90b29bca4200 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:38.657865 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c1c6d484-0f26-4cb9-a670-90b29bca4200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:38.713895 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb3bff-aa83-4107-bd98-e2d67b82a1d6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:38.763146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 138/279] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:38.775208 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f827a2-cb40-458d-9229-066b00afed6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:38.776182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f827a2-cb40-458d-9229-066b00afed6d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:38.776469 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f827a2-cb40-458d-9229-066b00afed6d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:38.776802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f827a2-cb40-458d-9229-066b00afed6d None admin] PATH_INFO: `/v3/users/0fcb8099d55b40ae974f88eb542b4dc9` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:38.788637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6d484-0f26-4cb9-a670-90b29bca4200 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:38.795936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f827a2-cb40-458d-9229-066b00afed6d None admin] RBAC: Authorizing `identity:get_user(user_id=0fcb8099d55b40ae974f88eb542b4dc9)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:38.797437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f827a2-cb40-458d-9229-066b00afed6d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:38.800126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 142/280] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:38 2022] GET /identity/v3/users/0fcb8099d55b40ae974f88eb542b4dc9 => generated 293 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:38.807471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f827a2-cb40-458d-9229-066b00afed6d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:38.865661 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:38.947636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6d484-0f26-4cb9-a670-90b29bca4200 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:38.955299 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f827a2-cb40-458d-9229-066b00afed6d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:38.974089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:38.997619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd2f52-4911-4faa-8eaf-0aa6af6e83d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:38.998464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd2f52-4911-4faa-8eaf-0aa6af6e83d8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:38.998750 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd2f52-4911-4faa-8eaf-0aa6af6e83d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:38.999207 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd2f52-4911-4faa-8eaf-0aa6af6e83d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:39.005160 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1efaad-c608-42ac-8310-69bcf2cae1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:39.006722 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1efaad-c608-42ac-8310-69bcf2cae1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:39.007167 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1efaad-c608-42ac-8310-69bcf2cae1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:39.007577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1efaad-c608-42ac-8310-69bcf2cae1b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:39.008730 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1efaad-c608-42ac-8310-69bcf2cae1b1 None admin] RBAC: Adding query filter params (role.id=8b31123e2813440db5a70f87fa5bd932, user.id=0fcb8099d55b40ae974f88eb542b4dc9, scope.system=all) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:39.009500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1efaad-c608-42ac-8310-69bcf2cae1b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:39.012393 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1efaad-c608-42ac-8310-69bcf2cae1b1 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:39.012607 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd2f52-4911-4faa-8eaf-0aa6af6e83d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:39.020290 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 143/281] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Jul 20 19:10:38 2022] GET /identity/v3/role_assignments?user.id=0fcb8099d55b40ae974f88eb542b4dc9&scope.system=all&role.id=8b31123e2813440db5a70f87fa5bd932 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:39.023256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d9fd2f52-4911-4faa-8eaf-0aa6af6e83d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:39.023256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:39.023256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:39.023256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:39.023256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:39.023256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:39.023256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:39.023256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:39.023256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:39.023256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:39.023256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:39.023256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:39.023256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:39.023256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:39.023256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:39.023256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:39.024191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:39.024191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:39.024191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:39.024191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:39.024191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:39.024191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:39.024191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:39.024191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:39.024191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:39.024191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:39.024191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:39.024191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:39.024191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:39.024191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:39.024191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:39.024191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:39.025529 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:39.025529 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:39.025529 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:39.025529 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:39.025529 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:39.025529 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:39.025529 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:39.025529 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:39.025529 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:39.025529 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:39.025529 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:39.025529 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:39.025529 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 139/282] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:10:39.030850 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1efaad-c608-42ac-8310-69bcf2cae1b1 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:39.175435 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1efaad-c608-42ac-8310-69bcf2cae1b1 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:39.189802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:39.231352 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5a664-7189-4618-a568-4e4874fdb26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:39.232371 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5a664-7189-4618-a568-4e4874fdb26a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:39.232860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5a664-7189-4618-a568-4e4874fdb26a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:39.233357 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5a664-7189-4618-a568-4e4874fdb26a None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:39.234340 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5a664-7189-4618-a568-4e4874fdb26a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:39.234857 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5a664-7189-4618-a568-4e4874fdb26a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:39.236486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5a664-7189-4618-a568-4e4874fdb26a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:39.246949 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 144/283] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:39.252531 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd2f52-4911-4faa-8eaf-0aa6af6e83d8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:39.409296 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd2f52-4911-4faa-8eaf-0aa6af6e83d8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:39.463171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a215ac7-fd0a-40b3-8b83-0b0081ba191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:39.464056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a215ac7-fd0a-40b3-8b83-0b0081ba191b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:39.464338 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a215ac7-fd0a-40b3-8b83-0b0081ba191b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:39.464613 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a215ac7-fd0a-40b3-8b83-0b0081ba191b None admin] PATH_INFO: `/v3/users/4bff957a8cce49fba362caddf2ab2640` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:39.469469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a215ac7-fd0a-40b3-8b83-0b0081ba191b None admin] RBAC: Authorizing `identity:get_user(user_id=4bff957a8cce49fba362caddf2ab2640)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:39.470984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a215ac7-fd0a-40b3-8b83-0b0081ba191b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:39.474440 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 140/284] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:39 2022] GET /identity/v3/users/4bff957a8cce49fba362caddf2ab2640 => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:39.478279 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5a664-7189-4618-a568-4e4874fdb26a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:39.609708 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5a664-7189-4618-a568-4e4874fdb26a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:39.653951 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492c10e-9640-4c43-a78d-ec92ed8899fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:39.654872 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492c10e-9640-4c43-a78d-ec92ed8899fe None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:39.655158 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492c10e-9640-4c43-a78d-ec92ed8899fe None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:39.655441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492c10e-9640-4c43-a78d-ec92ed8899fe None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:39.656671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492c10e-9640-4c43-a78d-ec92ed8899fe None admin] RBAC: Authorizing `identity:get_project(project_id=1cf408d461524402acb8b395a622adc4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:39.658145 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492c10e-9640-4c43-a78d-ec92ed8899fe None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:39.660527 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 145/285] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:39 2022] GET /identity/v3/projects/1cf408d461524402acb8b395a622adc4 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:39.667479 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a215ac7-fd0a-40b3-8b83-0b0081ba191b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:39.733625 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:39.829659 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a215ac7-fd0a-40b3-8b83-0b0081ba191b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:39.889492 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c47c1d-30e2-42d9-a68f-c8a69c7d23b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:39.890438 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c47c1d-30e2-42d9-a68f-c8a69c7d23b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:39.890649 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c47c1d-30e2-42d9-a68f-c8a69c7d23b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:39.890908 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c47c1d-30e2-42d9-a68f-c8a69c7d23b7 None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4/users/4bff957a8cce49fba362caddf2ab2640/roles/afe0f864483d4f3186a49ce8d33ecd74` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:39.895186 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c47c1d-30e2-42d9-a68f-c8a69c7d23b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1cf408d461524402acb8b395a622adc4, user_id=4bff957a8cce49fba362caddf2ab2640, role_id=afe0f864483d4f3186a49ce8d33ecd74)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:39.896655 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c47c1d-30e2-42d9-a68f-c8a69c7d23b7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:39.917850 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 141/286] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:10:39 2022] PUT /identity/v3/projects/1cf408d461524402acb8b395a622adc4/users/4bff957a8cce49fba362caddf2ab2640/roles/afe0f864483d4f3186a49ce8d33ecd74 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:10:39.970694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fa523-9df3-4997-9cbf-351ad7e0b8ef None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:39.971044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fa523-9df3-4997-9cbf-351ad7e0b8ef None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:39.971271 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fa523-9df3-4997-9cbf-351ad7e0b8ef None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:39.973167 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 146/287] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:39.989069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ac756-d10e-4003-b5de-0051bccd4db0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:39.989406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ac756-d10e-4003-b5de-0051bccd4db0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:39.989646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ac756-d10e-4003-b5de-0051bccd4db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:40.013545 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-193ac756-d10e-4003-b5de-0051bccd4db0 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:40.015277 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-193ac756-d10e-4003-b5de-0051bccd4db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:40.104818 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 142/288] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:40.131957 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fa523-9df3-4997-9cbf-351ad7e0b8ef None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:40.195786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:40.300064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fa523-9df3-4997-9cbf-351ad7e0b8ef None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:40.349792 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226db4e-111c-4349-9469-4d322077f42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:40.350640 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226db4e-111c-4349-9469-4d322077f42c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:40.350931 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226db4e-111c-4349-9469-4d322077f42c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:40.351214 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226db4e-111c-4349-9469-4d322077f42c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:40.362461 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226db4e-111c-4349-9469-4d322077f42c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:40.374263 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-7226db4e-111c-4349-9469-4d322077f42c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:40.374263 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:40.374263 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:40.374263 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:40.374263 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:40.374263 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:40.374263 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:40.374263 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:40.374263 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:40.374263 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:40.374263 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:40.374263 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:40.374263 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:40.374263 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:40.374263 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:40.374263 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:40.375285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:40.375285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:40.375285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:40.375285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:40.375285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:40.375285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:40.375285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:40.375285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:40.375285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:40.375285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:40.375285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:40.375285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:40.375285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:40.375285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:40.375285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:40.375285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:40.376099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:40.376099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:40.376099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:40.376099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:40.376099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:40.376099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:40.376099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:40.376099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:40.376099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:40.376099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:40.376099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:40.376099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:40.376099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 147/289] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:40.381623 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ac756-d10e-4003-b5de-0051bccd4db0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:40.454809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:40.568673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ac756-d10e-4003-b5de-0051bccd4db0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:40.625884 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38936dd-684f-4e4d-b80d-c46de8c03ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:40.627025 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38936dd-684f-4e4d-b80d-c46de8c03ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:40.627522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38936dd-684f-4e4d-b80d-c46de8c03ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:40.628027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38936dd-684f-4e4d-b80d-c46de8c03ae8 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:40.629496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38936dd-684f-4e4d-b80d-c46de8c03ae8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:40.630049 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38936dd-684f-4e4d-b80d-c46de8c03ae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:40.632799 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38936dd-684f-4e4d-b80d-c46de8c03ae8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:40.650026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 143/290] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:40.651530 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226db4e-111c-4349-9469-4d322077f42c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:40.801872 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:40.812572 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226db4e-111c-4349-9469-4d322077f42c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:40.865630 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceee9a5-fb8a-42a8-bfe2-4066d8453603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:40.866562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceee9a5-fb8a-42a8-bfe2-4066d8453603 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:40.866845 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceee9a5-fb8a-42a8-bfe2-4066d8453603 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:40.867260 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceee9a5-fb8a-42a8-bfe2-4066d8453603 None admin] PATH_INFO: `/v3/users/4b15ca047099497a88329e4d3e07dd35` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:40.869091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceee9a5-fb8a-42a8-bfe2-4066d8453603 None admin] RBAC: Authorizing `identity:get_user(user_id=4b15ca047099497a88329e4d3e07dd35)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:40.870739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceee9a5-fb8a-42a8-bfe2-4066d8453603 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:40.872745 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 148/291] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:40 2022] GET /identity/v3/users/4b15ca047099497a88329e4d3e07dd35 => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:40.878451 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38936dd-684f-4e4d-b80d-c46de8c03ae8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:41.028710 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:41.036772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38936dd-684f-4e4d-b80d-c46de8c03ae8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:41.089494 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c86a47-26b6-45aa-b473-14856e09f62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:41.090597 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c86a47-26b6-45aa-b473-14856e09f62d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:41.091459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c86a47-26b6-45aa-b473-14856e09f62d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:41.092331 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c86a47-26b6-45aa-b473-14856e09f62d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:41.194003 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c86a47-26b6-45aa-b473-14856e09f62d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:41.195472 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c86a47-26b6-45aa-b473-14856e09f62d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:41.333126 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:41.342353 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 144/292] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:41.348063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceee9a5-fb8a-42a8-bfe2-4066d8453603 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:41.411705 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5d88c-5552-4890-9821-1089ddda1e73 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:41.412667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5d88c-5552-4890-9821-1089ddda1e73 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:41.413148 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5d88c-5552-4890-9821-1089ddda1e73 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:41.415160 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 145/293] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:41.422044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ecab4-1a29-47ca-a6bd-d83b43119c60 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:41.422833 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ecab4-1a29-47ca-a6bd-d83b43119c60 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:41.423456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ecab4-1a29-47ca-a6bd-d83b43119c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:41.458994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-384ecab4-1a29-47ca-a6bd-d83b43119c60 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:41.462787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-384ecab4-1a29-47ca-a6bd-d83b43119c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:41.553810 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceee9a5-fb8a-42a8-bfe2-4066d8453603 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:41.567222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 146/294] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:41.568906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70208ce3-9f5b-4b45-b2c0-aebfdaba3983 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:41.569353 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70208ce3-9f5b-4b45-b2c0-aebfdaba3983 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:41.569770 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70208ce3-9f5b-4b45-b2c0-aebfdaba3983 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:41.572265 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 147/295] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:41.579944 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ae0a5-525e-4c52-b6ef-ecdf0bcaa94a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:41.582017 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ae0a5-525e-4c52-b6ef-ecdf0bcaa94a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:41.582539 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ae0a5-525e-4c52-b6ef-ecdf0bcaa94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:41.611742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1e5ae0a5-525e-4c52-b6ef-ecdf0bcaa94a None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:41.613771 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1e5ae0a5-525e-4c52-b6ef-ecdf0bcaa94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:41.618822 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c26c9-ec3e-471a-b1b1-f0810240389c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:41.619823 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c26c9-ec3e-471a-b1b1-f0810240389c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:41.620174 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c26c9-ec3e-471a-b1b1-f0810240389c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:41.620523 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c26c9-ec3e-471a-b1b1-f0810240389c None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:41.621854 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c26c9-ec3e-471a-b1b1-f0810240389c None admin] RBAC: Authorizing `identity:get_project(project_id=1cf408d461524402acb8b395a622adc4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:41.623645 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c26c9-ec3e-471a-b1b1-f0810240389c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:41.625916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 149/296] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:41 2022] GET /identity/v3/projects/1cf408d461524402acb8b395a622adc4 => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:41.626884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c26c9-ec3e-471a-b1b1-f0810240389c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:41.676113 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:41.701353 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 148/297] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:41.706824 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ae0a5-525e-4c52-b6ef-ecdf0bcaa94a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:41.767594 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c26c9-ec3e-471a-b1b1-f0810240389c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:41.788777 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:41.803619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de8726-ec7d-4ac2-b842-180bbddb1584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:41.804425 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de8726-ec7d-4ac2-b842-180bbddb1584 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:41.804915 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de8726-ec7d-4ac2-b842-180bbddb1584 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:41.805342 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de8726-ec7d-4ac2-b842-180bbddb1584 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:41.817707 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de8726-ec7d-4ac2-b842-180bbddb1584 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:41.826574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-36de8726-ec7d-4ac2-b842-180bbddb1584 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:41.826574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:41.826574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:41.826574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:41.826574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:41.826574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:41.826574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:41.826574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:41.826574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:41.826574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:41.826574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:41.826574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:41.826574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:41.826574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:41.826574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:41.826574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:41.827486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:41.827486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:41.827486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:41.827486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:41.827486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:41.827486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:41.827486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:41.827486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:41.827486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:41.827486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:41.827486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:41.827486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:41.827486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:41.827486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:41.827486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:41.827486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:41.828318 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:41.828318 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:41.828318 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:41.828318 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:41.828318 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:41.828318 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:41.828318 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:41.828318 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:41.828318 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:41.828318 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:41.828318 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:41.828318 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:41.835363 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 150/298] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:41.836240 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de8726-ec7d-4ac2-b842-180bbddb1584 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:41.841320 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ae0a5-525e-4c52-b6ef-ecdf0bcaa94a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:41.884699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36005075-e9ae-4a78-b4a7-9d3940352ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:41.885712 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36005075-e9ae-4a78-b4a7-9d3940352ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:41.886191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36005075-e9ae-4a78-b4a7-9d3940352ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:41.886704 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36005075-e9ae-4a78-b4a7-9d3940352ea4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:41.887693 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36005075-e9ae-4a78-b4a7-9d3940352ea4 None admin] RBAC: Adding query filter params (role.id=8b31123e2813440db5a70f87fa5bd932, scope.project.id=1cf408d461524402acb8b395a622adc4, user.id=4b15ca047099497a88329e4d3e07dd35) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:41.888153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36005075-e9ae-4a78-b4a7-9d3940352ea4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:41.889755 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36005075-e9ae-4a78-b4a7-9d3940352ea4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:41.897122 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 149/299] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:41 2022] GET /identity/v3/role_assignments?user.id=4b15ca047099497a88329e4d3e07dd35&scope.project.id=1cf408d461524402acb8b395a622adc4&role.id=8b31123e2813440db5a70f87fa5bd932 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:41.898000 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36005075-e9ae-4a78-b4a7-9d3940352ea4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:41.958006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:41.969386 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de8726-ec7d-4ac2-b842-180bbddb1584 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:42.008490 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c768f-dcd0-49bd-8957-fd79ff3fdd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:42.009846 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c768f-dcd0-49bd-8957-fd79ff3fdd05 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:42.010129 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c768f-dcd0-49bd-8957-fd79ff3fdd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:42.010430 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c768f-dcd0-49bd-8957-fd79ff3fdd05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:42.011734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c768f-dcd0-49bd-8957-fd79ff3fdd05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:42.013555 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c768f-dcd0-49bd-8957-fd79ff3fdd05 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:42.015149 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 151/300] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:42.015149 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b57f3-df12-482f-a4f6-619bc2d0eaaa None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:42.015149 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b57f3-df12-482f-a4f6-619bc2d0eaaa None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:42.015149 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b57f3-df12-482f-a4f6-619bc2d0eaaa None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:42.015149 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 152/301] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:42.020636 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b57f3-df12-482f-a4f6-619bc2d0eaaa None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:42.032752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36005075-e9ae-4a78-b4a7-9d3940352ea4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:42.054926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:42.072241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b63fc0-6a72-4ce3-9539-e6d6ae58e20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:42.072914 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b63fc0-6a72-4ce3-9539-e6d6ae58e20b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:42.073195 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b63fc0-6a72-4ce3-9539-e6d6ae58e20b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:42.073469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b63fc0-6a72-4ce3-9539-e6d6ae58e20b None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:42.074223 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b63fc0-6a72-4ce3-9539-e6d6ae58e20b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:42.075348 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b63fc0-6a72-4ce3-9539-e6d6ae58e20b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:42.076816 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b63fc0-6a72-4ce3-9539-e6d6ae58e20b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:42.086066 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 150/302] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:42.087186 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415d4b3-9116-4557-9443-03ed37877a6f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:42.087468 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415d4b3-9116-4557-9443-03ed37877a6f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:42.087740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415d4b3-9116-4557-9443-03ed37877a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:42.106403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2415d4b3-9116-4557-9443-03ed37877a6f None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:42.107785 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2415d4b3-9116-4557-9443-03ed37877a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:42.165838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b57f3-df12-482f-a4f6-619bc2d0eaaa None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:42.206811 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 151/303] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:42.207839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415d4b3-9116-4557-9443-03ed37877a6f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:42.212711 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111aa79-60bd-484c-8423-559f66d01b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:42.213696 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111aa79-60bd-484c-8423-559f66d01b6d None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:42.214179 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111aa79-60bd-484c-8423-559f66d01b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:42.214839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111aa79-60bd-484c-8423-559f66d01b6d None admin] PATH_INFO: `/v3/groups` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:42.215737 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111aa79-60bd-484c-8423-559f66d01b6d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:42.218324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111aa79-60bd-484c-8423-559f66d01b6d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:42.241600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 153/304] 10.222.0.18 () {60 vars in 1134 bytes} [Wed Jul 20 19:10:42 2022] POST /identity/v3/groups => generated 229 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:42.243877 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111aa79-60bd-484c-8423-559f66d01b6d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:42.277376 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:42.372550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415d4b3-9116-4557-9443-03ed37877a6f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:42.390613 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:42.402619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111aa79-60bd-484c-8423-559f66d01b6d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:42.422870 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54814e-6084-4dfc-97ec-ba7e0e31a1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:42.424534 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54814e-6084-4dfc-97ec-ba7e0e31a1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:42.424925 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54814e-6084-4dfc-97ec-ba7e0e31a1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:42.425430 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54814e-6084-4dfc-97ec-ba7e0e31a1b8 None admin] PATH_INFO: `/v3/users/4f1a68c174f24ed98064c68cf89126bd` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:42.453235 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54814e-6084-4dfc-97ec-ba7e0e31a1b8 None admin] RBAC: Authorizing `identity:get_user(user_id=4f1a68c174f24ed98064c68cf89126bd)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:42.454221 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec5a20-f334-49b5-b346-4bad5298c0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:42.455137 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54814e-6084-4dfc-97ec-ba7e0e31a1b8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:42.455383 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec5a20-f334-49b5-b346-4bad5298c0cb None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:42.455806 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec5a20-f334-49b5-b346-4bad5298c0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:42.456250 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec5a20-f334-49b5-b346-4bad5298c0cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:42.458257 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 152/305] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:42 2022] GET /identity/v3/users/4f1a68c174f24ed98064c68cf89126bd => generated 293 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:42.464014 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54814e-6084-4dfc-97ec-ba7e0e31a1b8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:42.470600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec5a20-f334-49b5-b346-4bad5298c0cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:42.479004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-03ec5a20-f334-49b5-b346-4bad5298c0cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:42.479004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:42.479004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:42.479004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:42.479004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:42.479004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:42.479004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:42.479004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:42.479004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:42.479004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:42.479004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:42.479004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:42.479004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:42.479004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:42.479004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:42.479004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:42.479916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:42.479916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:42.479916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:42.479916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:42.479916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:42.479916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:42.479916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:42.479916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:42.479916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:42.479916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:42.479916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:42.479916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:42.479916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:42.479916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:42.479916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:42.479916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:42.481385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:42.481385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:42.481385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:42.481385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:42.481385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:42.481385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:42.481385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:42.481385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:42.481385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:42.481385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:42.481385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:42.481385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:42.481385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 154/306] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:42.485895 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec5a20-f334-49b5-b346-4bad5298c0cb None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:42.587635 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:42.599456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54814e-6084-4dfc-97ec-ba7e0e31a1b8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:42.618846 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec5a20-f334-49b5-b346-4bad5298c0cb None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:42.639289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f487a4-b8cd-4783-915d-0df2ffaa0162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:42.639949 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f487a4-b8cd-4783-915d-0df2ffaa0162 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:42.640725 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f487a4-b8cd-4783-915d-0df2ffaa0162 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:42.640725 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f487a4-b8cd-4783-915d-0df2ffaa0162 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:42.641411 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f487a4-b8cd-4783-915d-0df2ffaa0162 None admin] RBAC: Adding query filter params (role.id=afe0f864483d4f3186a49ce8d33ecd74, user.id=4f1a68c174f24ed98064c68cf89126bd, scope.system=all) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:42.641721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f487a4-b8cd-4783-915d-0df2ffaa0162 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:42.643257 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f487a4-b8cd-4783-915d-0df2ffaa0162 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:42.648657 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 153/307] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Jul 20 19:10:42 2022] GET /identity/v3/role_assignments?user.id=4f1a68c174f24ed98064c68cf89126bd&scope.system=all&role.id=afe0f864483d4f3186a49ce8d33ecd74 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:42.650421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c22eaa-1190-4f29-86ed-87a954990eb1 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:42.650707 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c22eaa-1190-4f29-86ed-87a954990eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:42.650979 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c22eaa-1190-4f29-86ed-87a954990eb1 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:42.652476 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 154/308] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:42.658120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bd3d2-51b4-4b31-8506-6378d70301fd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:42.658443 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bd3d2-51b4-4b31-8506-6378d70301fd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:42.658726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bd3d2-51b4-4b31-8506-6378d70301fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:42.667605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edadf4-acfd-4525-87c3-040c93e5d085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:42.668670 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edadf4-acfd-4525-87c3-040c93e5d085 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:42.669157 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edadf4-acfd-4525-87c3-040c93e5d085 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:42.669635 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edadf4-acfd-4525-87c3-040c93e5d085 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:42.670709 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40edadf4-acfd-4525-87c3-040c93e5d085 None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:42.671228 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40edadf4-acfd-4525-87c3-040c93e5d085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:42.673078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40edadf4-acfd-4525-87c3-040c93e5d085 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:42.678085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d99bd3d2-51b4-4b31-8506-6378d70301fd None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:42.679383 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d99bd3d2-51b4-4b31-8506-6378d70301fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:42.684738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 155/309] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:42.694464 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edadf4-acfd-4525-87c3-040c93e5d085 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:42.710833 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:42.758512 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 155/310] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:42.782851 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bd3d2-51b4-4b31-8506-6378d70301fd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:42.843824 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edadf4-acfd-4525-87c3-040c93e5d085 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:42.884323 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeaf7cc-b20e-4885-a14f-ff210e63007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:42.885941 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaf7cc-b20e-4885-a14f-ff210e63007d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:42.886788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaf7cc-b20e-4885-a14f-ff210e63007d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:42.887217 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeaf7cc-b20e-4885-a14f-ff210e63007d None admin] PATH_INFO: `/v3/users/0fcb8099d55b40ae974f88eb542b4dc9` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:42.888868 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeaf7cc-b20e-4885-a14f-ff210e63007d None admin] RBAC: Authorizing `identity:get_user(user_id=0fcb8099d55b40ae974f88eb542b4dc9)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:42.891480 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeaf7cc-b20e-4885-a14f-ff210e63007d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:42.899214 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 156/311] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:42 2022] GET /identity/v3/users/0fcb8099d55b40ae974f88eb542b4dc9 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:42.901101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeaf7cc-b20e-4885-a14f-ff210e63007d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:42.914328 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bd3d2-51b4-4b31-8506-6378d70301fd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:42.921697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:42.951593 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d56bb7-ddc8-491b-922f-46912b32a4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:42.952530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d56bb7-ddc8-491b-922f-46912b32a4b0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:42.953106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d56bb7-ddc8-491b-922f-46912b32a4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:42.953679 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d56bb7-ddc8-491b-922f-46912b32a4b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:42.967737 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d56bb7-ddc8-491b-922f-46912b32a4b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:42.978499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-94d56bb7-ddc8-491b-922f-46912b32a4b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:42.978499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:42.978499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:42.978499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:42.978499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:42.978499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:42.978499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:42.978499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:42.978499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:42.978499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:42.978499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:42.978499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:42.978499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:42.978499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:42.978499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:42.978499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:42.979528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:42.979528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:42.979528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:42.979528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:42.979528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:42.979528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:42.979528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:42.979528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:42.979528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:42.979528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:42.979528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:42.979528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:42.979528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:42.979528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:42.979528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:42.979528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:42.980341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:42.980341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:42.980341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:42.980341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:42.980341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:42.980341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:42.980341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:42.980341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:42.980341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:42.980341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:42.980341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:42.980341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:42.982385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 156/312] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:10:42.987160 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d56bb7-ddc8-491b-922f-46912b32a4b0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:43.020764 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:43.046179 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeaf7cc-b20e-4885-a14f-ff210e63007d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:43.090732 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7613bc-c232-46de-bffe-59d6c3b6dd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:43.092016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7613bc-c232-46de-bffe-59d6c3b6dd5d None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:43.092502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7613bc-c232-46de-bffe-59d6c3b6dd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:43.092982 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7613bc-c232-46de-bffe-59d6c3b6dd5d None admin] PATH_INFO: `/v3/system/users/0fcb8099d55b40ae974f88eb542b4dc9/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:43.094772 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7613bc-c232-46de-bffe-59d6c3b6dd5d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0fcb8099d55b40ae974f88eb542b4dc9, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:43.096366 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7613bc-c232-46de-bffe-59d6c3b6dd5d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:43.112951 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 157/313] 10.222.0.18 () {58 vars in 1334 bytes} [Wed Jul 20 19:10:42 2022] PUT /identity/v3/system/users/0fcb8099d55b40ae974f88eb542b4dc9/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:10:43.126805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d56bb7-ddc8-491b-922f-46912b32a4b0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:43.166678 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3f080-640a-4eff-93ce-26384b5a7da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:43.167816 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3f080-640a-4eff-93ce-26384b5a7da5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:43.168354 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3f080-640a-4eff-93ce-26384b5a7da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:43.168829 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3f080-640a-4eff-93ce-26384b5a7da5 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:43.169807 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3f080-640a-4eff-93ce-26384b5a7da5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:43.170411 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3f080-640a-4eff-93ce-26384b5a7da5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:43.172038 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3f080-640a-4eff-93ce-26384b5a7da5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:43.187575 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 157/314] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:43.189343 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7613bc-c232-46de-bffe-59d6c3b6dd5d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:43.273202 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:43.303287 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7613bc-c232-46de-bffe-59d6c3b6dd5d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:43.345026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e46997-1e23-4303-81f9-3c92548ff2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:43.346181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e46997-1e23-4303-81f9-3c92548ff2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:43.346625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e46997-1e23-4303-81f9-3c92548ff2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:43.347046 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e46997-1e23-4303-81f9-3c92548ff2a3 None admin] PATH_INFO: `/v3/users/4bff957a8cce49fba362caddf2ab2640` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:43.348432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e46997-1e23-4303-81f9-3c92548ff2a3 None admin] RBAC: Authorizing `identity:get_user(user_id=4bff957a8cce49fba362caddf2ab2640)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:43.350037 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e46997-1e23-4303-81f9-3c92548ff2a3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:43.352243 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 158/315] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:43 2022] GET /identity/v3/users/4bff957a8cce49fba362caddf2ab2640 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:43.358406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3f080-640a-4eff-93ce-26384b5a7da5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:43.451866 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:43.474530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3f080-640a-4eff-93ce-26384b5a7da5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:43.511899 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8d510-50f9-438b-82f5-364ba1bdfdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:43.512561 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8d510-50f9-438b-82f5-364ba1bdfdf6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:43.512840 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8d510-50f9-438b-82f5-364ba1bdfdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:43.513112 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8d510-50f9-438b-82f5-364ba1bdfdf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:43.582984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8d510-50f9-438b-82f5-364ba1bdfdf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:43.584436 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba8d510-50f9-438b-82f5-364ba1bdfdf6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:43.672144 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:43.689308 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 158/316] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:43.694800 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e46997-1e23-4303-81f9-3c92548ff2a3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:43.801191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e46997-1e23-4303-81f9-3c92548ff2a3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:43.838716 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130d37a-eddd-4fac-983b-f10810928ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:43.839489 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130d37a-eddd-4fac-983b-f10810928ccd None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:43.839771 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130d37a-eddd-4fac-983b-f10810928ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:43.840052 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130d37a-eddd-4fac-983b-f10810928ccd None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:43.841363 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130d37a-eddd-4fac-983b-f10810928ccd None admin] RBAC: Authorizing `identity:get_project(project_id=1cf408d461524402acb8b395a622adc4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:43.842884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130d37a-eddd-4fac-983b-f10810928ccd None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:43.849596 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 159/317] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:43 2022] GET /identity/v3/projects/1cf408d461524402acb8b395a622adc4 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:43.851378 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8d510-50f9-438b-82f5-364ba1bdfdf6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:43.982642 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8d510-50f9-438b-82f5-364ba1bdfdf6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:44.020971 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1e7a1-99df-4db3-ae73-b69fdf949ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:44.021633 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1e7a1-99df-4db3-ae73-b69fdf949ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:44.021919 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1e7a1-99df-4db3-ae73-b69fdf949ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:44.022199 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1e7a1-99df-4db3-ae73-b69fdf949ee4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:44.023206 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1e7a1-99df-4db3-ae73-b69fdf949ee4 None admin] RBAC: Adding query filter params (role.id=afe0f864483d4f3186a49ce8d33ecd74, scope.project.id=1cf408d461524402acb8b395a622adc4, user.id=4bff957a8cce49fba362caddf2ab2640) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:44.023524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1e7a1-99df-4db3-ae73-b69fdf949ee4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:44.025591 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1e7a1-99df-4db3-ae73-b69fdf949ee4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:44.036903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 159/318] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:10:43 2022] GET /identity/v3/role_assignments?user.id=4bff957a8cce49fba362caddf2ab2640&scope.project.id=1cf408d461524402acb8b395a622adc4&role.id=afe0f864483d4f3186a49ce8d33ecd74 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:44.471180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5273a7f-174d-47f2-ac22-e6bf9bf5feed None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:44.471573 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5273a7f-174d-47f2-ac22-e6bf9bf5feed None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:44.471748 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5273a7f-174d-47f2-ac22-e6bf9bf5feed None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:44.473270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 160/319] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:44.478189 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e7f13-a4d2-4b88-9ab6-2d9acfd7f464 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:44.478649 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e7f13-a4d2-4b88-9ab6-2d9acfd7f464 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:44.478819 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e7f13-a4d2-4b88-9ab6-2d9acfd7f464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:44.495654 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-af2e7f13-a4d2-4b88-9ab6-2d9acfd7f464 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:44.496833 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-af2e7f13-a4d2-4b88-9ab6-2d9acfd7f464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:44.544579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:44.578469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 160/320] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:44.593979 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5273a7f-174d-47f2-ac22-e6bf9bf5feed None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:44.608593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:44.701164 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5273a7f-174d-47f2-ac22-e6bf9bf5feed None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:44.735356 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab909b-23da-4f47-9169-bf4680cce61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:44.736071 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab909b-23da-4f47-9169-bf4680cce61e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:44.736351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab909b-23da-4f47-9169-bf4680cce61e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:44.736621 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab909b-23da-4f47-9169-bf4680cce61e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:44.737792 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab909b-23da-4f47-9169-bf4680cce61e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:44.739261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab909b-23da-4f47-9169-bf4680cce61e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:44.741084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 161/321] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:10:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:44.746994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e7f13-a4d2-4b88-9ab6-2d9acfd7f464 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:44.756266 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c04a23-d8d9-443b-b211-782b7b0bd514 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:44.756567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c04a23-d8d9-443b-b211-782b7b0bd514 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:44.756828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c04a23-d8d9-443b-b211-782b7b0bd514 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:44.758394 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 162/322] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:10:44.763394 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb34d32-f315-4b23-b7e7-3877b0261b03 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:44.763686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb34d32-f315-4b23-b7e7-3877b0261b03 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:44.763968 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb34d32-f315-4b23-b7e7-3877b0261b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:44.780789 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9cb34d32-f315-4b23-b7e7-3877b0261b03 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:44.781990 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9cb34d32-f315-4b23-b7e7-3877b0261b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:44.852089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e7f13-a4d2-4b88-9ab6-2d9acfd7f464 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:44.854191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 163/323] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:44.877260 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb34d32-f315-4b23-b7e7-3877b0261b03 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:44.888811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:44.889125 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a416d-5f74-4159-b9a6-252a172f821a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:44.889866 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a416d-5f74-4159-b9a6-252a172f821a None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:44.890150 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a416d-5f74-4159-b9a6-252a172f821a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:44.890453 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a416d-5f74-4159-b9a6-252a172f821a None admin] PATH_INFO: `/v3/groups` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:44.891216 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a416d-5f74-4159-b9a6-252a172f821a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:44.892730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a416d-5f74-4159-b9a6-252a172f821a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:44.918513 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 161/324] 10.222.0.18 () {60 vars in 1134 bytes} [Wed Jul 20 19:10:44 2022] POST /identity/v3/groups => generated 226 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:10:45.000491 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb34d32-f315-4b23-b7e7-3877b0261b03 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:45.051628 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff816dd-33f8-4829-823e-b728a0cea696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:45.052458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff816dd-33f8-4829-823e-b728a0cea696 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:45.052744 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff816dd-33f8-4829-823e-b728a0cea696 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:45.053022 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff816dd-33f8-4829-823e-b728a0cea696 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:45.064908 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff816dd-33f8-4829-823e-b728a0cea696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:45.072786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-6ff816dd-33f8-4829-823e-b728a0cea696 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:45.072786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:45.072786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:45.072786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:45.072786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:45.072786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:45.072786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:45.072786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:45.072786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:45.072786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:45.072786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:45.072786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:45.072786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:45.072786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:45.072786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:45.072786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:45.073671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:45.073671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:45.073671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:45.073671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:45.073671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:45.073671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:45.073671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:45.073671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:45.073671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:45.073671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:45.073671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:45.073671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:45.073671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:45.073671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:45.073671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:45.073671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:45.074506 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:45.074506 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:45.074506 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:45.074506 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:45.074506 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:45.074506 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:45.074506 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:45.074506 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:45.074506 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:45.074506 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:45.074506 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:45.074506 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:45.074506 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 164/325] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:10:45.080528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a416d-5f74-4159-b9a6-252a172f821a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:45.132463 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:45.198563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a416d-5f74-4159-b9a6-252a172f821a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:45.238980 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb90b6-a613-44d2-a80b-d6f800760eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:45.240219 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb90b6-a613-44d2-a80b-d6f800760eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:45.240633 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb90b6-a613-44d2-a80b-d6f800760eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:45.241030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb90b6-a613-44d2-a80b-d6f800760eb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:45.241950 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb90b6-a613-44d2-a80b-d6f800760eb1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:45.242422 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb90b6-a613-44d2-a80b-d6f800760eb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:45.243979 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb90b6-a613-44d2-a80b-d6f800760eb1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:45.254935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 162/326] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:45.262540 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff816dd-33f8-4829-823e-b728a0cea696 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:45.267737 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73710215-8c13-4a79-b628-a5f925d0319b None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:45.268333 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73710215-8c13-4a79-b628-a5f925d0319b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:45.268616 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73710215-8c13-4a79-b628-a5f925d0319b None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:45.270434 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 163/327] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:10:45.276054 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4ab42-f42f-47a7-ab1d-1deae2c04cb9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:45.276667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4ab42-f42f-47a7-ab1d-1deae2c04cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:45.276946 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4ab42-f42f-47a7-ab1d-1deae2c04cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:45.297191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-03a4ab42-f42f-47a7-ab1d-1deae2c04cb9 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:45.297191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-03a4ab42-f42f-47a7-ab1d-1deae2c04cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:45.355916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:45.374157 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 164/328] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:45.400848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4ab42-f42f-47a7-ab1d-1deae2c04cb9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:45.417276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff816dd-33f8-4829-823e-b728a0cea696 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:45.439365 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:45.459723 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c7aa1-dad5-49f4-9a55-57cd10f7dfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:45.460608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c7aa1-dad5-49f4-9a55-57cd10f7dfe0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:45.460898 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c7aa1-dad5-49f4-9a55-57cd10f7dfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:45.461176 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c7aa1-dad5-49f4-9a55-57cd10f7dfe0 None admin] PATH_INFO: `/v3/users/4f1a68c174f24ed98064c68cf89126bd` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:45.463880 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c7aa1-dad5-49f4-9a55-57cd10f7dfe0 None admin] RBAC: Authorizing `identity:get_user(user_id=4f1a68c174f24ed98064c68cf89126bd)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:45.465369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c7aa1-dad5-49f4-9a55-57cd10f7dfe0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:45.467256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 165/329] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:45 2022] GET /identity/v3/users/4f1a68c174f24ed98064c68cf89126bd => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:45.472864 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c7aa1-dad5-49f4-9a55-57cd10f7dfe0 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:45.538572 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4ab42-f42f-47a7-ab1d-1deae2c04cb9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:45.592304 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b63c8a-278e-4734-8fc1-314b31e79d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:45.593116 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b63c8a-278e-4734-8fc1-314b31e79d7e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:45.593397 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b63c8a-278e-4734-8fc1-314b31e79d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:45.593671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b63c8a-278e-4734-8fc1-314b31e79d7e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:45.608758 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b63c8a-278e-4734-8fc1-314b31e79d7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:45.617779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-60b63c8a-278e-4734-8fc1-314b31e79d7e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:45.617779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:45.617779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:45.617779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:45.617779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:45.617779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:45.617779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:45.617779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:45.617779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:45.617779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:45.617779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:45.617779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:45.617779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:45.617779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:45.617779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:45.617779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:45.618835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:45.618835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:45.618835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:45.618835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:45.618835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:45.618835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:45.618835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:45.618835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:45.618835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:45.618835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:45.618835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:45.618835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:45.618835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:45.618835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:45.618835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:45.618835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:45.619637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:45.619637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:45.619637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:45.619637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:45.619637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:45.619637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:45.619637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:45.619637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:45.619637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:45.619637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:45.619637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:45.619637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:45.620242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 165/330] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:10:45.625452 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b63c8a-278e-4734-8fc1-314b31e79d7e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:45.636492 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c7aa1-dad5-49f4-9a55-57cd10f7dfe0 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:45.683603 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356de0f-bdc9-4ee3-abf2-5b486ec335ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:45.684476 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356de0f-bdc9-4ee3-abf2-5b486ec335ca None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:45.684765 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356de0f-bdc9-4ee3-abf2-5b486ec335ca None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:45.685522 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356de0f-bdc9-4ee3-abf2-5b486ec335ca None admin] PATH_INFO: `/v3/system/users/4f1a68c174f24ed98064c68cf89126bd/roles/afe0f864483d4f3186a49ce8d33ecd74` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:45.688382 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356de0f-bdc9-4ee3-abf2-5b486ec335ca None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4f1a68c174f24ed98064c68cf89126bd, role_id=afe0f864483d4f3186a49ce8d33ecd74)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:45.690111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356de0f-bdc9-4ee3-abf2-5b486ec335ca None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:45.693641 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:45.702667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 166/331] 10.222.0.18 () {58 vars in 1334 bytes} [Wed Jul 20 19:10:45 2022] PUT /identity/v3/system/users/4f1a68c174f24ed98064c68cf89126bd/roles/afe0f864483d4f3186a49ce8d33ecd74 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:10:45.767121 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:45.771064 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b63c8a-278e-4734-8fc1-314b31e79d7e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:45.810236 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db0418-9a93-4544-9e8c-4dc4ff5e438d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:45.810873 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db0418-9a93-4544-9e8c-4dc4ff5e438d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:45.811160 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db0418-9a93-4544-9e8c-4dc4ff5e438d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:45.811579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db0418-9a93-4544-9e8c-4dc4ff5e438d None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:45.812374 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db0418-9a93-4544-9e8c-4dc4ff5e438d None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:45.812743 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db0418-9a93-4544-9e8c-4dc4ff5e438d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:45.814196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db0418-9a93-4544-9e8c-4dc4ff5e438d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:45.828715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 166/332] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:45.830764 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356de0f-bdc9-4ee3-abf2-5b486ec335ca None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:45.943057 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356de0f-bdc9-4ee3-abf2-5b486ec335ca None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:45.980615 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db1e02-a27d-47ba-ae75-02f3c4bd89ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:45.981612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db1e02-a27d-47ba-ae75-02f3c4bd89ce None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:45.981904 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db1e02-a27d-47ba-ae75-02f3c4bd89ce None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:45.982186 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db1e02-a27d-47ba-ae75-02f3c4bd89ce None admin] PATH_INFO: `/v3/users/0fcb8099d55b40ae974f88eb542b4dc9` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:45.983479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db1e02-a27d-47ba-ae75-02f3c4bd89ce None admin] RBAC: Authorizing `identity:get_user(user_id=0fcb8099d55b40ae974f88eb542b4dc9)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:45.984940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db1e02-a27d-47ba-ae75-02f3c4bd89ce None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:45.986810 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 167/333] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:45 2022] GET /identity/v3/users/0fcb8099d55b40ae974f88eb542b4dc9 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:45.992610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db0418-9a93-4544-9e8c-4dc4ff5e438d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:46.102886 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db0418-9a93-4544-9e8c-4dc4ff5e438d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:46.138790 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafe85a-b67e-482f-8034-2ea826fe7d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:46.139455 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafe85a-b67e-482f-8034-2ea826fe7d82 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:46.139739 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafe85a-b67e-482f-8034-2ea826fe7d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:46.140018 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafe85a-b67e-482f-8034-2ea826fe7d82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:46.140875 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafe85a-b67e-482f-8034-2ea826fe7d82 None admin] RBAC: Adding query filter params (role.id=8b31123e2813440db5a70f87fa5bd932, user.id=0fcb8099d55b40ae974f88eb542b4dc9, scope.system=all) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:46.141187 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafe85a-b67e-482f-8034-2ea826fe7d82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:46.142690 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafe85a-b67e-482f-8034-2ea826fe7d82 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:46.155955 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 167/334] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Jul 20 19:10:45 2022] GET /identity/v3/role_assignments?user.id=0fcb8099d55b40ae974f88eb542b4dc9&scope.system=all&role.id=8b31123e2813440db5a70f87fa5bd932 => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:47.349594 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1c70a-7232-4edb-ab14-645a2146369e None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:47.350216 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1c70a-7232-4edb-ab14-645a2146369e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:47.350216 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1c70a-7232-4edb-ab14-645a2146369e None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:47.351784 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 168/335] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:47.357167 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47811a5-6cfe-4036-91f5-d7dc6ec904ad None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:47.357607 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47811a5-6cfe-4036-91f5-d7dc6ec904ad None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:47.357784 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47811a5-6cfe-4036-91f5-d7dc6ec904ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:47.378768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a47811a5-6cfe-4036-91f5-d7dc6ec904ad None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:47.379945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a47811a5-6cfe-4036-91f5-d7dc6ec904ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:47.388906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:47.459683 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 168/336] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:47.497559 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1c70a-7232-4edb-ab14-645a2146369e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:47.578280 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:47.619763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1c70a-7232-4edb-ab14-645a2146369e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:47.658849 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73890747-885a-44f4-b690-69f4bc6c4af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:47.659903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73890747-885a-44f4-b690-69f4bc6c4af2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:47.660183 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73890747-885a-44f4-b690-69f4bc6c4af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:47.660458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73890747-885a-44f4-b690-69f4bc6c4af2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:47.679195 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73890747-885a-44f4-b690-69f4bc6c4af2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:47.687553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-73890747-885a-44f4-b690-69f4bc6c4af2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:47.687553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:47.687553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:47.687553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:47.687553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:47.687553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:47.687553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:47.687553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:47.687553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:47.687553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:47.687553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:47.687553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:47.687553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:47.687553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:47.687553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:47.687553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:47.688567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:47.688567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:47.688567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:47.688567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:47.688567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:47.688567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:47.688567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:47.688567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:47.688567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:47.688567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:47.688567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:47.688567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:47.688567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:47.688567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:47.688567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:47.688567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:47.689399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:47.689399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:47.689399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:47.689399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:47.689399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:47.689399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:47.689399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:47.689399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:47.689399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:47.689399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:47.689399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:47.689399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:47.689399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 169/337] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:47.697033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47811a5-6cfe-4036-91f5-d7dc6ec904ad None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:47.821675 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47811a5-6cfe-4036-91f5-d7dc6ec904ad None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:47.861296 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b3072-1e6d-4d45-aec0-0842b95f7c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:47.861973 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b3072-1e6d-4d45-aec0-0842b95f7c21 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:47.862252 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b3072-1e6d-4d45-aec0-0842b95f7c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:47.862553 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b3072-1e6d-4d45-aec0-0842b95f7c21 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:47.863315 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b3072-1e6d-4d45-aec0-0842b95f7c21 None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:47.863620 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b3072-1e6d-4d45-aec0-0842b95f7c21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:47.864993 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b3072-1e6d-4d45-aec0-0842b95f7c21 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:47.876399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 169/338] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:47.882182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73890747-885a-44f4-b690-69f4bc6c4af2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:48.008245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73890747-885a-44f4-b690-69f4bc6c4af2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:48.041707 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:48.050011 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54785de-9dd0-487b-a99c-53f6f222746d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:48.050709 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54785de-9dd0-487b-a99c-53f6f222746d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:48.051428 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54785de-9dd0-487b-a99c-53f6f222746d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:48.051703 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54785de-9dd0-487b-a99c-53f6f222746d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:48.167327 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54785de-9dd0-487b-a99c-53f6f222746d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:48.168769 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54785de-9dd0-487b-a99c-53f6f222746d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:48.288028 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 170/339] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:48.294308 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b3072-1e6d-4d45-aec0-0842b95f7c21 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:48.301422 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:48.440483 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b3072-1e6d-4d45-aec0-0842b95f7c21 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:48.478063 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1e5f2-6ebe-40e3-b06d-e8fb1869db1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:48.478960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1e5f2-6ebe-40e3-b06d-e8fb1869db1e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:48.479242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1e5f2-6ebe-40e3-b06d-e8fb1869db1e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:48.479519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1e5f2-6ebe-40e3-b06d-e8fb1869db1e None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:48.480715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1e5f2-6ebe-40e3-b06d-e8fb1869db1e None admin] RBAC: Authorizing `identity:get_project(project_id=00c44395b45b4dbc8c543b0837e2af1b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:48.482156 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1e5f2-6ebe-40e3-b06d-e8fb1869db1e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:48.483918 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 170/340] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:48 2022] GET /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:48.492604 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54785de-9dd0-487b-a99c-53f6f222746d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:48.536849 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:48.621403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c3379-4f23-4113-abc1-fbc245bc9c70 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:48.621683 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c3379-4f23-4113-abc1-fbc245bc9c70 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:48.621959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c3379-4f23-4113-abc1-fbc245bc9c70 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:48.623365 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 171/341] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:48.631629 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a52b0-82b1-48f8-9049-e5f53a60f976 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:48.631936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a52b0-82b1-48f8-9049-e5f53a60f976 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:48.632201 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a52b0-82b1-48f8-9049-e5f53a60f976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:48.640660 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54785de-9dd0-487b-a99c-53f6f222746d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:48.659758 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-772a52b0-82b1-48f8-9049-e5f53a60f976 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:48.661094 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-772a52b0-82b1-48f8-9049-e5f53a60f976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:48.704269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5727d-3865-401a-96d6-4f121cc3d4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:48.705059 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5727d-3865-401a-96d6-4f121cc3d4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:48.705343 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5727d-3865-401a-96d6-4f121cc3d4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:48.705620 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5727d-3865-401a-96d6-4f121cc3d4f4 None admin] PATH_INFO: `/v3/groups/af18051111424574bec588108a9e5d8b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:48.719744 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5727d-3865-401a-96d6-4f121cc3d4f4 None admin] RBAC: Authorizing `identity:get_group(group_id=af18051111424574bec588108a9e5d8b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:48.721234 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5727d-3865-401a-96d6-4f121cc3d4f4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:48.726323 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 171/342] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 20 19:10:48 2022] GET /identity/v3/groups/af18051111424574bec588108a9e5d8b => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:48.734946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5727d-3865-401a-96d6-4f121cc3d4f4 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:48.792484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 172/343] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:48.827863 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a52b0-82b1-48f8-9049-e5f53a60f976 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:48.832072 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:48.874474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:48.897616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5727d-3865-401a-96d6-4f121cc3d4f4 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:48.958471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43c272-5704-4e49-91b6-8ee3039cba08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:48.959069 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43c272-5704-4e49-91b6-8ee3039cba08 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:48.959351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43c272-5704-4e49-91b6-8ee3039cba08 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:48.959807 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43c272-5704-4e49-91b6-8ee3039cba08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:48.960788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43c272-5704-4e49-91b6-8ee3039cba08 None admin] RBAC: Adding query filter params (group.id=af18051111424574bec588108a9e5d8b, role.id=8b31123e2813440db5a70f87fa5bd932, scope.project.id=00c44395b45b4dbc8c543b0837e2af1b) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:48.961257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43c272-5704-4e49-91b6-8ee3039cba08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:48.962951 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43c272-5704-4e49-91b6-8ee3039cba08 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:48.969339 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 172/344] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jul 20 19:10:48 2022] GET /identity/v3/role_assignments?group.id=af18051111424574bec588108a9e5d8b&scope.project.id=00c44395b45b4dbc8c543b0837e2af1b&role.id=8b31123e2813440db5a70f87fa5bd932 => generated 260 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:48.970978 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb5134-6f50-4852-8d0c-2e7b8bd7cda2 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:48.971406 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb5134-6f50-4852-8d0c-2e7b8bd7cda2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:48.971869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb5134-6f50-4852-8d0c-2e7b8bd7cda2 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:48.973313 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 173/345] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:48.974771 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e83690-299d-495d-b07b-027461574146 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:48.975215 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e83690-299d-495d-b07b-027461574146 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:48.975630 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e83690-299d-495d-b07b-027461574146 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:48.977162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 174/346] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:48.984013 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d6d0a-4fdd-4c84-b326-c730ec12c67d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:48.984503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d6d0a-4fdd-4c84-b326-c730ec12c67d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:48.984954 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d6d0a-4fdd-4c84-b326-c730ec12c67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:49.012126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-819d6d0a-4fdd-4c84-b326-c730ec12c67d None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:49.013635 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-819d6d0a-4fdd-4c84-b326-c730ec12c67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:49.036379 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a52b0-82b1-48f8-9049-e5f53a60f976 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:49.123454 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98be1f-4547-4e64-9cec-3545f95a4912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:49.124281 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98be1f-4547-4e64-9cec-3545f95a4912 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:49.124560 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98be1f-4547-4e64-9cec-3545f95a4912 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:49.124832 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98be1f-4547-4e64-9cec-3545f95a4912 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:49.141435 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 175/347] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:49.142793 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e79de5-4780-417f-8bb0-a3340c9d1c8f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:49.143079 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e79de5-4780-417f-8bb0-a3340c9d1c8f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:49.143350 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e79de5-4780-417f-8bb0-a3340c9d1c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:49.151877 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98be1f-4547-4e64-9cec-3545f95a4912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:49.160619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-0b98be1f-4547-4e64-9cec-3545f95a4912 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:49.160619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:49.160619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:49.160619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:49.160619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:49.160619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:49.160619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:49.160619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:49.160619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:49.160619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:49.160619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:49.160619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:49.160619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:49.160619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:49.160619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:49.160619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:49.161576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:49.161576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:49.161576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:49.161576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:49.161576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:49.161576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:49.161576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:49.161576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:49.161576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:49.161576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:49.161576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:49.161576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:49.161576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:49.161576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:49.161576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:49.161576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:49.162406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:49.162406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:49.162406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:49.162406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:49.162406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:49.162406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:49.162406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:49.162406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:49.162406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:49.162406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:49.162406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:49.162406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:49.167367 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 173/348] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 20 19:10:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:10:49.173507 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98be1f-4547-4e64-9cec-3545f95a4912 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:49.177887 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-39e79de5-4780-417f-8bb0-a3340c9d1c8f None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:49.179644 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-39e79de5-4780-417f-8bb0-a3340c9d1c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:49.292217 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:49.324220 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 176/349] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:49.325528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e79de5-4780-417f-8bb0-a3340c9d1c8f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:49.348802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:49.419729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98be1f-4547-4e64-9cec-3545f95a4912 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:49.468127 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e79de5-4780-417f-8bb0-a3340c9d1c8f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:49.479779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac98b83-6ac3-474c-bee1-0448aa6e7236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:49.480914 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac98b83-6ac3-474c-bee1-0448aa6e7236 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:49.481635 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac98b83-6ac3-474c-bee1-0448aa6e7236 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:49.482355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac98b83-6ac3-474c-bee1-0448aa6e7236 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:49.483991 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac98b83-6ac3-474c-bee1-0448aa6e7236 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:49.484770 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac98b83-6ac3-474c-bee1-0448aa6e7236 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:49.487486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac98b83-6ac3-474c-bee1-0448aa6e7236 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:49.502939 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 174/350] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:10:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:49.504672 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac98b83-6ac3-474c-bee1-0448aa6e7236 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:49.514723 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe552dd9-4c8b-4278-9f7a-28e852ab9a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:49.515596 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe552dd9-4c8b-4278-9f7a-28e852ab9a6f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:49.516062 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe552dd9-4c8b-4278-9f7a-28e852ab9a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:49.516492 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe552dd9-4c8b-4278-9f7a-28e852ab9a6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:49.528974 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe552dd9-4c8b-4278-9f7a-28e852ab9a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:49.539479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-fe552dd9-4c8b-4278-9f7a-28e852ab9a6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:49.539479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:49.539479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:49.539479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:49.539479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:49.539479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:49.539479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:49.539479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:49.539479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:49.539479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:49.539479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:49.539479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:49.539479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:49.539479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:49.539479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:49.539479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:49.540774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:49.540774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:49.540774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:49.540774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:49.540774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:49.540774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:49.540774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:49.540774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:49.540774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:49.540774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:49.540774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:49.540774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:49.540774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:49.540774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:49.540774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:49.540774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:49.541802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:49.541802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:49.541802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:49.541802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:49.541802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:49.541802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:49.541802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:49.541802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:49.541802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:49.541802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:49.541802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:49.541802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:49.544091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 177/351] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:49.545655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fe8be-63f9-4b23-97a4-eb8fd1f55a8c None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:49.546213 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fe8be-63f9-4b23-97a4-eb8fd1f55a8c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:49.546698 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fe8be-63f9-4b23-97a4-eb8fd1f55a8c None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:49.548543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 178/352] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:49.549422 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fe8be-63f9-4b23-97a4-eb8fd1f55a8c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:49.646819 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:49.681035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fe8be-63f9-4b23-97a4-eb8fd1f55a8c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:49.711062 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac98b83-6ac3-474c-bee1-0448aa6e7236 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:49.723872 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71182928-5d87-4d25-af6a-28004e7f81cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:49.724524 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71182928-5d87-4d25-af6a-28004e7f81cb None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:49.725375 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71182928-5d87-4d25-af6a-28004e7f81cb None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:49.725656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71182928-5d87-4d25-af6a-28004e7f81cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:49.756372 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:49.779506 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2e513-f78e-4ab2-abc8-ba68fa3886b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:49.780941 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2e513-f78e-4ab2-abc8-ba68fa3886b8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:49.781441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2e513-f78e-4ab2-abc8-ba68fa3886b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:49.781934 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2e513-f78e-4ab2-abc8-ba68fa3886b8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:49.806468 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2e513-f78e-4ab2-abc8-ba68fa3886b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:49.807498 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71182928-5d87-4d25-af6a-28004e7f81cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:49.808972 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71182928-5d87-4d25-af6a-28004e7f81cb None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:49.831935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-72f2e513-f78e-4ab2-abc8-ba68fa3886b8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:49.831935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:49.831935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:49.831935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:49.831935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:49.831935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:49.831935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:49.831935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:49.831935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:49.831935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:49.831935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:49.831935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:49.831935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:49.831935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:49.831935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:49.831935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:49.833699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:49.833699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:49.833699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:49.833699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:49.833699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:49.833699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:49.833699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:49.833699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:49.833699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:49.833699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:49.833699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:49.833699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:49.833699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:49.833699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:49.833699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:49.833699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:49.835312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:49.835312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:49.835312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:49.835312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:49.835312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:49.835312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:49.835312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:49.835312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:49.835312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:49.835312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:49.835312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 19:10:49.835312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:49.841876 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 175/353] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:49.844588 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69f8f9-d4aa-4364-9f98-253f67bc771c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:49.845096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69f8f9-d4aa-4364-9f98-253f67bc771c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:49.845591 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69f8f9-d4aa-4364-9f98-253f67bc771c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:49.877302 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ab69f8f9-d4aa-4364-9f98-253f67bc771c None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:49.880072 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ab69f8f9-d4aa-4364-9f98-253f67bc771c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:49.892632 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:49.921017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 179/354] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:49.921957 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71182928-5d87-4d25-af6a-28004e7f81cb None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:50.007695 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 176/355] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:50.014181 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69f8f9-d4aa-4364-9f98-253f67bc771c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:50.101946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71182928-5d87-4d25-af6a-28004e7f81cb None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:50.153451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601783d-f474-4276-b048-074e4dfbc016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:50.154217 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601783d-f474-4276-b048-074e4dfbc016 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:50.154552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601783d-f474-4276-b048-074e4dfbc016 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:50.154833 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601783d-f474-4276-b048-074e4dfbc016 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:50.155716 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601783d-f474-4276-b048-074e4dfbc016 None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:50.156026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601783d-f474-4276-b048-074e4dfbc016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:50.157550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601783d-f474-4276-b048-074e4dfbc016 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:50.177530 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 180/356] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:50.177530 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601783d-f474-4276-b048-074e4dfbc016 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:50.190347 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69f8f9-d4aa-4364-9f98-253f67bc771c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:50.214964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:50.234154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:50.239683 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c80481-592a-47e5-8387-3f1e76125100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:50.240365 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c80481-592a-47e5-8387-3f1e76125100 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:50.240651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c80481-592a-47e5-8387-3f1e76125100 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:50.240932 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c80481-592a-47e5-8387-3f1e76125100 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:50.241931 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c80481-592a-47e5-8387-3f1e76125100 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:50.242243 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c80481-592a-47e5-8387-3f1e76125100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:50.243752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c80481-592a-47e5-8387-3f1e76125100 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:50.255455 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 177/357] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:50.256738 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c80481-592a-47e5-8387-3f1e76125100 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:50.312254 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601783d-f474-4276-b048-074e4dfbc016 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:50.353852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c128bbe-f0f6-41a1-b01f-3c81bdb9b57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:50.354735 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c128bbe-f0f6-41a1-b01f-3c81bdb9b57c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:50.355023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c128bbe-f0f6-41a1-b01f-3c81bdb9b57c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:50.355300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c128bbe-f0f6-41a1-b01f-3c81bdb9b57c None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:50.356538 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c128bbe-f0f6-41a1-b01f-3c81bdb9b57c None admin] RBAC: Authorizing `identity:get_project(project_id=00c44395b45b4dbc8c543b0837e2af1b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:50.357971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c128bbe-f0f6-41a1-b01f-3c81bdb9b57c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:50.360150 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 181/358] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:50 2022] GET /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:50.360945 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c128bbe-f0f6-41a1-b01f-3c81bdb9b57c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:50.388199 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c80481-592a-47e5-8387-3f1e76125100 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:50.434106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e70ed-219d-45fd-b7b5-0a8729a38a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:50.434956 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e70ed-219d-45fd-b7b5-0a8729a38a4b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:50.435239 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e70ed-219d-45fd-b7b5-0a8729a38a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:50.435513 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e70ed-219d-45fd-b7b5-0a8729a38a4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:50.447623 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e70ed-219d-45fd-b7b5-0a8729a38a4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:50.456843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-3f4e70ed-219d-45fd-b7b5-0a8729a38a4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:50.456843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:50.456843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:50.456843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:50.456843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:50.456843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:50.456843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:50.456843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:50.456843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:50.456843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:50.456843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:50.456843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:50.456843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:50.456843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:50.456843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:50.456843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:50.457797 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:50.457797 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:50.457797 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:50.457797 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:50.457797 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:50.457797 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:50.457797 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:50.457797 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:50.457797 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:50.457797 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:50.457797 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:50.457797 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:50.457797 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:50.457797 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:50.457797 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:50.457797 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:50.459028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:50.459028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:50.459028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:50.459028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:50.459028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:50.459028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:50.459028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:50.459028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:50.459028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:50.459028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:50.459028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:50.459028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:50.459028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 178/359] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 20 19:10:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:50.460568 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01569505-d916-49f7-b1b1-5f9ac7ea4fa9 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:50.460854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01569505-d916-49f7-b1b1-5f9ac7ea4fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:50.461127 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01569505-d916-49f7-b1b1-5f9ac7ea4fa9 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:50.463209 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 179/360] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:50.463953 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01569505-d916-49f7-b1b1-5f9ac7ea4fa9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:50.505493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c128bbe-f0f6-41a1-b01f-3c81bdb9b57c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:50.511406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:50.514116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:50.550212 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68211efe-3ab8-412b-8e60-9ce86e11c0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:50.550903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68211efe-3ab8-412b-8e60-9ce86e11c0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:50.551208 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68211efe-3ab8-412b-8e60-9ce86e11c0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:50.551492 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68211efe-3ab8-412b-8e60-9ce86e11c0d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:50.603536 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01569505-d916-49f7-b1b1-5f9ac7ea4fa9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:50.644585 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d80ea-66d0-49ec-849f-7ffcfde7de81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:50.645786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d80ea-66d0-49ec-849f-7ffcfde7de81 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:50.646293 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d80ea-66d0-49ec-849f-7ffcfde7de81 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:50.647682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d80ea-66d0-49ec-849f-7ffcfde7de81 None admin] PATH_INFO: `/v3/users/4f1a68c174f24ed98064c68cf89126bd` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:50.650660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d80ea-66d0-49ec-849f-7ffcfde7de81 None admin] RBAC: Authorizing `identity:get_user(user_id=4f1a68c174f24ed98064c68cf89126bd)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:50.652369 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d80ea-66d0-49ec-849f-7ffcfde7de81 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:50.654673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 180/361] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:10:50 2022] GET /identity/v3/users/4f1a68c174f24ed98064c68cf89126bd => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:50.655633 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d80ea-66d0-49ec-849f-7ffcfde7de81 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:50.663027 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68211efe-3ab8-412b-8e60-9ce86e11c0d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:50.664584 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68211efe-3ab8-412b-8e60-9ce86e11c0d3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:50.776009 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d80ea-66d0-49ec-849f-7ffcfde7de81 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:50.779398 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:50.784146 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 182/362] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:50.785260 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68211efe-3ab8-412b-8e60-9ce86e11c0d3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:50.794009 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:50.819673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e0b97-1be2-4dae-94cb-6b4031ef2495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:50.820639 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e0b97-1be2-4dae-94cb-6b4031ef2495 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:50.821482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e0b97-1be2-4dae-94cb-6b4031ef2495 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:50.821753 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e0b97-1be2-4dae-94cb-6b4031ef2495 None admin] PATH_INFO: `/v3/groups/af18051111424574bec588108a9e5d8b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:50.823295 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e0b97-1be2-4dae-94cb-6b4031ef2495 None admin] RBAC: Authorizing `identity:get_group(group_id=af18051111424574bec588108a9e5d8b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:50.824729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e0b97-1be2-4dae-94cb-6b4031ef2495 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:50.826669 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 181/363] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 20 19:10:50 2022] GET /identity/v3/groups/af18051111424574bec588108a9e5d8b => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:50.827959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc989a-5543-4b42-ae04-27a832ec2648 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:50.828213 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc989a-5543-4b42-ae04-27a832ec2648 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:50.828487 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc989a-5543-4b42-ae04-27a832ec2648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:50.851755 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-cabc989a-5543-4b42-ae04-27a832ec2648 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:50.854055 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cabc989a-5543-4b42-ae04-27a832ec2648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:50.910429 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68211efe-3ab8-412b-8e60-9ce86e11c0d3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:50.936875 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 182/364] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:50.937598 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc989a-5543-4b42-ae04-27a832ec2648 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:50.960962 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa9336-325b-40ce-9993-d7ee8376427e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:50.962098 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa9336-325b-40ce-9993-d7ee8376427e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:50.962624 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa9336-325b-40ce-9993-d7ee8376427e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:50.962992 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa9336-325b-40ce-9993-d7ee8376427e None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:50.963908 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa9336-325b-40ce-9993-d7ee8376427e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:50.964418 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa9336-325b-40ce-9993-d7ee8376427e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:50.966032 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa9336-325b-40ce-9993-d7ee8376427e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:50.975373 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 183/365] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:10:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:50.976355 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa9336-325b-40ce-9993-d7ee8376427e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:51.057834 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:51.079148 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc989a-5543-4b42-ae04-27a832ec2648 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:51.081046 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:51.102771 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa9336-325b-40ce-9993-d7ee8376427e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:51.128722 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae9d12-4a40-4e16-bcae-cd80b82a61ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:51.129803 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae9d12-4a40-4e16-bcae-cd80b82a61ed None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:51.130102 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae9d12-4a40-4e16-bcae-cd80b82a61ed None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:51.130506 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae9d12-4a40-4e16-bcae-cd80b82a61ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:51.131354 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae9d12-4a40-4e16-bcae-cd80b82a61ed None admin] RBAC: Adding query filter params (role.id=afe0f864483d4f3186a49ce8d33ecd74, user.id=4f1a68c174f24ed98064c68cf89126bd, scope.system=all) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:51.131673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae9d12-4a40-4e16-bcae-cd80b82a61ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:51.133917 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae9d12-4a40-4e16-bcae-cd80b82a61ed None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:51.147850 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 183/366] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Jul 20 19:10:50 2022] GET /identity/v3/role_assignments?user.id=4f1a68c174f24ed98064c68cf89126bd&scope.system=all&role.id=afe0f864483d4f3186a49ce8d33ecd74 => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:51.150415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae9d12-4a40-4e16-bcae-cd80b82a61ed None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:51.158957 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8196f-996a-45a5-88bf-9c8ef287a96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:51.160117 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8196f-996a-45a5-88bf-9c8ef287a96a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:51.160401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8196f-996a-45a5-88bf-9c8ef287a96a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:51.160734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8196f-996a-45a5-88bf-9c8ef287a96a None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:51.162138 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8196f-996a-45a5-88bf-9c8ef287a96a None admin] RBAC: Authorizing `identity:get_project(project_id=1cf408d461524402acb8b395a622adc4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:51.163676 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8196f-996a-45a5-88bf-9c8ef287a96a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:51.165523 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 184/367] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:50 2022] GET /identity/v3/projects/1cf408d461524402acb8b395a622adc4 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:51.166459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8196f-996a-45a5-88bf-9c8ef287a96a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:51.278412 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae9d12-4a40-4e16-bcae-cd80b82a61ed None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:51.283925 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8196f-996a-45a5-88bf-9c8ef287a96a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:51.321524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd59eee-1db1-4616-a5e0-29e3f2eb59c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:51.322601 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd59eee-1db1-4616-a5e0-29e3f2eb59c2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:51.323163 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd59eee-1db1-4616-a5e0-29e3f2eb59c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:51.323641 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd59eee-1db1-4616-a5e0-29e3f2eb59c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:51.324107 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded1653-572e-4231-a3a4-bff384a1784a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:51.324912 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded1653-572e-4231-a3a4-bff384a1784a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:51.325182 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd59eee-1db1-4616-a5e0-29e3f2eb59c2 None admin] RBAC: Adding query filter params (group.id=af18051111424574bec588108a9e5d8b, role.id=61bf7de1301f489ab3311c954d548da5, scope.project.id=00c44395b45b4dbc8c543b0837e2af1b) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:51.325284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded1653-572e-4231-a3a4-bff384a1784a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:51.325453 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded1653-572e-4231-a3a4-bff384a1784a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:51.325947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd59eee-1db1-4616-a5e0-29e3f2eb59c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:51.327756 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd59eee-1db1-4616-a5e0-29e3f2eb59c2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:51.328473 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:51.336383 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 184/368] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jul 20 19:10:51 2022] GET /identity/v3/role_assignments?group.id=af18051111424574bec588108a9e5d8b&scope.project.id=00c44395b45b4dbc8c543b0837e2af1b&role.id=61bf7de1301f489ab3311c954d548da5 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:51.337511 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd59eee-1db1-4616-a5e0-29e3f2eb59c2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:51.338493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded1653-572e-4231-a3a4-bff384a1784a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:51.346680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-6ded1653-572e-4231-a3a4-bff384a1784a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:51.346680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:51.346680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:51.346680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:51.346680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:51.346680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:51.346680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:51.346680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:51.346680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:51.346680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:51.346680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:51.346680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:51.346680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:51.346680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:51.346680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:51.346680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:51.347691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:51.347691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:51.347691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:51.347691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:51.347691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:51.347691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:51.347691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:51.347691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:51.347691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:51.347691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:51.347691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:51.347691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:51.347691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:51.347691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:51.347691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:51.347691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:51.348505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:51.348505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:51.348505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:51.348505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:51.348505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:51.348505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:51.348505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:51.348505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:51.348505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:51.348505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:51.348505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:51.348505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:51.348505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 185/369] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:10:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:51.349701 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded1653-572e-4231-a3a4-bff384a1784a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:51.371892 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:51.463272 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd59eee-1db1-4616-a5e0-29e3f2eb59c2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:51.470614 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded1653-572e-4231-a3a4-bff384a1784a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:51.506761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ae33e-f8fa-40ea-8042-d147213ddcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:51.507863 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ae33e-f8fa-40ea-8042-d147213ddcfe None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:51.508450 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ae33e-f8fa-40ea-8042-d147213ddcfe None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:51.508949 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ae33e-f8fa-40ea-8042-d147213ddcfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:51.512280 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdf48c-00b2-48d3-9702-de83ae58d2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:51.513001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdf48c-00b2-48d3-9702-de83ae58d2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:51.513288 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdf48c-00b2-48d3-9702-de83ae58d2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:51.513564 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bdf48c-00b2-48d3-9702-de83ae58d2b6 None admin] PATH_INFO: `/v3/groups/af18051111424574bec588108a9e5d8b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:51.515626 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bdf48c-00b2-48d3-9702-de83ae58d2b6 None admin] RBAC: Authorizing `identity:get_group(group_id=af18051111424574bec588108a9e5d8b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:51.517114 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bdf48c-00b2-48d3-9702-de83ae58d2b6 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:51.519301 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 186/370] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 20 19:10:51 2022] GET /identity/v3/groups/af18051111424574bec588108a9e5d8b => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:51.520199 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdf48c-00b2-48d3-9702-de83ae58d2b6 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:51.591446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:51.602993 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ae33e-f8fa-40ea-8042-d147213ddcfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:51.605041 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ae33e-f8fa-40ea-8042-d147213ddcfe None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:51.634116 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:51.643031 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bdf48c-00b2-48d3-9702-de83ae58d2b6 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:51.682959 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f07ba-4fd4-4a83-ad2d-b0be8a2ea0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:51.683751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f07ba-4fd4-4a83-ad2d-b0be8a2ea0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:51.684041 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f07ba-4fd4-4a83-ad2d-b0be8a2ea0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:51.684422 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f07ba-4fd4-4a83-ad2d-b0be8a2ea0f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:51.685178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f07ba-4fd4-4a83-ad2d-b0be8a2ea0f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:51.685492 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f07ba-4fd4-4a83-ad2d-b0be8a2ea0f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:51.687872 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f07ba-4fd4-4a83-ad2d-b0be8a2ea0f1 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:51.702384 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 187/371] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:51.703536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f07ba-4fd4-4a83-ad2d-b0be8a2ea0f1 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:51.723660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 185/372] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:51.725137 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3112ae-2cb1-4938-baa8-02b4887fe6e4 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:51.725500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3112ae-2cb1-4938-baa8-02b4887fe6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:51.725854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3112ae-2cb1-4938-baa8-02b4887fe6e4 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:51.727852 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 186/373] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:51.730946 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3112ae-2cb1-4938-baa8-02b4887fe6e4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:51.847427 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f07ba-4fd4-4a83-ad2d-b0be8a2ea0f1 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:51.863654 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3112ae-2cb1-4938-baa8-02b4887fe6e4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:51.880775 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:51.891447 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb2135-26e3-42f2-ace2-ae4d5f8b67a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:51.892108 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb2135-26e3-42f2-ace2-ae4d5f8b67a8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:51.892389 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb2135-26e3-42f2-ace2-ae4d5f8b67a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:51.892664 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb2135-26e3-42f2-ace2-ae4d5f8b67a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:51.893498 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb2135-26e3-42f2-ace2-ae4d5f8b67a8 None admin] RBAC: Adding query filter params (group.id=af18051111424574bec588108a9e5d8b, role.id=8b31123e2813440db5a70f87fa5bd932, scope.project.id=1cf408d461524402acb8b395a622adc4) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:51.893806 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb2135-26e3-42f2-ace2-ae4d5f8b67a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:51.895283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb2135-26e3-42f2-ace2-ae4d5f8b67a8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:51.903381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:51.906332 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 188/374] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jul 20 19:10:51 2022] GET /identity/v3/role_assignments?group.id=af18051111424574bec588108a9e5d8b&scope.project.id=1cf408d461524402acb8b395a622adc4&role.id=8b31123e2813440db5a70f87fa5bd932 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:51.906332 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb2135-26e3-42f2-ace2-ae4d5f8b67a8 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:51.921654 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a229fa-4761-4a45-b563-30d94384f1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:51.922545 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a229fa-4761-4a45-b563-30d94384f1cb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:51.923363 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a229fa-4761-4a45-b563-30d94384f1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:51.923756 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a229fa-4761-4a45-b563-30d94384f1cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:52.039869 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a229fa-4761-4a45-b563-30d94384f1cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:52.041316 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a229fa-4761-4a45-b563-30d94384f1cb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:52.060330 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb2135-26e3-42f2-ace2-ae4d5f8b67a8 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:52.107994 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b294b55-4539-48b9-b1f5-62a75e4cbf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:52.108878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b294b55-4539-48b9-b1f5-62a75e4cbf4d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:52.109302 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b294b55-4539-48b9-b1f5-62a75e4cbf4d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:52.109588 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b294b55-4539-48b9-b1f5-62a75e4cbf4d None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:52.111020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b294b55-4539-48b9-b1f5-62a75e4cbf4d None admin] RBAC: Authorizing `identity:get_project(project_id=1cf408d461524402acb8b395a622adc4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:52.112480 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b294b55-4539-48b9-b1f5-62a75e4cbf4d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:52.114663 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 189/375] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:51 2022] GET /identity/v3/projects/1cf408d461524402acb8b395a622adc4 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:52.115975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133f34f-0762-45b1-a55e-771077fdeea5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:52.116275 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133f34f-0762-45b1-a55e-771077fdeea5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:52.116563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133f34f-0762-45b1-a55e-771077fdeea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:52.142882 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5133f34f-0762-45b1-a55e-771077fdeea5 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:52.144456 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5133f34f-0762-45b1-a55e-771077fdeea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:52.177513 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 187/376] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:52.178516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a229fa-4761-4a45-b563-30d94384f1cb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:52.212143 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:52.220991 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:52.236452 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 190/377] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:52.237121 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133f34f-0762-45b1-a55e-771077fdeea5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:52.297861 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a229fa-4761-4a45-b563-30d94384f1cb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:52.334686 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbc3ec-9491-497d-bd33-2ecdcb6b57ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:52.335540 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbc3ec-9491-497d-bd33-2ecdcb6b57ef None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:52.335822 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbc3ec-9491-497d-bd33-2ecdcb6b57ef None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:52.336096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbc3ec-9491-497d-bd33-2ecdcb6b57ef None admin] PATH_INFO: `/v3/groups/af18051111424574bec588108a9e5d8b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:52.337856 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cbc3ec-9491-497d-bd33-2ecdcb6b57ef None admin] RBAC: Authorizing `identity:get_group(group_id=af18051111424574bec588108a9e5d8b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:52.339336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cbc3ec-9491-497d-bd33-2ecdcb6b57ef None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:52.341141 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 188/378] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 20 19:10:52 2022] GET /identity/v3/groups/af18051111424574bec588108a9e5d8b => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:52.341723 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbc3ec-9491-497d-bd33-2ecdcb6b57ef None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:52.343652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133f34f-0762-45b1-a55e-771077fdeea5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:52.379878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f5f93-ceea-458c-b2cb-ae7eef28ffe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:52.380760 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f5f93-ceea-458c-b2cb-ae7eef28ffe7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:52.381046 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f5f93-ceea-458c-b2cb-ae7eef28ffe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:52.381325 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f5f93-ceea-458c-b2cb-ae7eef28ffe7 None admin] PATH_INFO: `/v3/projects/b67a2f849d994ba1b870dbba687449fc` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:52.382562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f5f93-ceea-458c-b2cb-ae7eef28ffe7 None admin] RBAC: Authorizing `identity:get_project(project_id=b67a2f849d994ba1b870dbba687449fc)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:52.384541 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f5f93-ceea-458c-b2cb-ae7eef28ffe7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:52.386435 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 191/379] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:52 2022] GET /identity/v3/projects/b67a2f849d994ba1b870dbba687449fc => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:52.391169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f5f93-ceea-458c-b2cb-ae7eef28ffe7 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:52.444666 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:52.454576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:52.454727 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbc3ec-9491-497d-bd33-2ecdcb6b57ef None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:52.493921 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e28e1b-bc6d-4ddd-b18e-005d36756e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:52.494760 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e28e1b-bc6d-4ddd-b18e-005d36756e41 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:52.495045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e28e1b-bc6d-4ddd-b18e-005d36756e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:52.495322 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e28e1b-bc6d-4ddd-b18e-005d36756e41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:52.504029 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f5f93-ceea-458c-b2cb-ae7eef28ffe7 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:52.506412 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e28e1b-bc6d-4ddd-b18e-005d36756e41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:52.515682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-88e28e1b-bc6d-4ddd-b18e-005d36756e41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:52.515682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:52.515682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:52.515682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:52.515682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:52.515682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:52.515682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:52.515682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:52.515682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:52.515682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:52.515682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:52.515682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:52.515682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:52.515682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:52.515682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:52.515682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:52.517759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:52.517759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:52.517759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:52.517759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:52.517759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:52.517759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:52.517759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:52.517759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:52.517759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:52.517759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:52.517759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:52.517759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:52.517759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:52.517759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:52.517759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:52.517759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:52.519687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:52.519687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:52.519687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:52.519687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:52.519687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:52.519687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:52.519687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:52.519687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:52.519687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:52.519687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:52.519687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:52.519687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:52.519687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 189/380] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:52.519687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e28e1b-bc6d-4ddd-b18e-005d36756e41 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:52.541245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4055c5-598b-4f72-9a9a-f5e194bfd112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:52.541931 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4055c5-598b-4f72-9a9a-f5e194bfd112 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:52.542193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4055c5-598b-4f72-9a9a-f5e194bfd112 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:52.542498 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4055c5-598b-4f72-9a9a-f5e194bfd112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:52.543337 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4055c5-598b-4f72-9a9a-f5e194bfd112 None admin] RBAC: Adding query filter params (group.id=af18051111424574bec588108a9e5d8b, role.id=61bf7de1301f489ab3311c954d548da5, scope.project.id=1cf408d461524402acb8b395a622adc4) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:52.543647 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4055c5-598b-4f72-9a9a-f5e194bfd112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:52.545103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4055c5-598b-4f72-9a9a-f5e194bfd112 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:52.555963 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 192/381] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jul 20 19:10:52 2022] GET /identity/v3/role_assignments?group.id=af18051111424574bec588108a9e5d8b&scope.project.id=1cf408d461524402acb8b395a622adc4&role.id=61bf7de1301f489ab3311c954d548da5 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:52.555963 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4055c5-598b-4f72-9a9a-f5e194bfd112 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:52.636478 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e28e1b-bc6d-4ddd-b18e-005d36756e41 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:52.671120 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4055c5-598b-4f72-9a9a-f5e194bfd112 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:52.675904 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdb0c7-ce54-4be5-9fcf-0716f623d5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:52.676794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdb0c7-ce54-4be5-9fcf-0716f623d5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:52.677075 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdb0c7-ce54-4be5-9fcf-0716f623d5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:52.677351 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bdb0c7-ce54-4be5-9fcf-0716f623d5c3 None admin] PATH_INFO: `/v3/groups/6a12463ed2e44002b9bf47de1162c722` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:52.685310 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bdb0c7-ce54-4be5-9fcf-0716f623d5c3 None admin] RBAC: Authorizing `identity:get_group(group_id=6a12463ed2e44002b9bf47de1162c722)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:52.686889 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bdb0c7-ce54-4be5-9fcf-0716f623d5c3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:52.689041 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 190/382] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 20 19:10:52 2022] GET /identity/v3/groups/6a12463ed2e44002b9bf47de1162c722 => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:52.699402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdb0c7-ce54-4be5-9fcf-0716f623d5c3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:52.709451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:52.737526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:52.749137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f347371-b5b0-4318-8913-1a7cf67dc654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:52.751302 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f347371-b5b0-4318-8913-1a7cf67dc654 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:52.751592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f347371-b5b0-4318-8913-1a7cf67dc654 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:52.751865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f347371-b5b0-4318-8913-1a7cf67dc654 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:52.752635 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f347371-b5b0-4318-8913-1a7cf67dc654 None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:52.752943 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f347371-b5b0-4318-8913-1a7cf67dc654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:52.754414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f347371-b5b0-4318-8913-1a7cf67dc654 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:52.779559 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 193/383] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:52.785525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f347371-b5b0-4318-8913-1a7cf67dc654 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:52.881269 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bdb0c7-ce54-4be5-9fcf-0716f623d5c3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:52.919861 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ab915-4b61-4a36-bd26-826c15ab45c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:52.920529 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ab915-4b61-4a36-bd26-826c15ab45c4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:52.920817 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ab915-4b61-4a36-bd26-826c15ab45c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:52.921089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ab915-4b61-4a36-bd26-826c15ab45c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:52.921995 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ab915-4b61-4a36-bd26-826c15ab45c4 None admin] RBAC: Adding query filter params (group.id=6a12463ed2e44002b9bf47de1162c722, role.id=6322f657162c45ca85f019a408655ff3, scope.project.id=b67a2f849d994ba1b870dbba687449fc) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:52.922341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ab915-4b61-4a36-bd26-826c15ab45c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:52.926392 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f347371-b5b0-4318-8913-1a7cf67dc654 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:52.928861 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ab915-4b61-4a36-bd26-826c15ab45c4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:52.944564 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 191/384] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jul 20 19:10:52 2022] GET /identity/v3/role_assignments?group.id=6a12463ed2e44002b9bf47de1162c722&scope.project.id=b67a2f849d994ba1b870dbba687449fc&role.id=6322f657162c45ca85f019a408655ff3 => generated 260 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:52.981243 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf16bc6-7fd0-4738-8433-80df846a682e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:52.982201 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf16bc6-7fd0-4738-8433-80df846a682e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:52.982517 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf16bc6-7fd0-4738-8433-80df846a682e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:52.982842 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf16bc6-7fd0-4738-8433-80df846a682e None admin] PATH_INFO: `/v3/groups/af18051111424574bec588108a9e5d8b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:52.984115 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf16bc6-7fd0-4738-8433-80df846a682e None admin] RBAC: Authorizing `identity:get_group(group_id=af18051111424574bec588108a9e5d8b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:52.985607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf16bc6-7fd0-4738-8433-80df846a682e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:52.987348 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 194/385] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 20 19:10:52 2022] GET /identity/v3/groups/af18051111424574bec588108a9e5d8b => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:52.993614 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ab915-4b61-4a36-bd26-826c15ab45c4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:53.102476 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:53.126537 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ab915-4b61-4a36-bd26-826c15ab45c4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:53.167796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256de63-00ac-4ec0-9c60-310138bcb705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:53.168594 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256de63-00ac-4ec0-9c60-310138bcb705 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:53.168879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256de63-00ac-4ec0-9c60-310138bcb705 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:53.169157 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256de63-00ac-4ec0-9c60-310138bcb705 None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:53.175003 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256de63-00ac-4ec0-9c60-310138bcb705 None admin] RBAC: Authorizing `identity:get_project(project_id=00c44395b45b4dbc8c543b0837e2af1b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:53.177638 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256de63-00ac-4ec0-9c60-310138bcb705 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:53.179502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 192/386] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:52 2022] GET /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:53.186064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf16bc6-7fd0-4738-8433-80df846a682e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:53.244369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:53.305547 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf16bc6-7fd0-4738-8433-80df846a682e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:53.340651 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba365ea-1660-4599-8e38-f296869ebca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:53.341543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba365ea-1660-4599-8e38-f296869ebca2 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:53.341829 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba365ea-1660-4599-8e38-f296869ebca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:53.342112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba365ea-1660-4599-8e38-f296869ebca2 None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b/groups/af18051111424574bec588108a9e5d8b/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:53.344149 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba365ea-1660-4599-8e38-f296869ebca2 None admin] RBAC: Authorizing `identity:create_grant(project_id=00c44395b45b4dbc8c543b0837e2af1b, group_id=af18051111424574bec588108a9e5d8b, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:53.345593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba365ea-1660-4599-8e38-f296869ebca2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:53.369444 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 195/387] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Jul 20 19:10:53 2022] PUT /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b/groups/af18051111424574bec588108a9e5d8b/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:10:53.706876 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc1d8f-33fd-41d6-92f0-18dfb0e170cd None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:53.707569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc1d8f-33fd-41d6-92f0-18dfb0e170cd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:53.707569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc1d8f-33fd-41d6-92f0-18dfb0e170cd None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:53.708789 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 193/388] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:53.714262 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57f1ff-6860-4f7a-8182-ebbd5ced362a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:53.714748 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57f1ff-6860-4f7a-8182-ebbd5ced362a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:53.714849 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57f1ff-6860-4f7a-8182-ebbd5ced362a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:53.732719 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1f57f1ff-6860-4f7a-8182-ebbd5ced362a None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:53.733934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1f57f1ff-6860-4f7a-8182-ebbd5ced362a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:53.813872 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 196/389] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:53.837159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc1d8f-33fd-41d6-92f0-18dfb0e170cd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:53.960010 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc1d8f-33fd-41d6-92f0-18dfb0e170cd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:54.001998 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ad631-3b98-4c0b-9a6b-d6cf248d6d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:54.002850 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ad631-3b98-4c0b-9a6b-d6cf248d6d8c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:54.003133 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ad631-3b98-4c0b-9a6b-d6cf248d6d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:54.003408 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ad631-3b98-4c0b-9a6b-d6cf248d6d8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:54.020817 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ad631-3b98-4c0b-9a6b-d6cf248d6d8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:54.029586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c55ad631-3b98-4c0b-9a6b-d6cf248d6d8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:54.029586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:54.029586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:54.029586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:54.029586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:54.029586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:54.029586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:54.029586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:54.029586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:54.029586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:54.029586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:54.029586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:54.029586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:54.029586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:54.029586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:54.029586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:54.030604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:54.030604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:54.030604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:54.030604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:54.030604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:54.030604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:54.030604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:54.030604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:54.030604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:54.030604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:54.030604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:54.030604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:54.030604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:54.030604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:54.030604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:54.030604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:54.031399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:54.031399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:54.031399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:54.031399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:54.031399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:54.031399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:54.031399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:54.031399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:54.031399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:54.031399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:54.031399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:54.031399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:54.035370 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 194/390] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 20 19:10:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:54.042064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57f1ff-6860-4f7a-8182-ebbd5ced362a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:54.090968 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:54.170228 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57f1ff-6860-4f7a-8182-ebbd5ced362a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:54.214248 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299e1e4-67c1-481b-a09e-15aa079bfa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:54.214958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299e1e4-67c1-481b-a09e-15aa079bfa40 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:54.215244 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299e1e4-67c1-481b-a09e-15aa079bfa40 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:54.215521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299e1e4-67c1-481b-a09e-15aa079bfa40 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:54.216272 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299e1e4-67c1-481b-a09e-15aa079bfa40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:54.216584 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299e1e4-67c1-481b-a09e-15aa079bfa40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:54.218081 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299e1e4-67c1-481b-a09e-15aa079bfa40 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:54.226593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 197/391] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:10:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:54.235378 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ad631-3b98-4c0b-9a6b-d6cf248d6d8c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:54.252860 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:54.360172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ad631-3b98-4c0b-9a6b-d6cf248d6d8c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:54.398333 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9c760-4047-4f3a-8f21-9fb296ad8df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:54.399818 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9c760-4047-4f3a-8f21-9fb296ad8df5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:54.400098 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9c760-4047-4f3a-8f21-9fb296ad8df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:54.400371 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9c760-4047-4f3a-8f21-9fb296ad8df5 None admin] PATH_INFO: `/v3/groups/af18051111424574bec588108a9e5d8b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:54.403084 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9c760-4047-4f3a-8f21-9fb296ad8df5 None admin] RBAC: Authorizing `identity:get_group(group_id=af18051111424574bec588108a9e5d8b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:54.404527 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9c760-4047-4f3a-8f21-9fb296ad8df5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:54.406366 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 195/392] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 20 19:10:54 2022] GET /identity/v3/groups/af18051111424574bec588108a9e5d8b => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:54.412797 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299e1e4-67c1-481b-a09e-15aa079bfa40 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:54.559922 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299e1e4-67c1-481b-a09e-15aa079bfa40 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:54.571270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:54.615216 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71641729-c9fb-4e35-aa89-2015294d7db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:54.616024 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71641729-c9fb-4e35-aa89-2015294d7db3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:54.616303 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71641729-c9fb-4e35-aa89-2015294d7db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:54.616573 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71641729-c9fb-4e35-aa89-2015294d7db3 None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:54.617967 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71641729-c9fb-4e35-aa89-2015294d7db3 None admin] RBAC: Authorizing `identity:get_project(project_id=00c44395b45b4dbc8c543b0837e2af1b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:54.619440 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71641729-c9fb-4e35-aa89-2015294d7db3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:54.621217 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 198/393] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:54 2022] GET /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:54.627350 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9c760-4047-4f3a-8f21-9fb296ad8df5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:54.749573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:54.793163 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9c760-4047-4f3a-8f21-9fb296ad8df5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:54.840109 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8a157-a8c4-4244-b182-a4a1d4a22600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:54.841350 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8a157-a8c4-4244-b182-a4a1d4a22600 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:54.841868 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8a157-a8c4-4244-b182-a4a1d4a22600 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:54.842372 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8a157-a8c4-4244-b182-a4a1d4a22600 None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b/groups/af18051111424574bec588108a9e5d8b/roles/61bf7de1301f489ab3311c954d548da5` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:54.847304 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8a157-a8c4-4244-b182-a4a1d4a22600 None admin] RBAC: Authorizing `identity:create_grant(project_id=00c44395b45b4dbc8c543b0837e2af1b, group_id=af18051111424574bec588108a9e5d8b, role_id=61bf7de1301f489ab3311c954d548da5)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:54.849011 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8a157-a8c4-4244-b182-a4a1d4a22600 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:54.869464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 196/394] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Jul 20 19:10:54 2022] PUT /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b/groups/af18051111424574bec588108a9e5d8b/roles/61bf7de1301f489ab3311c954d548da5 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:10:54.938253 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2765bd5-2916-4c0c-bca1-458cdb4c47cc None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:54.938840 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2765bd5-2916-4c0c-bca1-458cdb4c47cc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:54.938919 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2765bd5-2916-4c0c-bca1-458cdb4c47cc None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:54.940671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 199/395] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:54.947290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827e5d2-6cf4-4d73-b03f-9164ce3d6044 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:54.947863 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827e5d2-6cf4-4d73-b03f-9164ce3d6044 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:54.948345 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827e5d2-6cf4-4d73-b03f-9164ce3d6044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:54.966107 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0827e5d2-6cf4-4d73-b03f-9164ce3d6044 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:54.967771 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0827e5d2-6cf4-4d73-b03f-9164ce3d6044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:55.044761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 197/396] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:55.084693 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2765bd5-2916-4c0c-bca1-458cdb4c47cc None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:55.106074 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575831d-5f00-441d-896d-d64a3e70bfeb None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:55.106764 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575831d-5f00-441d-896d-d64a3e70bfeb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:55.108232 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575831d-5f00-441d-896d-d64a3e70bfeb None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:55.109195 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 198/397] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:10:55.115102 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a892a-c5c6-4093-b82b-32f07c833306 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:55.115679 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a892a-c5c6-4093-b82b-32f07c833306 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:55.116389 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a892a-c5c6-4093-b82b-32f07c833306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:55.136108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a52a892a-c5c6-4093-b82b-32f07c833306 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:55.137701 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a52a892a-c5c6-4093-b82b-32f07c833306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:55.216112 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:55.228078 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 199/398] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:55.240704 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2765bd5-2916-4c0c-bca1-458cdb4c47cc None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:55.251807 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a892a-c5c6-4093-b82b-32f07c833306 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:55.280950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b094d-51d3-46e7-93fe-0cdb17250755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:55.282672 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b094d-51d3-46e7-93fe-0cdb17250755 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:55.283189 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b094d-51d3-46e7-93fe-0cdb17250755 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:55.283645 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b094d-51d3-46e7-93fe-0cdb17250755 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:55.304378 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b094d-51d3-46e7-93fe-0cdb17250755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:55.318446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-257b094d-51d3-46e7-93fe-0cdb17250755 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:55.318446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:55.318446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:55.318446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:55.318446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:55.318446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:55.318446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:55.318446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:55.318446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:55.318446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:55.318446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:55.318446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:55.318446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:55.318446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:55.318446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:55.318446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:55.319413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:55.319413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:55.319413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:55.319413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:55.319413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:55.319413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:55.319413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:55.319413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:55.319413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:55.319413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:55.319413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:55.319413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:55.319413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:55.319413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:55.319413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:55.319413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:55.320238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:55.320238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:55.320238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:55.320238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:55.320238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:55.320238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:55.320238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:55.320238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:55.320238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:55.320238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:55.320238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:55.320238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:55.320887 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 200/399] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:55.326239 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b094d-51d3-46e7-93fe-0cdb17250755 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:55.376085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a892a-c5c6-4093-b82b-32f07c833306 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:55.385615 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:55.413842 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b01f1a-c533-41a5-8221-0a30bd88471f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:55.415585 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b01f1a-c533-41a5-8221-0a30bd88471f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:55.416075 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b01f1a-c533-41a5-8221-0a30bd88471f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:55.416601 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b01f1a-c533-41a5-8221-0a30bd88471f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:55.427834 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b01f1a-c533-41a5-8221-0a30bd88471f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:55.436573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-00b01f1a-c533-41a5-8221-0a30bd88471f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:55.436573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:55.436573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:55.436573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:55.436573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:55.436573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:55.436573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:55.436573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:55.436573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:55.436573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:55.436573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:55.436573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:55.436573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:55.436573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:55.436573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:55.436573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:55.437464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:55.437464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:55.437464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:55.437464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:55.437464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:55.437464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:55.437464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:55.437464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:55.437464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:55.437464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:55.437464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:55.437464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:55.437464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:55.437464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:55.437464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:55.437464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:55.438278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:55.438278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:55.438278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:55.438278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:55.438278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:55.438278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:55.438278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:55.438278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:55.438278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:55.438278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:55.438278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:55.438278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:55.441075 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 200/400] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 20 19:10:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:10:55.448043 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b01f1a-c533-41a5-8221-0a30bd88471f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:55.512759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:55.554359 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b094d-51d3-46e7-93fe-0cdb17250755 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:55.562598 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b01f1a-c533-41a5-8221-0a30bd88471f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:55.621295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b59e65-fc57-4f06-bfc9-b4ae2096e2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:55.623106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b59e65-fc57-4f06-bfc9-b4ae2096e2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:55.623400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b59e65-fc57-4f06-bfc9-b4ae2096e2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:55.623680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b59e65-fc57-4f06-bfc9-b4ae2096e2f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:55.624458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b59e65-fc57-4f06-bfc9-b4ae2096e2f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:55.624751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b59e65-fc57-4f06-bfc9-b4ae2096e2f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:55.625977 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee05525-1b05-4c5e-b59e-7365d79e8805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:55.626191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b59e65-fc57-4f06-bfc9-b4ae2096e2f8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:55.627117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee05525-1b05-4c5e-b59e-7365d79e8805 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:55.627612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee05525-1b05-4c5e-b59e-7365d79e8805 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:55.629722 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee05525-1b05-4c5e-b59e-7365d79e8805 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:55.630740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee05525-1b05-4c5e-b59e-7365d79e8805 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:55.631269 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee05525-1b05-4c5e-b59e-7365d79e8805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:55.632854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee05525-1b05-4c5e-b59e-7365d79e8805 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:55.642005 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 201/402] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:55.642351 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 201/402] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:10:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:55.647140 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b59e65-fc57-4f06-bfc9-b4ae2096e2f8 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:55.648182 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee05525-1b05-4c5e-b59e-7365d79e8805 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:55.789327 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:55.798701 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b59e65-fc57-4f06-bfc9-b4ae2096e2f8 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:55.815183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee05525-1b05-4c5e-b59e-7365d79e8805 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:55.833852 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:55.835708 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b93d7-253e-4d27-bc81-6c9d11f78023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:55.837381 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b93d7-253e-4d27-bc81-6c9d11f78023 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:55.837749 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b93d7-253e-4d27-bc81-6c9d11f78023 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:55.838029 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b93d7-253e-4d27-bc81-6c9d11f78023 None admin] PATH_INFO: `/v3/groups/af18051111424574bec588108a9e5d8b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:55.839932 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b93d7-253e-4d27-bc81-6c9d11f78023 None admin] RBAC: Authorizing `identity:get_group(group_id=af18051111424574bec588108a9e5d8b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:55.841689 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b93d7-253e-4d27-bc81-6c9d11f78023 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:55.847976 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 202/403] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 20 19:10:55 2022] GET /identity/v3/groups/af18051111424574bec588108a9e5d8b => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:55.849420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da693c0-c49b-4cce-b8a8-de9478f9d49a None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:55.849702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da693c0-c49b-4cce-b8a8-de9478f9d49a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:55.849977 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da693c0-c49b-4cce-b8a8-de9478f9d49a None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:55.851563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 203/404] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:55.852284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da693c0-c49b-4cce-b8a8-de9478f9d49a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:55.852459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2087dad-ed59-4e16-a32f-3440400cc8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:55.853373 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2087dad-ed59-4e16-a32f-3440400cc8dc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:55.853716 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2087dad-ed59-4e16-a32f-3440400cc8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:55.853999 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2087dad-ed59-4e16-a32f-3440400cc8dc None admin] PATH_INFO: `/v3/groups/af18051111424574bec588108a9e5d8b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:55.855193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2087dad-ed59-4e16-a32f-3440400cc8dc None admin] RBAC: Authorizing `identity:get_group(group_id=af18051111424574bec588108a9e5d8b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:55.856719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2087dad-ed59-4e16-a32f-3440400cc8dc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:55.858640 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 202/405] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 20 19:10:55 2022] GET /identity/v3/groups/af18051111424574bec588108a9e5d8b => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:55.860005 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac64d0-b639-437c-8a9a-c2cb5ba5e60c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:55.860396 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac64d0-b639-437c-8a9a-c2cb5ba5e60c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:55.860679 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac64d0-b639-437c-8a9a-c2cb5ba5e60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:55.877969 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-51ac64d0-b639-437c-8a9a-c2cb5ba5e60c None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:55.879344 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-51ac64d0-b639-437c-8a9a-c2cb5ba5e60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:55.962947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 203/406] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:55.963913 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac64d0-b639-437c-8a9a-c2cb5ba5e60c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:55.992965 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da693c0-c49b-4cce-b8a8-de9478f9d49a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:56.038215 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4138b2b-ed6e-489d-bdc3-49ba82653c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:56.039125 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4138b2b-ed6e-489d-bdc3-49ba82653c9f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:56.039559 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4138b2b-ed6e-489d-bdc3-49ba82653c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:56.039778 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4138b2b-ed6e-489d-bdc3-49ba82653c9f None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:56.040987 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4138b2b-ed6e-489d-bdc3-49ba82653c9f None admin] RBAC: Authorizing `identity:get_project(project_id=1cf408d461524402acb8b395a622adc4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:56.042572 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4138b2b-ed6e-489d-bdc3-49ba82653c9f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:56.044555 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 204/407] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:55 2022] GET /identity/v3/projects/1cf408d461524402acb8b395a622adc4 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:56.045112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4138b2b-ed6e-489d-bdc3-49ba82653c9f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:56.067795 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac64d0-b639-437c-8a9a-c2cb5ba5e60c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:56.080884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:56.086899 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:56.112472 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba2fd0-cfcc-4bc1-8270-aa3913578d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:56.113990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba2fd0-cfcc-4bc1-8270-aa3913578d82 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:56.114651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba2fd0-cfcc-4bc1-8270-aa3913578d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:56.115003 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba2fd0-cfcc-4bc1-8270-aa3913578d82 None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:56.116523 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba2fd0-cfcc-4bc1-8270-aa3913578d82 None admin] RBAC: Authorizing `identity:get_project(project_id=1cf408d461524402acb8b395a622adc4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:56.118877 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba2fd0-cfcc-4bc1-8270-aa3913578d82 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:56.121963 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 204/408] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:55 2022] GET /identity/v3/projects/1cf408d461524402acb8b395a622adc4 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:56.122995 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba2fd0-cfcc-4bc1-8270-aa3913578d82 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:56.167265 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4138b2b-ed6e-489d-bdc3-49ba82653c9f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:56.213388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69dcd59-526e-4fd9-bdc5-b94f887ab566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:56.214559 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dcd59-526e-4fd9-bdc5-b94f887ab566 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:56.214559 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dcd59-526e-4fd9-bdc5-b94f887ab566 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:56.214824 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dcd59-526e-4fd9-bdc5-b94f887ab566 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:56.226692 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69dcd59-526e-4fd9-bdc5-b94f887ab566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:56.234420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-a69dcd59-526e-4fd9-bdc5-b94f887ab566 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:56.234420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:56.234420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:56.234420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:56.234420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:56.234420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:56.234420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:56.234420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:56.234420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:56.234420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:56.234420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:56.234420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:56.234420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:56.234420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:56.234420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:56.234420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:56.235305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:56.235305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:56.235305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:56.235305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:56.235305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:56.235305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:56.235305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:56.235305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:56.235305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:56.235305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:56.235305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:56.235305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:56.235305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:56.235305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:56.235305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:56.235305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:56.236111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:56.236111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:56.236111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:56.236111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:56.236111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:56.236111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:56.236111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:56.236111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:56.236111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:56.236111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:56.236111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:10:56.236111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:56.236111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 205/409] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:10:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:56.236766 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69dcd59-526e-4fd9-bdc5-b94f887ab566 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:56.252084 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba2fd0-cfcc-4bc1-8270-aa3913578d82 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:56.288578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2c384-c749-47bb-a0ae-77408ee5caff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:56.289489 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2c384-c749-47bb-a0ae-77408ee5caff None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:56.289819 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2c384-c749-47bb-a0ae-77408ee5caff None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:56.290036 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2c384-c749-47bb-a0ae-77408ee5caff None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4/groups/af18051111424574bec588108a9e5d8b/roles/61bf7de1301f489ab3311c954d548da5` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:56.294594 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2c384-c749-47bb-a0ae-77408ee5caff None admin] RBAC: Authorizing `identity:create_grant(project_id=1cf408d461524402acb8b395a622adc4, group_id=af18051111424574bec588108a9e5d8b, role_id=61bf7de1301f489ab3311c954d548da5)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:56.297038 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2c384-c749-47bb-a0ae-77408ee5caff None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:56.318346 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 205/410] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Jul 20 19:10:56 2022] PUT /identity/v3/projects/1cf408d461524402acb8b395a622adc4/groups/af18051111424574bec588108a9e5d8b/roles/61bf7de1301f489ab3311c954d548da5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:10:56.318346 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f657e-b8c4-4b9a-8340-a4947b5f2ff7 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:56.318346 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f657e-b8c4-4b9a-8340-a4947b5f2ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:56.318346 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f657e-b8c4-4b9a-8340-a4947b5f2ff7 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:56.318346 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 206/411] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:56.318346 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f657e-b8c4-4b9a-8340-a4947b5f2ff7 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:56.355668 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:56.372745 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69dcd59-526e-4fd9-bdc5-b94f887ab566 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:56.403695 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:56.427634 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7894b48-579f-4904-a66b-0da5cd79d6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:56.428556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7894b48-579f-4904-a66b-0da5cd79d6cc None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:56.428845 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7894b48-579f-4904-a66b-0da5cd79d6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:56.429129 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7894b48-579f-4904-a66b-0da5cd79d6cc None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4/groups/af18051111424574bec588108a9e5d8b/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:56.432918 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7894b48-579f-4904-a66b-0da5cd79d6cc None admin] RBAC: Authorizing `identity:create_grant(project_id=1cf408d461524402acb8b395a622adc4, group_id=af18051111424574bec588108a9e5d8b, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:56.434770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7894b48-579f-4904-a66b-0da5cd79d6cc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:56.455291 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 206/412] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Jul 20 19:10:56 2022] PUT /identity/v3/projects/1cf408d461524402acb8b395a622adc4/groups/af18051111424574bec588108a9e5d8b/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:10:56.456954 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ae644-f89a-4ea3-805b-6636c71b6d7b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:56.457252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ae644-f89a-4ea3-805b-6636c71b6d7b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:56.457583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ae644-f89a-4ea3-805b-6636c71b6d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:56.485803 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f657e-b8c4-4b9a-8340-a4947b5f2ff7 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:56.487518 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-be9ae644-f89a-4ea3-805b-6636c71b6d7b None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:56.488816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-be9ae644-f89a-4ea3-805b-6636c71b6d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:56.538124 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5440c-5579-46bb-b1b0-d11b4676d0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:56.539775 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5440c-5579-46bb-b1b0-d11b4676d0ee None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:56.540459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5440c-5579-46bb-b1b0-d11b4676d0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:56.541028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5440c-5579-46bb-b1b0-d11b4676d0ee None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:56.542092 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5440c-5579-46bb-b1b0-d11b4676d0ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:56.542615 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5440c-5579-46bb-b1b0-d11b4676d0ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:56.544333 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5440c-5579-46bb-b1b0-d11b4676d0ee None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:56.567918 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 207/413] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:56.575201 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5440c-5579-46bb-b1b0-d11b4676d0ee None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:56.593708 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 207/414] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:56.618816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ae644-f89a-4ea3-805b-6636c71b6d7b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:56.727386 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:56.758013 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5440c-5579-46bb-b1b0-d11b4676d0ee None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:56.758459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ae644-f89a-4ea3-805b-6636c71b6d7b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:56.766816 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:56.802719 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0250a-7d76-4a81-959c-550638ba10a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:56.803453 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0250a-7d76-4a81-959c-550638ba10a7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:56.803843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0250a-7d76-4a81-959c-550638ba10a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:56.804123 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0250a-7d76-4a81-959c-550638ba10a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:56.804227 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33a7ef-72fc-40b0-980e-57a56792634f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:56.805649 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33a7ef-72fc-40b0-980e-57a56792634f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:56.805924 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33a7ef-72fc-40b0-980e-57a56792634f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:56.806245 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33a7ef-72fc-40b0-980e-57a56792634f None admin] PATH_INFO: `/v3/groups/6a12463ed2e44002b9bf47de1162c722` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:56.807507 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33a7ef-72fc-40b0-980e-57a56792634f None admin] RBAC: Authorizing `identity:get_group(group_id=6a12463ed2e44002b9bf47de1162c722)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:56.808943 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe33a7ef-72fc-40b0-980e-57a56792634f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:56.810987 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 208/415] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 20 19:10:56 2022] GET /identity/v3/groups/6a12463ed2e44002b9bf47de1162c722 => generated 229 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:56.816098 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33a7ef-72fc-40b0-980e-57a56792634f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:56.816671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d0250a-7d76-4a81-959c-550638ba10a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:56.826126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-04d0250a-7d76-4a81-959c-550638ba10a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:56.826126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:56.826126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:56.826126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:56.826126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:56.826126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:56.826126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:56.826126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:56.826126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:56.826126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:56.826126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:56.826126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:56.826126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:56.826126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:56.826126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:56.826126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:56.828259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:56.828259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:56.828259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:56.828259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:56.828259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:56.828259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:56.828259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:56.828259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:56.828259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:56.828259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:56.828259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:56.828259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:56.828259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:56.828259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:56.828259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:56.828259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:56.830227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:56.830227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:56.830227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:56.830227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:56.830227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:56.830227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:56.830227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:56.830227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:56.830227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:56.830227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:56.830227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:56.830227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:56.830227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 208/416] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:10:56.839459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0250a-7d76-4a81-959c-550638ba10a7 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:56.930674 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33a7ef-72fc-40b0-980e-57a56792634f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:56.955757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0250a-7d76-4a81-959c-550638ba10a7 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:56.971232 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afc27f-5d30-4534-9cfa-cbf2d8be4c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:56.972203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afc27f-5d30-4534-9cfa-cbf2d8be4c3f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:56.972487 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afc27f-5d30-4534-9cfa-cbf2d8be4c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:56.972756 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afc27f-5d30-4534-9cfa-cbf2d8be4c3f None admin] PATH_INFO: `/v3/projects/b67a2f849d994ba1b870dbba687449fc` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:56.973995 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afc27f-5d30-4534-9cfa-cbf2d8be4c3f None admin] RBAC: Authorizing `identity:get_project(project_id=b67a2f849d994ba1b870dbba687449fc)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:56.975851 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afc27f-5d30-4534-9cfa-cbf2d8be4c3f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:56.978455 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 209/417] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:56 2022] GET /identity/v3/projects/b67a2f849d994ba1b870dbba687449fc => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:56.984156 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afc27f-5d30-4534-9cfa-cbf2d8be4c3f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:57.008586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48aa2bf-3b2a-472d-90ee-9b0f5dc55557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:57.013846 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48aa2bf-3b2a-472d-90ee-9b0f5dc55557 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:57.013846 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48aa2bf-3b2a-472d-90ee-9b0f5dc55557 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:57.013846 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48aa2bf-3b2a-472d-90ee-9b0f5dc55557 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:57.013846 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48aa2bf-3b2a-472d-90ee-9b0f5dc55557 None admin] RBAC: Adding query filter params (name=member) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:57.013846 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48aa2bf-3b2a-472d-90ee-9b0f5dc55557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:57.014693 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48aa2bf-3b2a-472d-90ee-9b0f5dc55557 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:57.028098 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:57.037894 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 209/418] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:57.048765 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48aa2bf-3b2a-472d-90ee-9b0f5dc55557 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:57.081780 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:57.176331 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48aa2bf-3b2a-472d-90ee-9b0f5dc55557 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:57.213120 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71d9ae-9771-4b9f-bfcd-e597f2ab99d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:57.213798 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71d9ae-9771-4b9f-bfcd-e597f2ab99d1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:57.214090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71d9ae-9771-4b9f-bfcd-e597f2ab99d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:57.214402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f71d9ae-9771-4b9f-bfcd-e597f2ab99d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:57.222138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afc27f-5d30-4534-9cfa-cbf2d8be4c3f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:57.287330 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71d9ae-9771-4b9f-bfcd-e597f2ab99d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:57.288808 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f71d9ae-9771-4b9f-bfcd-e597f2ab99d1 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:57.292230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:57.342910 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62da2f3-582a-4224-ad6a-0bf1e51ae910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:57.343737 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62da2f3-582a-4224-ad6a-0bf1e51ae910 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:57.344027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62da2f3-582a-4224-ad6a-0bf1e51ae910 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:57.344314 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62da2f3-582a-4224-ad6a-0bf1e51ae910 None admin] PATH_INFO: `/v3/projects/b67a2f849d994ba1b870dbba687449fc/groups/6a12463ed2e44002b9bf47de1162c722/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:57.351175 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62da2f3-582a-4224-ad6a-0bf1e51ae910 None admin] RBAC: Authorizing `identity:create_grant(project_id=b67a2f849d994ba1b870dbba687449fc, group_id=6a12463ed2e44002b9bf47de1162c722, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:57.352700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62da2f3-582a-4224-ad6a-0bf1e51ae910 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:57.398103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 210/419] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 19:10:57.404498 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71d9ae-9771-4b9f-bfcd-e597f2ab99d1 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:57.409193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 210/420] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Jul 20 19:10:56 2022] PUT /identity/v3/projects/b67a2f849d994ba1b870dbba687449fc/groups/6a12463ed2e44002b9bf47de1162c722/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:10:57.518655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:57.522366 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f71d9ae-9771-4b9f-bfcd-e597f2ab99d1 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:57.561192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8885fc5-a821-4c83-8c0f-8056210f66d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:57.562103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8885fc5-a821-4c83-8c0f-8056210f66d4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:57.562420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8885fc5-a821-4c83-8c0f-8056210f66d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:57.562802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8885fc5-a821-4c83-8c0f-8056210f66d4 None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:57.564277 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8885fc5-a821-4c83-8c0f-8056210f66d4 None admin] RBAC: Authorizing `identity:get_project(project_id=00c44395b45b4dbc8c543b0837e2af1b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:57.565799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8885fc5-a821-4c83-8c0f-8056210f66d4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:57.567986 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 211/421] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:57 2022] GET /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:57.569973 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b82c6-44b1-451e-9665-782519c2de6a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:57.570815 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b82c6-44b1-451e-9665-782519c2de6a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:57.571116 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b82c6-44b1-451e-9665-782519c2de6a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:57.572733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 211/422] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:57.577541 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8885fc5-a821-4c83-8c0f-8056210f66d4 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:57.579348 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57539404-48a7-4324-8a4f-06e1585651b2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:57.579632 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57539404-48a7-4324-8a4f-06e1585651b2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:57.579902 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57539404-48a7-4324-8a4f-06e1585651b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:57.607021 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-57539404-48a7-4324-8a4f-06e1585651b2 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:57.608306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-57539404-48a7-4324-8a4f-06e1585651b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:57.724804 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 212/423] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:57.743277 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8885fc5-a821-4c83-8c0f-8056210f66d4 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:57.754219 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57539404-48a7-4324-8a4f-06e1585651b2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:57.790601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64281ab5-eb0b-421e-a874-a9c96a46f7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:57.791475 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64281ab5-eb0b-421e-a874-a9c96a46f7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:57.791757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64281ab5-eb0b-421e-a874-a9c96a46f7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:57.792030 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64281ab5-eb0b-421e-a874-a9c96a46f7f9 None admin] PATH_INFO: `/v3/groups/af18051111424574bec588108a9e5d8b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:57.793225 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64281ab5-eb0b-421e-a874-a9c96a46f7f9 None admin] RBAC: Authorizing `identity:get_group(group_id=af18051111424574bec588108a9e5d8b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:57.794850 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64281ab5-eb0b-421e-a874-a9c96a46f7f9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:57.796988 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 212/424] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 20 19:10:57 2022] GET /identity/v3/groups/af18051111424574bec588108a9e5d8b => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:57.802644 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:57.803163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64281ab5-eb0b-421e-a874-a9c96a46f7f9 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:57.850765 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:57.924257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64281ab5-eb0b-421e-a874-a9c96a46f7f9 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:57.981736 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e422a-1ba6-4b1d-b50f-7e8f1151f8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:57.982599 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e422a-1ba6-4b1d-b50f-7e8f1151f8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:57.982886 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e422a-1ba6-4b1d-b50f-7e8f1151f8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:57.983164 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e422a-1ba6-4b1d-b50f-7e8f1151f8f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:57.984478 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e422a-1ba6-4b1d-b50f-7e8f1151f8f6 None admin] RBAC: Adding query filter params (group.id=af18051111424574bec588108a9e5d8b, role.id=8b31123e2813440db5a70f87fa5bd932, scope.project.id=00c44395b45b4dbc8c543b0837e2af1b) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:57.984799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e422a-1ba6-4b1d-b50f-7e8f1151f8f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:57.986468 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e422a-1ba6-4b1d-b50f-7e8f1151f8f6 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:57.988464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57539404-48a7-4324-8a4f-06e1585651b2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:57.996316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 213/425] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jul 20 19:10:57 2022] GET /identity/v3/role_assignments?group.id=af18051111424574bec588108a9e5d8b&scope.project.id=00c44395b45b4dbc8c543b0837e2af1b&role.id=8b31123e2813440db5a70f87fa5bd932 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:58.038395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4a34c-0206-4575-a1b5-9b48be15958f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:58.039736 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4a34c-0206-4575-a1b5-9b48be15958f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:58.040016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4a34c-0206-4575-a1b5-9b48be15958f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:58.040283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4a34c-0206-4575-a1b5-9b48be15958f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:58.052327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4a34c-0206-4575-a1b5-9b48be15958f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:58.061551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-31a4a34c-0206-4575-a1b5-9b48be15958f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:58.061551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:58.061551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:58.061551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:58.061551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:58.061551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:58.061551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:58.061551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:58.061551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:58.061551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:58.061551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:58.061551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:58.061551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:58.061551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:58.061551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:58.061551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:58.062526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:58.062526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:58.062526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:58.062526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:58.062526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:58.062526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:58.062526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:58.062526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:58.062526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:58.062526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:58.062526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:58.062526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:58.062526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:58.062526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:58.062526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:58.062526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:58.063802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:58.063802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:58.063802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:58.063802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:58.063802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:58.063802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:58.063802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:58.063802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:58.063802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:58.063802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:58.063802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:58.063802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:58.063802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 213/426] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 20 19:10:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:58.069240 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e422a-1ba6-4b1d-b50f-7e8f1151f8f6 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:58.179484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:58.183062 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e422a-1ba6-4b1d-b50f-7e8f1151f8f6 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:58.220471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19c8d4-7d24-45b0-aae5-4b5e8ccb6968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:58.221156 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19c8d4-7d24-45b0-aae5-4b5e8ccb6968 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:58.221440 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19c8d4-7d24-45b0-aae5-4b5e8ccb6968 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:58.221713 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19c8d4-7d24-45b0-aae5-4b5e8ccb6968 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:58.222491 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19c8d4-7d24-45b0-aae5-4b5e8ccb6968 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:58.222798 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19c8d4-7d24-45b0-aae5-4b5e8ccb6968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:58.224171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19c8d4-7d24-45b0-aae5-4b5e8ccb6968 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:58.234193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 214/427] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:10:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:58.239852 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4a34c-0206-4575-a1b5-9b48be15958f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:58.349401 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:58.349401 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4a34c-0206-4575-a1b5-9b48be15958f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:58.386023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a051b-c087-47fa-9e57-5637021a4248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:58.386715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a051b-c087-47fa-9e57-5637021a4248 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:58.387157 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a051b-c087-47fa-9e57-5637021a4248 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:58.387438 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a051b-c087-47fa-9e57-5637021a4248 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:58.457868 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a051b-c087-47fa-9e57-5637021a4248 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:58.459426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a051b-c087-47fa-9e57-5637021a4248 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:58.559140 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:58.566171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 214/428] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:10:58.571974 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19c8d4-7d24-45b0-aae5-4b5e8ccb6968 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:58.682923 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19c8d4-7d24-45b0-aae5-4b5e8ccb6968 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:58.718722 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e02af5-aa8a-4274-b71f-f0430f6b0350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:58.719639 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02af5-aa8a-4274-b71f-f0430f6b0350 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:58.719924 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02af5-aa8a-4274-b71f-f0430f6b0350 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:58.720199 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e02af5-aa8a-4274-b71f-f0430f6b0350 None admin] PATH_INFO: `/v3/projects/00c44395b45b4dbc8c543b0837e2af1b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:58.721395 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e02af5-aa8a-4274-b71f-f0430f6b0350 None admin] RBAC: Authorizing `identity:get_project(project_id=00c44395b45b4dbc8c543b0837e2af1b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:58.722863 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e02af5-aa8a-4274-b71f-f0430f6b0350 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:58.724841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 215/429] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:58 2022] GET /identity/v3/projects/00c44395b45b4dbc8c543b0837e2af1b => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:58.731095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a051b-c087-47fa-9e57-5637021a4248 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:58.801049 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a581a-4a7b-4fc7-8392-5bbf020131ed None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:58.801695 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a581a-4a7b-4fc7-8392-5bbf020131ed None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:58.802187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a581a-4a7b-4fc7-8392-5bbf020131ed None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:58.806403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 216/430] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:10:58.809800 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def7ea6-801a-435c-81f2-78669f6831cb None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:58.810370 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def7ea6-801a-435c-81f2-78669f6831cb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:58.810891 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def7ea6-801a-435c-81f2-78669f6831cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:58.838136 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8def7ea6-801a-435c-81f2-78669f6831cb None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:58.839940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8def7ea6-801a-435c-81f2-78669f6831cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:58.848713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a051b-c087-47fa-9e57-5637021a4248 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:58.877949 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:58.886698 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef0c70-c716-465d-843b-5bc1e22b86b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:58.887567 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef0c70-c716-465d-843b-5bc1e22b86b9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:58.887849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef0c70-c716-465d-843b-5bc1e22b86b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:58.888123 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef0c70-c716-465d-843b-5bc1e22b86b9 None admin] PATH_INFO: `/v3/groups/af18051111424574bec588108a9e5d8b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:58.889331 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef0c70-c716-465d-843b-5bc1e22b86b9 None admin] RBAC: Authorizing `identity:get_group(group_id=af18051111424574bec588108a9e5d8b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:58.890830 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef0c70-c716-465d-843b-5bc1e22b86b9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:58.892789 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 215/431] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 20 19:10:58 2022] GET /identity/v3/groups/af18051111424574bec588108a9e5d8b => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:58.899684 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef0c70-c716-465d-843b-5bc1e22b86b9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:58.939767 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 217/432] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:10:58.964149 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def7ea6-801a-435c-81f2-78669f6831cb None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:58.965765 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:59.011122 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef0c70-c716-465d-843b-5bc1e22b86b9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:59.047873 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894616c-9d3e-4687-beee-757bc7e49a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:59.048538 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894616c-9d3e-4687-beee-757bc7e49a91 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:59.048823 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894616c-9d3e-4687-beee-757bc7e49a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:59.049102 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894616c-9d3e-4687-beee-757bc7e49a91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:59.049940 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894616c-9d3e-4687-beee-757bc7e49a91 None admin] RBAC: Adding query filter params (group.id=af18051111424574bec588108a9e5d8b, role.id=61bf7de1301f489ab3311c954d548da5, scope.project.id=00c44395b45b4dbc8c543b0837e2af1b) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:59.050251 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894616c-9d3e-4687-beee-757bc7e49a91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:59.051713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894616c-9d3e-4687-beee-757bc7e49a91 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:59.058231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 216/433] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jul 20 19:10:58 2022] GET /identity/v3/role_assignments?group.id=af18051111424574bec588108a9e5d8b&scope.project.id=00c44395b45b4dbc8c543b0837e2af1b&role.id=61bf7de1301f489ab3311c954d548da5 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:59.085134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def7ea6-801a-435c-81f2-78669f6831cb None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:59.133834 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7890a0d-ced5-4ea0-a194-36ae0362ed92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:59.134724 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7890a0d-ced5-4ea0-a194-36ae0362ed92 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:59.135009 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7890a0d-ced5-4ea0-a194-36ae0362ed92 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:59.135285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7890a0d-ced5-4ea0-a194-36ae0362ed92 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:59.147648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7890a0d-ced5-4ea0-a194-36ae0362ed92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:59.150385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd5e97-6667-46c7-901d-4319203c9fc4 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:59.150679 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd5e97-6667-46c7-901d-4319203c9fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:59.150962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd5e97-6667-46c7-901d-4319203c9fc4 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:59.152602 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 217/434] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:10:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:10:59.156648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-f7890a0d-ced5-4ea0-a194-36ae0362ed92 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:59.156648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:59.156648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:59.156648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:59.156648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:59.156648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:59.156648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:59.156648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:59.156648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:59.156648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:59.156648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:59.156648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:59.156648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:59.156648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:59.156648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:59.156648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:59.159116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:59.159116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:59.159116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:59.159116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:59.159116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:59.159116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:59.159116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:59.159116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:59.159116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:59.159116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:59.159116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:59.159116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:59.159116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:59.159116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:59.159116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:59.159116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:59.161001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:59.161001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:59.161001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:59.161001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:59.161001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:59.161001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:59.161001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:59.161001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:59.161001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:59.161001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:59.161001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:10:59.161001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:10:59.161001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 218/435] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 20 19:10:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:10:59.161961 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb006c-420b-46c2-ac69-46ebfc0c7a15 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:59.161961 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb006c-420b-46c2-ac69-46ebfc0c7a15 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:59.161961 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb006c-420b-46c2-ac69-46ebfc0c7a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:59.166329 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7890a0d-ced5-4ea0-a194-36ae0362ed92 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:59.180480 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-16fb006c-420b-46c2-ac69-46ebfc0c7a15 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:10:59.181858 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-16fb006c-420b-46c2-ac69-46ebfc0c7a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:10:59.190138 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:59.263273 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 218/436] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:10:59.278480 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7890a0d-ced5-4ea0-a194-36ae0362ed92 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:59.288685 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb006c-420b-46c2-ac69-46ebfc0c7a15 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:59.319702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c695a-3195-4d66-afd4-ae2c30ea0991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:59.320971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c695a-3195-4d66-afd4-ae2c30ea0991 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:59.321253 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c695a-3195-4d66-afd4-ae2c30ea0991 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:59.321533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c695a-3195-4d66-afd4-ae2c30ea0991 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:59.322284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c695a-3195-4d66-afd4-ae2c30ea0991 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:59.322696 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c695a-3195-4d66-afd4-ae2c30ea0991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:59.324053 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c695a-3195-4d66-afd4-ae2c30ea0991 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:59.334524 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 219/437] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:10:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:59.341045 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c695a-3195-4d66-afd4-ae2c30ea0991 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:59.354397 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:59.427934 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb006c-420b-46c2-ac69-46ebfc0c7a15 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:59.456737 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:59.482373 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c695a-3195-4d66-afd4-ae2c30ea0991 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:59.486721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a761b-b0da-4e76-9f92-8d79324389c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:59.487541 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a761b-b0da-4e76-9f92-8d79324389c4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:59.487825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a761b-b0da-4e76-9f92-8d79324389c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:59.488099 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a761b-b0da-4e76-9f92-8d79324389c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:59.502527 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a761b-b0da-4e76-9f92-8d79324389c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:10:59.512449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-2c6a761b-b0da-4e76-9f92-8d79324389c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:59.512449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:10:59.512449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:10:59.512449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:10:59.512449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:10:59.512449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:10:59.512449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:10:59.512449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:10:59.512449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:10:59.512449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:10:59.512449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:10:59.512449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:10:59.512449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:10:59.512449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:10:59.512449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:10:59.512449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:10:59.513426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:10:59.513426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:10:59.513426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:10:59.513426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:10:59.513426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:10:59.513426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:10:59.513426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:10:59.513426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:10:59.513426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:10:59.513426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:10:59.513426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:10:59.513426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:10:59.513426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:10:59.513426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:10:59.513426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:10:59.513426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:10:59.514542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:10:59.514542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:10:59.514542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:10:59.514542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:10:59.514542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:10:59.514542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:10:59.514542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:10:59.514542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:10:59.514542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:10:59.514542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:10:59.514542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 19:10:59.514542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:10:59.514542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 219/438] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:10:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:10:59.519660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a761b-b0da-4e76-9f92-8d79324389c4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:59.530292 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfc07c-d473-4c8e-b673-db48e55cc47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:59.531156 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfc07c-d473-4c8e-b673-db48e55cc47c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:59.531482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfc07c-d473-4c8e-b673-db48e55cc47c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:59.531775 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfc07c-d473-4c8e-b673-db48e55cc47c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:59.624379 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfc07c-d473-4c8e-b673-db48e55cc47c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:59.625849 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfc07c-d473-4c8e-b673-db48e55cc47c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:59.655274 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a761b-b0da-4e76-9f92-8d79324389c4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:59.669959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:59.693811 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8598a-8941-42fb-8a42-660d2448f79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:59.694495 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8598a-8941-42fb-8a42-660d2448f79e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:59.694777 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8598a-8941-42fb-8a42-660d2448f79e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:59.695049 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8598a-8941-42fb-8a42-660d2448f79e None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:59.695955 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8598a-8941-42fb-8a42-660d2448f79e None admin] RBAC: Adding query filter params (name=member) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:10:59.696342 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8598a-8941-42fb-8a42-660d2448f79e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:59.697697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b8598a-8941-42fb-8a42-660d2448f79e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:59.711300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 220/439] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:10:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:10:59.712280 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8598a-8941-42fb-8a42-660d2448f79e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:59.719345 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:59.744660 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 220/440] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 19:10:59.750099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfc07c-d473-4c8e-b673-db48e55cc47c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:59.826339 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8598a-8941-42fb-8a42-660d2448f79e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:59.856776 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfc07c-d473-4c8e-b673-db48e55cc47c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:10:59.862598 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888adef9-1cbd-4fe2-a9c2-a0e5a9dd4bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:59.863465 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888adef9-1cbd-4fe2-a9c2-a0e5a9dd4bfa None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:59.864286 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888adef9-1cbd-4fe2-a9c2-a0e5a9dd4bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:59.864744 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888adef9-1cbd-4fe2-a9c2-a0e5a9dd4bfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:59.892183 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e210423-b773-4c67-9b7e-a4a82134122a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:10:59.893297 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e210423-b773-4c67-9b7e-a4a82134122a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:10:59.893729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e210423-b773-4c67-9b7e-a4a82134122a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:10:59.894151 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e210423-b773-4c67-9b7e-a4a82134122a None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:10:59.895508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e210423-b773-4c67-9b7e-a4a82134122a None admin] RBAC: Authorizing `identity:get_project(project_id=1cf408d461524402acb8b395a622adc4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:59.896947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e210423-b773-4c67-9b7e-a4a82134122a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:59.903692 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 221/441] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:10:59 2022] GET /identity/v3/projects/1cf408d461524402acb8b395a622adc4 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:10:59.904455 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e210423-b773-4c67-9b7e-a4a82134122a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:10:59.915272 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:10:59.941420 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888adef9-1cbd-4fe2-a9c2-a0e5a9dd4bfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:10:59.942934 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888adef9-1cbd-4fe2-a9c2-a0e5a9dd4bfa None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:10:59.955763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:00.007149 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e210423-b773-4c67-9b7e-a4a82134122a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:00.042028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 221/442] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:10:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:00.042889 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b278ad-a1c2-471e-a6a2-ac05ced9c846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:00.043745 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b278ad-a1c2-471e-a6a2-ac05ced9c846 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:00.044033 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b278ad-a1c2-471e-a6a2-ac05ced9c846 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:00.044154 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412a1c3-2091-4f78-bf1f-fbea356da59e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:00.044312 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b278ad-a1c2-471e-a6a2-ac05ced9c846 None admin] PATH_INFO: `/v3/groups/af18051111424574bec588108a9e5d8b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:00.044419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412a1c3-2091-4f78-bf1f-fbea356da59e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:00.044757 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412a1c3-2091-4f78-bf1f-fbea356da59e None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:00.045610 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b278ad-a1c2-471e-a6a2-ac05ced9c846 None admin] RBAC: Authorizing `identity:get_group(group_id=af18051111424574bec588108a9e5d8b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:00.046146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 222/443] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:00.047108 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b278ad-a1c2-471e-a6a2-ac05ced9c846 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:00.053212 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 222/444] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 20 19:10:59 2022] GET /identity/v3/groups/af18051111424574bec588108a9e5d8b => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:00.053346 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412a1c3-2091-4f78-bf1f-fbea356da59e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:00.053455 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813da064-5643-410d-af52-178e7ee78fb9 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:00.053455 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813da064-5643-410d-af52-178e7ee78fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:00.053455 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813da064-5643-410d-af52-178e7ee78fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:00.069136 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-813da064-5643-410d-af52-178e7ee78fb9 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:00.070364 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-813da064-5643-410d-af52-178e7ee78fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:00.128768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:00.137563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 223/445] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:11:00.139176 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813da064-5643-410d-af52-178e7ee78fb9 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:00.154629 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412a1c3-2091-4f78-bf1f-fbea356da59e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:00.189069 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:00.189427 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce11c1-8a42-4b23-b638-21dd7bb0eab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:00.190406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce11c1-8a42-4b23-b638-21dd7bb0eab7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:00.190677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce11c1-8a42-4b23-b638-21dd7bb0eab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:00.191026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce11c1-8a42-4b23-b638-21dd7bb0eab7 None admin] PATH_INFO: `/v3/projects/1cf408d461524402acb8b395a622adc4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:00.192253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce11c1-8a42-4b23-b638-21dd7bb0eab7 None admin] RBAC: Authorizing `identity:get_project(project_id=1cf408d461524402acb8b395a622adc4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:00.193691 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce11c1-8a42-4b23-b638-21dd7bb0eab7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:00.195583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 223/446] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:11:00 2022] GET /identity/v3/projects/1cf408d461524402acb8b395a622adc4 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:00.196335 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce11c1-8a42-4b23-b638-21dd7bb0eab7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:00.240090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813da064-5643-410d-af52-178e7ee78fb9 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:00.274013 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b00572-08f6-46e9-807e-d9a2d8ad9357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:00.274696 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b00572-08f6-46e9-807e-d9a2d8ad9357 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:00.274980 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b00572-08f6-46e9-807e-d9a2d8ad9357 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:00.275236 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b00572-08f6-46e9-807e-d9a2d8ad9357 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:00.276054 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b00572-08f6-46e9-807e-d9a2d8ad9357 None admin] RBAC: Adding query filter params (group.id=af18051111424574bec588108a9e5d8b, role.id=61bf7de1301f489ab3311c954d548da5, scope.project.id=1cf408d461524402acb8b395a622adc4) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:00.276362 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b00572-08f6-46e9-807e-d9a2d8ad9357 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:00.277786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b00572-08f6-46e9-807e-d9a2d8ad9357 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:00.283574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 224/447] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jul 20 19:11:00 2022] GET /identity/v3/role_assignments?group.id=af18051111424574bec588108a9e5d8b&scope.project.id=1cf408d461524402acb8b395a622adc4&role.id=61bf7de1301f489ab3311c954d548da5 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:00.284600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b00572-08f6-46e9-807e-d9a2d8ad9357 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:00.294841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce11c1-8a42-4b23-b638-21dd7bb0eab7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:00.335647 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fe853-2fa4-46fb-ac14-9851c5e44363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:00.337082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fe853-2fa4-46fb-ac14-9851c5e44363 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:00.337364 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fe853-2fa4-46fb-ac14-9851c5e44363 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:00.337639 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fe853-2fa4-46fb-ac14-9851c5e44363 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:00.350428 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091fe853-2fa4-46fb-ac14-9851c5e44363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:00.358651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-091fe853-2fa4-46fb-ac14-9851c5e44363 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:00.358651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:00.358651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:00.358651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:00.358651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:00.358651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:00.358651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:00.358651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:00.358651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:00.358651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:00.358651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:00.358651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:00.358651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:00.358651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:00.358651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:00.358651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:00.360193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:00.360193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:00.360193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:00.360193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:00.360193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:00.360193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:00.360193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:00.360193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:00.360193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:00.360193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:00.360193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:00.360193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:00.360193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:00.360193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:00.360193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:00.360193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:00.361637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:00.361637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:00.361637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:00.361637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:00.361637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:00.361637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:00.361637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:00.361637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:00.361637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:00.361637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:00.361637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:00.361637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:00.361637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 224/448] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:11:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:00.365774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fe853-2fa4-46fb-ac14-9851c5e44363 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:00.369661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:00.410334 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b00572-08f6-46e9-807e-d9a2d8ad9357 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:00.425257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:00.453083 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444e36a-143e-469e-9fd3-7766e880b1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:00.453960 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444e36a-143e-469e-9fd3-7766e880b1ee None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:00.454247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444e36a-143e-469e-9fd3-7766e880b1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:00.454579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444e36a-143e-469e-9fd3-7766e880b1ee None admin] PATH_INFO: `/v3/groups/af18051111424574bec588108a9e5d8b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:00.455792 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444e36a-143e-469e-9fd3-7766e880b1ee None admin] RBAC: Authorizing `identity:get_group(group_id=af18051111424574bec588108a9e5d8b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:00.457240 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444e36a-143e-469e-9fd3-7766e880b1ee None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:00.459351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 225/449] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 20 19:11:00 2022] GET /identity/v3/groups/af18051111424574bec588108a9e5d8b => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:00.465697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444e36a-143e-469e-9fd3-7766e880b1ee None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:00.486531 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fe853-2fa4-46fb-ac14-9851c5e44363 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:00.521390 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53360583-5eb9-4cb2-ab4b-aa1ca6593ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:00.522061 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53360583-5eb9-4cb2-ab4b-aa1ca6593ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:00.522372 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53360583-5eb9-4cb2-ab4b-aa1ca6593ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:00.522656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53360583-5eb9-4cb2-ab4b-aa1ca6593ba2 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:00.523948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53360583-5eb9-4cb2-ab4b-aa1ca6593ba2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:00.524255 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53360583-5eb9-4cb2-ab4b-aa1ca6593ba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:00.525627 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53360583-5eb9-4cb2-ab4b-aa1ca6593ba2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:00.533750 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 225/450] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:00.539471 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53360583-5eb9-4cb2-ab4b-aa1ca6593ba2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:00.573323 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444e36a-143e-469e-9fd3-7766e880b1ee None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:00.602765 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:00.608349 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2a835-b5a2-4855-a07e-ba7e01c9d091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:00.608994 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2a835-b5a2-4855-a07e-ba7e01c9d091 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:00.609283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2a835-b5a2-4855-a07e-ba7e01c9d091 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:00.609562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2a835-b5a2-4855-a07e-ba7e01c9d091 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:00.610422 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2a835-b5a2-4855-a07e-ba7e01c9d091 None admin] RBAC: Adding query filter params (group.id=af18051111424574bec588108a9e5d8b, role.id=8b31123e2813440db5a70f87fa5bd932, scope.project.id=1cf408d461524402acb8b395a622adc4) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:00.610738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2a835-b5a2-4855-a07e-ba7e01c9d091 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:00.612190 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2a835-b5a2-4855-a07e-ba7e01c9d091 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:00.618022 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 226/451] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jul 20 19:11:00 2022] GET /identity/v3/role_assignments?group.id=af18051111424574bec588108a9e5d8b&scope.project.id=1cf408d461524402acb8b395a622adc4&role.id=8b31123e2813440db5a70f87fa5bd932 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:00.639571 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53360583-5eb9-4cb2-ab4b-aa1ca6593ba2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:00.681996 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63dc2b-a3de-4d9c-830f-59af7ec38ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:00.682608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63dc2b-a3de-4d9c-830f-59af7ec38ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:00.682899 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63dc2b-a3de-4d9c-830f-59af7ec38ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:00.683187 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63dc2b-a3de-4d9c-830f-59af7ec38ec5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:00.754499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63dc2b-a3de-4d9c-830f-59af7ec38ec5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:00.755986 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63dc2b-a3de-4d9c-830f-59af7ec38ec5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:00.834846 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:00.871510 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 226/452] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 19:11:00.877222 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2a835-b5a2-4855-a07e-ba7e01c9d091 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:00.925980 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:00.985793 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2a835-b5a2-4855-a07e-ba7e01c9d091 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:01.019852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67d91c-8283-45a1-b5fe-513db2a419a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:01.020727 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67d91c-8283-45a1-b5fe-513db2a419a2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:01.021012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67d91c-8283-45a1-b5fe-513db2a419a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:01.021296 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67d91c-8283-45a1-b5fe-513db2a419a2 None admin] PATH_INFO: `/v3/projects/b67a2f849d994ba1b870dbba687449fc` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:01.022531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67d91c-8283-45a1-b5fe-513db2a419a2 None admin] RBAC: Authorizing `identity:get_project(project_id=b67a2f849d994ba1b870dbba687449fc)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:01.024000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67d91c-8283-45a1-b5fe-513db2a419a2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:01.025714 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 227/453] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:11:00 2022] GET /identity/v3/projects/b67a2f849d994ba1b870dbba687449fc => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:01.031508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63dc2b-a3de-4d9c-830f-59af7ec38ec5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:01.134458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63dc2b-a3de-4d9c-830f-59af7ec38ec5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:01.176866 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c840752-10a1-4c2d-99b1-20f1c6d50679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:01.177726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c840752-10a1-4c2d-99b1-20f1c6d50679 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:01.178006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c840752-10a1-4c2d-99b1-20f1c6d50679 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:01.178282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c840752-10a1-4c2d-99b1-20f1c6d50679 None admin] PATH_INFO: `/v3/groups/6a12463ed2e44002b9bf47de1162c722` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:01.180096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c840752-10a1-4c2d-99b1-20f1c6d50679 None admin] RBAC: Authorizing `identity:get_group(group_id=6a12463ed2e44002b9bf47de1162c722)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:01.181532 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c840752-10a1-4c2d-99b1-20f1c6d50679 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:01.183203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 227/454] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Jul 20 19:11:01 2022] GET /identity/v3/groups/6a12463ed2e44002b9bf47de1162c722 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:01.189467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67d91c-8283-45a1-b5fe-513db2a419a2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:01.286809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67d91c-8283-45a1-b5fe-513db2a419a2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:01.300125 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:01.321005 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22037ef-32be-44c0-a0c2-cadb14adaec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:01.321654 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22037ef-32be-44c0-a0c2-cadb14adaec2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:01.321937 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22037ef-32be-44c0-a0c2-cadb14adaec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:01.322212 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22037ef-32be-44c0-a0c2-cadb14adaec2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:01.323065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22037ef-32be-44c0-a0c2-cadb14adaec2 None admin] RBAC: Adding query filter params (group.id=6a12463ed2e44002b9bf47de1162c722, role.id=6322f657162c45ca85f019a408655ff3, scope.project.id=b67a2f849d994ba1b870dbba687449fc) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:01.323380 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22037ef-32be-44c0-a0c2-cadb14adaec2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:01.324825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22037ef-32be-44c0-a0c2-cadb14adaec2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:01.330515 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 228/455] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Jul 20 19:11:01 2022] GET /identity/v3/role_assignments?group.id=6a12463ed2e44002b9bf47de1162c722&scope.project.id=b67a2f849d994ba1b870dbba687449fc&role.id=6322f657162c45ca85f019a408655ff3 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:03.887726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a1715-a713-4680-b71d-7311afe83436 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:03.888756 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a1715-a713-4680-b71d-7311afe83436 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:03.889259 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a1715-a713-4680-b71d-7311afe83436 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:03.891153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 228/456] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:03.897006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a554a-3f72-4769-b428-4a8e1e8f6ff3 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:03.897881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a554a-3f72-4769-b428-4a8e1e8f6ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:03.898443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a554a-3f72-4769-b428-4a8e1e8f6ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:03.922608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2c2a554a-3f72-4769-b428-4a8e1e8f6ff3 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:03.923816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2c2a554a-3f72-4769-b428-4a8e1e8f6ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:04.009472 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 229/457] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:11:04.017744 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966978e-0d07-40a0-8b07-21f8e84bdf33 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:04.018290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966978e-0d07-40a0-8b07-21f8e84bdf33 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:04.018822 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966978e-0d07-40a0-8b07-21f8e84bdf33 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:04.020606 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 229/458] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:04.025836 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870f500-19c8-48d7-addc-29b5d3c16017 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:04.026378 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870f500-19c8-48d7-addc-29b5d3c16017 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:04.026871 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870f500-19c8-48d7-addc-29b5d3c16017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:04.038560 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966978e-0d07-40a0-8b07-21f8e84bdf33 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:04.060719 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1870f500-19c8-48d7-addc-29b5d3c16017 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:04.061934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1870f500-19c8-48d7-addc-29b5d3c16017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:04.098209 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:04.198248 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 230/459] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:04.222401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870f500-19c8-48d7-addc-29b5d3c16017 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:04.230332 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966978e-0d07-40a0-8b07-21f8e84bdf33 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:04.259255 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:04.307072 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f4805-a5b9-4f40-bc78-9f57f3eb8f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:04.307899 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f4805-a5b9-4f40-bc78-9f57f3eb8f87 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:04.308180 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f4805-a5b9-4f40-bc78-9f57f3eb8f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:04.308452 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f4805-a5b9-4f40-bc78-9f57f3eb8f87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:04.329406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f4805-a5b9-4f40-bc78-9f57f3eb8f87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:04.331614 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f4805-a5b9-4f40-bc78-9f57f3eb8f87 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:04.338722 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870f500-19c8-48d7-addc-29b5d3c16017 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:04.362381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-825f4805-a5b9-4f40-bc78-9f57f3eb8f87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:04.362381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:04.362381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:04.362381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:04.362381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:04.362381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:04.362381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:04.362381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:04.362381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:04.362381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:04.362381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:04.362381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:04.362381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:04.362381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:04.362381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:04.363556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:04.363556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:04.363556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:04.363556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:04.363556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:04.363556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:04.363556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:04.363556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:04.363556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:04.363556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:04.363556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:04.363556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:04.363556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:04.363556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:04.363556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:04.363556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:04.363556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:04.364647 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:04.364647 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:04.364647 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:04.364647 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:04.366549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 230/460] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:04.368587 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bd6eb-514e-4b9f-bb37-05dd9f63da87 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:04.369020 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bd6eb-514e-4b9f-bb37-05dd9f63da87 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:04.369458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bd6eb-514e-4b9f-bb37-05dd9f63da87 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:04.371150 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 231/461] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:04.372899 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bd6eb-514e-4b9f-bb37-05dd9f63da87 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:04.390534 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e6ade-0210-47c4-a3b3-8bea06995e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:04.391606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e6ade-0210-47c4-a3b3-8bea06995e47 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:04.392224 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e6ade-0210-47c4-a3b3-8bea06995e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:04.392646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e6ade-0210-47c4-a3b3-8bea06995e47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:04.405988 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e6ade-0210-47c4-a3b3-8bea06995e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:04.407499 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e6ade-0210-47c4-a3b3-8bea06995e47 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:04.427493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-090e6ade-0210-47c4-a3b3-8bea06995e47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:04.427493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:04.427493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:04.427493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:04.427493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:04.427493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:04.427493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:04.427493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:04.427493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:04.427493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:04.427493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:04.427493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:04.427493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:04.427493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:04.427493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:04.428417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:04.428417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:04.428417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:04.428417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:04.428417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:04.428417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:04.428417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:04.428417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:04.428417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:04.428417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:04.428417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:04.428417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:04.428417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:04.428417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:04.428417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:04.428417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:04.428417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:04.429447 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:04.429447 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:04.429447 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:04.429447 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:04.429447 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 231/462] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:04.430167 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb9104-7e85-43a4-95ab-3bfe55347c10 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:04.430429 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb9104-7e85-43a4-95ab-3bfe55347c10 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:04.430712 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb9104-7e85-43a4-95ab-3bfe55347c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:04.447774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-fbdb9104-7e85-43a4-95ab-3bfe55347c10 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:04.449090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-fbdb9104-7e85-43a4-95ab-3bfe55347c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:04.486630 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:04.505226 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bd6eb-514e-4b9f-bb37-05dd9f63da87 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:04.522584 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 232/463] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:04.524138 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb9104-7e85-43a4-95ab-3bfe55347c10 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:04.549506 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437af05-f761-4821-862a-61a4dd1aeb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:04.550359 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:04.551463 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437af05-f761-4821-862a-61a4dd1aeb61 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:04.551957 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437af05-f761-4821-862a-61a4dd1aeb61 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:04.552419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437af05-f761-4821-862a-61a4dd1aeb61 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:04.553546 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437af05-f761-4821-862a-61a4dd1aeb61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:04.554022 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437af05-f761-4821-862a-61a4dd1aeb61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:04.555601 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437af05-f761-4821-862a-61a4dd1aeb61 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:04.570337 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 232/464] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:04.570337 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00474a18-b767-4572-ad59-a47810276e97 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:04.570337 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00474a18-b767-4572-ad59-a47810276e97 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:04.570337 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00474a18-b767-4572-ad59-a47810276e97 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:04.574374 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 233/465] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:04.574374 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00474a18-b767-4572-ad59-a47810276e97 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:04.645209 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb9104-7e85-43a4-95ab-3bfe55347c10 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:04.687494 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00474a18-b767-4572-ad59-a47810276e97 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:04.691373 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30102f-69a8-4002-a3f0-a9acd4cf0aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:04.692043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30102f-69a8-4002-a3f0-a9acd4cf0aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:04.692327 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30102f-69a8-4002-a3f0-a9acd4cf0aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:04.692605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30102f-69a8-4002-a3f0-a9acd4cf0aa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:04.693338 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30102f-69a8-4002-a3f0-a9acd4cf0aa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:04.693646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30102f-69a8-4002-a3f0-a9acd4cf0aa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:04.695170 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30102f-69a8-4002-a3f0-a9acd4cf0aa1 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:04.714431 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 233/466] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:04.714431 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30102f-69a8-4002-a3f0-a9acd4cf0aa1 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:04.730487 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83da166-d4c4-4885-90d6-0a6295024997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:04.731277 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83da166-d4c4-4885-90d6-0a6295024997 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:04.731560 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83da166-d4c4-4885-90d6-0a6295024997 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:04.731836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83da166-d4c4-4885-90d6-0a6295024997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:04.743989 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83da166-d4c4-4885-90d6-0a6295024997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:04.745560 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83da166-d4c4-4885-90d6-0a6295024997 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:04.753496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:04.765589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c83da166-d4c4-4885-90d6-0a6295024997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:04.765589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:04.765589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:04.765589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:04.765589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:04.765589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:04.765589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:04.765589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:04.765589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:04.765589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:04.765589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:04.765589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:04.765589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:04.765589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:04.765589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:04.766700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:04.766700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:04.766700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:04.766700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:04.766700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:04.766700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:04.766700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:04.766700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:04.766700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:04.766700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:04.766700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:04.766700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:04.766700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:04.766700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:04.766700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:04.766700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:04.766700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:04.767553 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:04.767553 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:04.767553 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:04.767553 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:04.770340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 234/467] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:04.771673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99105755-ce4a-44df-92af-48867ccedcb4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:04.771961 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99105755-ce4a-44df-92af-48867ccedcb4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:04.772290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99105755-ce4a-44df-92af-48867ccedcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:04.789638 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-99105755-ce4a-44df-92af-48867ccedcb4 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:04.790853 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-99105755-ce4a-44df-92af-48867ccedcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:04.813889 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:04.842161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30102f-69a8-4002-a3f0-a9acd4cf0aa1 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:04.870087 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 235/468] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:04.870087 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99105755-ce4a-44df-92af-48867ccedcb4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:04.896349 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6b312-d41c-409a-988b-907049817b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:04.897034 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6b312-d41c-409a-988b-907049817b57 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:04.897586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6b312-d41c-409a-988b-907049817b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:04.897586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b6b312-d41c-409a-988b-907049817b57 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:04.898493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6b312-d41c-409a-988b-907049817b57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:04.900344 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b6b312-d41c-409a-988b-907049817b57 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:04.930338 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 234/469] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 20 19:11:04 2022] POST /identity/v3/users => generated 246 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:11:04.930338 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6b312-d41c-409a-988b-907049817b57 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:04.996844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99105755-ce4a-44df-92af-48867ccedcb4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:05.038122 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:05.054965 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b6b312-d41c-409a-988b-907049817b57 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:05.055544 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e114e6-a9b9-4045-a878-29f3f8cd12a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:05.056341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e114e6-a9b9-4045-a878-29f3f8cd12a3 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:05.056739 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e114e6-a9b9-4045-a878-29f3f8cd12a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:05.057113 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e114e6-a9b9-4045-a878-29f3f8cd12a3 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:05.057929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e114e6-a9b9-4045-a878-29f3f8cd12a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:05.059614 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e114e6-a9b9-4045-a878-29f3f8cd12a3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:05.085324 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 236/470] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 20 19:11:04 2022] POST /identity/v3/users => generated 248 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:11:05.087164 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e114e6-a9b9-4045-a878-29f3f8cd12a3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:05.098057 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415cd59-d467-4cb0-ab7b-1833ebfebaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:05.098774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415cd59-d467-4cb0-ab7b-1833ebfebaca None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:05.099063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415cd59-d467-4cb0-ab7b-1833ebfebaca None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:05.099462 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415cd59-d467-4cb0-ab7b-1833ebfebaca None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:05.100217 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415cd59-d467-4cb0-ab7b-1833ebfebaca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:05.100530 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415cd59-d467-4cb0-ab7b-1833ebfebaca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:05.102612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415cd59-d467-4cb0-ab7b-1833ebfebaca None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:05.104426 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:05.121819 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 235/471] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:05.127686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415cd59-d467-4cb0-ab7b-1833ebfebaca None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:05.232539 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e114e6-a9b9-4045-a878-29f3f8cd12a3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:05.250193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415cd59-d467-4cb0-ab7b-1833ebfebaca None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:05.279993 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f6a84-a561-414b-b69a-0a6f94042b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:05.281298 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f6a84-a561-414b-b69a-0a6f94042b48 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:05.281298 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f6a84-a561-414b-b69a-0a6f94042b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:05.282294 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f6a84-a561-414b-b69a-0a6f94042b48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:05.294136 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e30b5-9773-41cc-b641-571383f78bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:05.294944 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e30b5-9773-41cc-b641-571383f78bcf None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:05.295233 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e30b5-9773-41cc-b641-571383f78bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:05.295515 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e30b5-9773-41cc-b641-571383f78bcf None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:05.296244 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e30b5-9773-41cc-b641-571383f78bcf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:05.296845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f6a84-a561-414b-b69a-0a6f94042b48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:05.297699 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e30b5-9773-41cc-b641-571383f78bcf None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:05.298289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f6a84-a561-414b-b69a-0a6f94042b48 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:05.317791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e57f6a84-a561-414b-b69a-0a6f94042b48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:05.317791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:05.317791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:05.317791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:05.317791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:05.317791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:05.317791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:05.317791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:05.317791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:05.317791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:05.317791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:05.317791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:05.317791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:05.317791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:05.317791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:05.318947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:05.318947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:05.318947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:05.318947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:05.318947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:05.318947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:05.318947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:05.318947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:05.318947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:05.318947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:05.318947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:05.318947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:05.318947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:05.318947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:05.318947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:05.318947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:05.318947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:05.319945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:05.319945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:05.319945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:05.319945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:05.320289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 237/472] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:05.323585 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 236/473] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 20 19:11:05 2022] POST /identity/v3/users => generated 248 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:11:05.325866 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f6a84-a561-414b-b69a-0a6f94042b48 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:05.355949 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76993a4-316b-4c8b-a6bc-d10607c530d0 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:05.356590 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76993a4-316b-4c8b-a6bc-d10607c530d0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:05.357074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76993a4-316b-4c8b-a6bc-d10607c530d0 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:05.359106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 237/474] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:11:05.365588 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b713a9-4d59-48b1-a021-ae5a6536c906 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:05.366210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b713a9-4d59-48b1-a021-ae5a6536c906 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:05.366622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b713a9-4d59-48b1-a021-ae5a6536c906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:05.373789 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:05.387104 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-83b713a9-4d59-48b1-a021-ae5a6536c906 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:05.388368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-83b713a9-4d59-48b1-a021-ae5a6536c906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:05.448886 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:05.472768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f6a84-a561-414b-b69a-0a6f94042b48 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:05.480754 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 238/475] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:11:05.506068 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b713a9-4d59-48b1-a021-ae5a6536c906 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:05.521399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08248178-16eb-4bca-83e2-13fa1af5b683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:05.522075 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08248178-16eb-4bca-83e2-13fa1af5b683 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:05.522436 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08248178-16eb-4bca-83e2-13fa1af5b683 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:05.522711 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08248178-16eb-4bca-83e2-13fa1af5b683 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:05.524108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08248178-16eb-4bca-83e2-13fa1af5b683 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:05.524468 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08248178-16eb-4bca-83e2-13fa1af5b683 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:05.525845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08248178-16eb-4bca-83e2-13fa1af5b683 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:05.541012 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 238/476] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:05.546508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08248178-16eb-4bca-83e2-13fa1af5b683 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:05.637537 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b713a9-4d59-48b1-a021-ae5a6536c906 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:05.647364 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:05.654765 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08248178-16eb-4bca-83e2-13fa1af5b683 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:05.675701 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea67725-5ef3-4c64-b31b-473380b56adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:05.676379 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea67725-5ef3-4c64-b31b-473380b56adf None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:05.676667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea67725-5ef3-4c64-b31b-473380b56adf None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:05.676949 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea67725-5ef3-4c64-b31b-473380b56adf None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:05.677704 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea67725-5ef3-4c64-b31b-473380b56adf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:05.679178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea67725-5ef3-4c64-b31b-473380b56adf None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:05.686798 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.sql.core [None req-eea67725-5ef3-4c64-b31b-473380b56adf None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 19:11:05.686798 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 19:11:05.686798 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [parameters: {'id': '87ae00cfb17d4177beac86788e0b536d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 19:11:05.686798 dv-cinder-819149-14-smb devstack@keystone.service[80233]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80233) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 19:11:05.693222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5d525-7d60-4cd7-b604-6273fefef67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:05.694078 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5d525-7d60-4cd7-b604-6273fefef67c None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:05.694552 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5d525-7d60-4cd7-b604-6273fefef67c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:05.695546 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c5d525-7d60-4cd7-b604-6273fefef67c None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:05.696424 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5d525-7d60-4cd7-b604-6273fefef67c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:05.698001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c5d525-7d60-4cd7-b604-6273fefef67c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:05.705171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-eea67725-5ef3-4c64-b31b-473380b56adf None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 19:11:05.705171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:05.705171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 19:11:05.705171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 19:11:05.705171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 19:11:05.705171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 19:11:05.705171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 19:11:05.705171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 19:11:05.705171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 19:11:05.705171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application conn.query(q) Jul 20 19:11:05.705171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 19:11:05.705171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 19:11:05.705171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 19:11:05.705171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result.read() Jul 20 19:11:05.705171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 19:11:05.706256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 19:11:05.706256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 19:11:05.706256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 19:11:05.706256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 19:11:05.706256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 19:11:05.706256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 19:11:05.706256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 19:11:05.706256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 19:11:05.706256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:05.706256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 19:11:05.706256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:05.706256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:05.706256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 19:11:05.706256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 19:11:05.706256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 20 19:11:05.706256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return ref.to_dict() Jul 20 19:11:05.706256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 19:11:05.706256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application next(self.gen) Jul 20 19:11:05.707445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 19:11:05.707445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application yield resource Jul 20 19:11:05.707445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 19:11:05.707445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application next(self.gen) Jul 20 19:11:05.707445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 19:11:05.707445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 19:11:05.707445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 19:11:05.707445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 19:11:05.707445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 19:11:05.707445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise self.value Jul 20 19:11:05.707445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 19:11:05.707445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 19:11:05.707445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 19:11:05.707445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application session.commit() Jul 20 19:11:05.707445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 19:11:05.707445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 19:11:05.707445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 19:11:05.708423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 19:11:05.708423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 19:11:05.708423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.session.flush() Jul 20 19:11:05.708423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 19:11:05.708423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 19:11:05.708423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 19:11:05.708423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 19:11:05.708423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 19:11:05.708423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application compat.raise_( Jul 20 19:11:05.708423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 19:11:05.708423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception Jul 20 19:11:05.708423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 19:11:05.708423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 19:11:05.708423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 19:11:05.708423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 19:11:05.708423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 19:11:05.708423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 19:11:05.709388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 19:11:05.709388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 19:11:05.709388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 19:11:05.709388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 19:11:05.709388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 19:11:05.709388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 19:11:05.709388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 19:11:05.709388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 19:11:05.709388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 19:11:05.709388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 19:11:05.709388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 19:11:05.709388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 19:11:05.709388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 19:11:05.709388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 19:11:05.709388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 19:11:05.709388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception Jul 20 19:11:05.711785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 19:11:05.711785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 19:11:05.711785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 19:11:05.711785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 19:11:05.711785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 19:11:05.711785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 19:11:05.711785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 19:11:05.711785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application conn.query(q) Jul 20 19:11:05.711785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 19:11:05.711785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 19:11:05.711785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 19:11:05.711785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result.read() Jul 20 19:11:05.711785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 19:11:05.711785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 19:11:05.711785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 19:11:05.711785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 19:11:05.715095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 19:11:05.715095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 19:11:05.715095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 19:11:05.715095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 19:11:05.715095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 19:11:05.715095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 19:11:05.715095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [parameters: {'id': '87ae00cfb17d4177beac86788e0b536d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 19:11:05.715095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 19:11:05.715095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:05.715095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:11:05.715095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:05.715095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:05.715095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:05.715095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:05.715095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:05.715095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:05.717351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:05.717351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:05.717351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:05.717351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:05.717351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:05.717351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:05.717351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 20 19:11:05.717351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 20 19:11:05.717351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:05.717351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:05.717351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 20 19:11:05.717351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 20 19:11:05.717351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 19:11:05.717351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 19:11:05.717351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 19:11:05.717351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:05.719546 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 239/477] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Jul 20 19:11:05 2022] POST /identity/v3/roles => generated 144 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:05.719546 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea67725-5ef3-4c64-b31b-473380b56adf None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:05.733750 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 239/478] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 20 19:11:05 2022] POST /identity/v3/users => generated 249 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:11:05.779272 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:05.845194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea67725-5ef3-4c64-b31b-473380b56adf None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:05.883894 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99595954-7c7d-4c38-820f-f36fd7050784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:05.884795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99595954-7c7d-4c38-820f-f36fd7050784 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:05.885083 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99595954-7c7d-4c38-820f-f36fd7050784 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:05.885367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99595954-7c7d-4c38-820f-f36fd7050784 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:05.897794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99595954-7c7d-4c38-820f-f36fd7050784 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:05.906958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-99595954-7c7d-4c38-820f-f36fd7050784 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:11:05.906958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:05.906958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:05.906958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:05.906958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:05.906958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:05.906958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:05.906958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:05.906958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:05.906958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:05.906958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:05.906958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:05.906958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:05.906958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:05.906958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:05.906958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:05.907997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:05.907997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:05.907997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:05.907997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:05.907997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:05.907997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:05.907997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:05.907997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:05.907997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:05.907997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:05.907997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:05.907997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:05.907997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:05.907997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:05.907997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:05.907997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:05.908816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:05.908816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:05.908816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:05.908816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:05.908816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:05.908816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:05.908816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:05.908816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:05.908816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:05.908816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:05.908816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 19:11:05.908816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:05.908816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 240/479] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 20 19:11:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:05.914408 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5d525-7d60-4cd7-b604-6273fefef67c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:06.027296 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c5d525-7d60-4cd7-b604-6273fefef67c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:06.063047 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c36ab-b6ea-48fc-9c60-b636896a7762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:06.063642 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c36ab-b6ea-48fc-9c60-b636896a7762 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:06.063929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c36ab-b6ea-48fc-9c60-b636896a7762 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:06.064267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c36ab-b6ea-48fc-9c60-b636896a7762 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:06.065034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c36ab-b6ea-48fc-9c60-b636896a7762 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:06.065395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c36ab-b6ea-48fc-9c60-b636896a7762 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:06.066857 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c36ab-b6ea-48fc-9c60-b636896a7762 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:06.076445 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 240/480] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:07.536296 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bcd03-b846-4ab1-b881-8ad1f8f51b33 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:07.536829 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bcd03-b846-4ab1-b881-8ad1f8f51b33 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:07.536829 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bcd03-b846-4ab1-b881-8ad1f8f51b33 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:07.539053 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 241/481] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:07.544543 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b77ad-691e-4b46-8710-9f5779365655 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:07.544941 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b77ad-691e-4b46-8710-9f5779365655 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:07.545108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b77ad-691e-4b46-8710-9f5779365655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:07.562179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-006b77ad-691e-4b46-8710-9f5779365655 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:07.563863 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-006b77ad-691e-4b46-8710-9f5779365655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:07.575935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:07.667674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad431ce-2d14-4649-9813-0f1e8f8c10b3 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:07.667994 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad431ce-2d14-4649-9813-0f1e8f8c10b3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:07.668224 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad431ce-2d14-4649-9813-0f1e8f8c10b3 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:07.669892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 242/483] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:07.670014 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 241/483] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:07.674998 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c6fbc-3751-48a9-9f74-23133814c63c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:07.675505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c6fbc-3751-48a9-9f74-23133814c63c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:07.675980 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5c6fbc-3751-48a9-9f74-23133814c63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:07.691640 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b77ad-691e-4b46-8710-9f5779365655 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:07.699226 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8b5c6fbc-3751-48a9-9f74-23133814c63c None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:07.700776 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8b5c6fbc-3751-48a9-9f74-23133814c63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:07.777211 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 243/484] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:07.803129 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b77ad-691e-4b46-8710-9f5779365655 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:07.820189 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c6fbc-3751-48a9-9f74-23133814c63c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:07.862991 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:07.883964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0c04f-80fe-428f-8cdd-0fe2a04b95f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:07.884762 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0c04f-80fe-428f-8cdd-0fe2a04b95f3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:07.885101 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0c04f-80fe-428f-8cdd-0fe2a04b95f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:07.885378 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0c04f-80fe-428f-8cdd-0fe2a04b95f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:07.923149 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0c04f-80fe-428f-8cdd-0fe2a04b95f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:07.940456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8ce0c04f-80fe-428f-8cdd-0fe2a04b95f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:07.940456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:07.940456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:07.940456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:07.940456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:07.940456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:07.940456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:07.940456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:07.940456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:07.940456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:07.940456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:07.940456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:07.940456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:07.940456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:07.940456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:07.940456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:07.941441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:07.941441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:07.941441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:07.941441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:07.941441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:07.941441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:07.941441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:07.941441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:07.941441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:07.941441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:07.941441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:07.941441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:07.941441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:07.941441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:07.941441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:07.941441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:07.942251 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:07.942251 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:07.942251 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:07.942251 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:07.942251 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:07.942251 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:07.942251 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:07.942251 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:07.942251 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:07.942251 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:07.942251 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:07.942251 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:07.942251 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 242/485] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:07.948251 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0c04f-80fe-428f-8cdd-0fe2a04b95f3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:07.958583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5c6fbc-3751-48a9-9f74-23133814c63c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:07.959915 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:08.001713 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec11f1-dd73-4019-bafd-755146c7b40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:08.002935 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec11f1-dd73-4019-bafd-755146c7b40f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:08.003590 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec11f1-dd73-4019-bafd-755146c7b40f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:08.004089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec11f1-dd73-4019-bafd-755146c7b40f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:08.016878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec11f1-dd73-4019-bafd-755146c7b40f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:08.026528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-ceec11f1-dd73-4019-bafd-755146c7b40f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:08.026528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:08.026528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:08.026528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:08.026528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:08.026528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:08.026528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:08.026528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:08.026528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:08.026528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:08.026528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:08.026528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:08.026528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:08.026528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:08.026528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:08.026528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:08.027458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:08.027458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:08.027458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:08.027458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:08.027458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:08.027458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:08.027458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:08.027458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:08.027458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:08.027458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:08.027458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:08.027458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:08.027458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:08.027458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:08.027458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:08.027458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:08.028267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:08.028267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:08.028267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:08.028267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:08.028267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:08.028267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:08.028267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:08.028267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:08.028267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:08.028267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:08.028267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:08.028267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:08.031993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 244/486] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:08.038681 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec11f1-dd73-4019-bafd-755146c7b40f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:08.122741 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0c04f-80fe-428f-8cdd-0fe2a04b95f3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:08.203026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:08.204082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27786976-3165-4a5a-9502-2c9357951ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:08.204768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27786976-3165-4a5a-9502-2c9357951ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:08.205154 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27786976-3165-4a5a-9502-2c9357951ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:08.205328 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27786976-3165-4a5a-9502-2c9357951ab9 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:08.206099 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27786976-3165-4a5a-9502-2c9357951ab9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:08.206730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27786976-3165-4a5a-9502-2c9357951ab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:08.208021 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27786976-3165-4a5a-9502-2c9357951ab9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:08.215913 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec11f1-dd73-4019-bafd-755146c7b40f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:08.239105 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 243/487] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:08.247556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27786976-3165-4a5a-9502-2c9357951ab9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:08.266679 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5563c01-bc6c-4e1d-90ac-09a95bebc7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:08.267723 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5563c01-bc6c-4e1d-90ac-09a95bebc7de None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:08.268214 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5563c01-bc6c-4e1d-90ac-09a95bebc7de None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:08.268696 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5563c01-bc6c-4e1d-90ac-09a95bebc7de None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:08.269665 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5563c01-bc6c-4e1d-90ac-09a95bebc7de None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:08.270339 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5563c01-bc6c-4e1d-90ac-09a95bebc7de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:08.272075 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5563c01-bc6c-4e1d-90ac-09a95bebc7de None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:08.290414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 245/488] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:08.291674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5563c01-bc6c-4e1d-90ac-09a95bebc7de None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:08.403107 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5563c01-bc6c-4e1d-90ac-09a95bebc7de None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:08.447272 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dda9dc-28c0-40dd-9be4-017bfce3d233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:08.448888 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dda9dc-28c0-40dd-9be4-017bfce3d233 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:08.449588 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dda9dc-28c0-40dd-9be4-017bfce3d233 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:08.450068 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dda9dc-28c0-40dd-9be4-017bfce3d233 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:08.464973 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dda9dc-28c0-40dd-9be4-017bfce3d233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:08.468016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dda9dc-28c0-40dd-9be4-017bfce3d233 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:08.494467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-66dda9dc-28c0-40dd-9be4-017bfce3d233 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:08.494467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:08.494467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:08.494467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:08.494467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:08.494467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:08.494467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:08.494467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:08.494467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:08.494467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:08.494467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:08.494467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:08.494467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:08.494467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:08.494467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:08.495401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:08.495401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:08.495401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:08.495401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:08.495401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:08.495401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:08.495401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:08.495401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:08.495401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:08.495401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:08.495401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:08.495401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:08.495401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:08.495401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:08.495401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:08.495401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:08.495401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:08.496282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:08.496282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:08.496282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:08.496282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:08.499303 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 246/489] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:08.501152 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312622c-8520-45f8-91ef-bf0e64d55b2a None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:08.501749 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:08.502187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312622c-8520-45f8-91ef-bf0e64d55b2a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:08.503175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312622c-8520-45f8-91ef-bf0e64d55b2a None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:08.504949 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 247/490] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:08.505924 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312622c-8520-45f8-91ef-bf0e64d55b2a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:08.518532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:08.583635 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27786976-3165-4a5a-9502-2c9357951ab9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:08.634878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa39657-e025-4f59-9cf5-b5096c3675a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:08.636024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa39657-e025-4f59-9cf5-b5096c3675a7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:08.638872 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa39657-e025-4f59-9cf5-b5096c3675a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:08.639476 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa39657-e025-4f59-9cf5-b5096c3675a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:08.663971 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa39657-e025-4f59-9cf5-b5096c3675a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:08.666853 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa39657-e025-4f59-9cf5-b5096c3675a7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:08.698329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-5fa39657-e025-4f59-9cf5-b5096c3675a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:08.698329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:08.698329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:08.698329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:08.698329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:08.698329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:08.698329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:08.698329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:08.698329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:08.698329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:08.698329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:08.698329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:08.698329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:08.698329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:08.698329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:08.699268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:08.699268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:08.699268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:08.699268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:08.699268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:08.699268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:08.699268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:08.699268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:08.699268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:08.699268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:08.699268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:08.699268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:08.699268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:08.699268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:08.699268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:08.699268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:08.699268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:08.700139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:08.700139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:08.700139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:08.700139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:08.700354 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312622c-8520-45f8-91ef-bf0e64d55b2a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:08.702845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 244/491] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 456 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:08.704444 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b6673-24a3-401a-b825-5154c06350f6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:08.705038 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b6673-24a3-401a-b825-5154c06350f6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:08.705518 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b6673-24a3-401a-b825-5154c06350f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:08.722579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-974b6673-24a3-401a-b825-5154c06350f6 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:08.724132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-974b6673-24a3-401a-b825-5154c06350f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:08.744008 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa424a1b-7289-4634-993f-1c075f6605cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:08.744688 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa424a1b-7289-4634-993f-1c075f6605cd None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:08.745011 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa424a1b-7289-4634-993f-1c075f6605cd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:08.745303 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa424a1b-7289-4634-993f-1c075f6605cd None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:08.746037 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa424a1b-7289-4634-993f-1c075f6605cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:08.746421 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa424a1b-7289-4634-993f-1c075f6605cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:08.747831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa424a1b-7289-4634-993f-1c075f6605cd None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:08.762886 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 248/492] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:08.763798 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa424a1b-7289-4634-993f-1c075f6605cd None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:08.798376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 245/493] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:08.799579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b6673-24a3-401a-b825-5154c06350f6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:08.841838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:08.852775 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:08.878643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa424a1b-7289-4634-993f-1c075f6605cd None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:08.905478 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b6673-24a3-401a-b825-5154c06350f6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:08.912899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd63590-cc05-4374-a0c7-481d627c6b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:08.914187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd63590-cc05-4374-a0c7-481d627c6b2c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:08.914447 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd63590-cc05-4374-a0c7-481d627c6b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:08.914725 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd63590-cc05-4374-a0c7-481d627c6b2c None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:08.915471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd63590-cc05-4374-a0c7-481d627c6b2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:08.915777 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd63590-cc05-4374-a0c7-481d627c6b2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:08.917177 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd63590-cc05-4374-a0c7-481d627c6b2c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:08.928822 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 249/494] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:08.930436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381ec93-7aa2-4682-a9b0-9394eeaf6f20 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:08.930725 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381ec93-7aa2-4682-a9b0-9394eeaf6f20 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:08.931005 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381ec93-7aa2-4682-a9b0-9394eeaf6f20 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:08.932353 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 250/495] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:08.937446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe6b6d-2cc6-47b8-9f22-c8e3b47b6a3d None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:08.937732 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe6b6d-2cc6-47b8-9f22-c8e3b47b6a3d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:08.938011 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe6b6d-2cc6-47b8-9f22-c8e3b47b6a3d None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:08.939484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 251/496] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:08.939989 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe6b6d-2cc6-47b8-9f22-c8e3b47b6a3d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:08.943902 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997b992-bbf3-4347-9b3b-b5e66d60f4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:08.944738 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997b992-bbf3-4347-9b3b-b5e66d60f4cb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:08.945023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997b992-bbf3-4347-9b3b-b5e66d60f4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:08.945310 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997b992-bbf3-4347-9b3b-b5e66d60f4cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:08.952915 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997b992-bbf3-4347-9b3b-b5e66d60f4cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:08.954394 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997b992-bbf3-4347-9b3b-b5e66d60f4cb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:08.970708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b997b992-bbf3-4347-9b3b-b5e66d60f4cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:11:08.970708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:08.970708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:08.970708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:08.970708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:08.970708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:08.970708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:08.970708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:08.970708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:08.970708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:08.970708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:08.970708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:08.970708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:08.970708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:08.970708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:08.970708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:08.971726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:08.971726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:08.971726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:08.971726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:08.971726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:08.971726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:08.971726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:08.971726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:08.971726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:08.971726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:08.971726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:08.971726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:08.971726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:08.971726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:08.971726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:08.971726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:08.971726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:08.971726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:08.972639 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:08.972639 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:08.972639 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:08.972639 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:08.972639 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:08.972639 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:08.972639 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:08.972639 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:08.972639 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:11:08.972639 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:08.972639 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 246/497] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jul 20 19:11:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:08.973211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997b992-bbf3-4347-9b3b-b5e66d60f4cb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:09.046220 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe6b6d-2cc6-47b8-9f22-c8e3b47b6a3d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:09.071064 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997b992-bbf3-4347-9b3b-b5e66d60f4cb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:09.071664 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:09.079685 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b964155-274b-4c3f-9d3e-c8f9c7de6ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:09.080235 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:09.080474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b964155-274b-4c3f-9d3e-c8f9c7de6ddf None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:09.080754 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b964155-274b-4c3f-9d3e-c8f9c7de6ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:09.081026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b964155-274b-4c3f-9d3e-c8f9c7de6ddf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:09.092343 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b964155-274b-4c3f-9d3e-c8f9c7de6ddf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:09.100050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-8b964155-274b-4c3f-9d3e-c8f9c7de6ddf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:09.100050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:09.100050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:09.100050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:09.100050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:09.100050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:09.100050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:09.100050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:09.100050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:09.100050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:09.100050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:09.100050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:09.100050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:09.100050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:09.100050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:09.100050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:09.101579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:09.101579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:09.101579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:09.101579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:09.101579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:09.101579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:09.101579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:09.101579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:09.101579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:09.101579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:09.101579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:09.101579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:09.101579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:09.101579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:09.101579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:09.101579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:09.102618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:09.102618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:09.102618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:09.102618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:09.102618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:09.102618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:09.102618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:09.102618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:09.102618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:09.102618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:09.102618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:09.102618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:09.102618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 252/498] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:09.103618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02c3ab-2bd2-46db-9d98-6f47911a7b60 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:09.103618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02c3ab-2bd2-46db-9d98-6f47911a7b60 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:09.103618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02c3ab-2bd2-46db-9d98-6f47911a7b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:09.106838 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e285f-780f-4786-a22c-41c6ad44f759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:09.107633 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e285f-780f-4786-a22c-41c6ad44f759 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:09.107921 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e285f-780f-4786-a22c-41c6ad44f759 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:09.108200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e285f-780f-4786-a22c-41c6ad44f759 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:09.115562 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e285f-780f-4786-a22c-41c6ad44f759 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:09.117126 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e285f-780f-4786-a22c-41c6ad44f759 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:09.119623 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ca02c3ab-2bd2-46db-9d98-6f47911a7b60 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:09.120816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ca02c3ab-2bd2-46db-9d98-6f47911a7b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:09.131681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ab0e285f-780f-4786-a22c-41c6ad44f759 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 19:11:09.131681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:09.131681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:09.131681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:09.131681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:09.131681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:09.131681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:09.131681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:09.131681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:09.131681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:09.131681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:09.131681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:09.131681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:09.131681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:09.131681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:09.131681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:09.132665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:09.132665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:09.132665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:09.132665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:09.132665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:09.132665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:09.132665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:09.132665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:09.132665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:09.132665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:09.132665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:09.132665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:09.132665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:09.132665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:09.132665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:09.132665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:09.132665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:09.132665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:09.133565 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:09.133565 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:09.133565 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:09.133565 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:09.133565 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:09.133565 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:09.133565 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:09.133565 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:09.133565 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 19:11:09.133565 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:09.133565 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 247/499] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:09.134752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636741e4-1fee-4e1d-90ea-4b43ec67c53c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:09.134752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636741e4-1fee-4e1d-90ea-4b43ec67c53c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:09.134752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636741e4-1fee-4e1d-90ea-4b43ec67c53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:09.150763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-636741e4-1fee-4e1d-90ea-4b43ec67c53c None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:09.151970 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-636741e4-1fee-4e1d-90ea-4b43ec67c53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:09.195734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 253/500] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:09.196513 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02c3ab-2bd2-46db-9d98-6f47911a7b60 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:09.237754 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 248/501] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:09.238654 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636741e4-1fee-4e1d-90ea-4b43ec67c53c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:09.303262 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02c3ab-2bd2-46db-9d98-6f47911a7b60 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:09.321422 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:09.336819 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:09.339870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195daec-6894-48d0-901f-081ed5fb4ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:09.340535 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636741e4-1fee-4e1d-90ea-4b43ec67c53c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:09.340663 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195daec-6894-48d0-901f-081ed5fb4ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:09.340825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195daec-6894-48d0-901f-081ed5fb4ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:09.341105 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195daec-6894-48d0-901f-081ed5fb4ca5 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:09.341947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195daec-6894-48d0-901f-081ed5fb4ca5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:09.342260 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195daec-6894-48d0-901f-081ed5fb4ca5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:09.343729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195daec-6894-48d0-901f-081ed5fb4ca5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:09.373861 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44aaf7c-87a9-4268-be68-2e8d8e5148f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:09.374563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44aaf7c-87a9-4268-be68-2e8d8e5148f7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:09.374844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44aaf7c-87a9-4268-be68-2e8d8e5148f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:09.375115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44aaf7c-87a9-4268-be68-2e8d8e5148f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:09.375864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44aaf7c-87a9-4268-be68-2e8d8e5148f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:09.376168 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44aaf7c-87a9-4268-be68-2e8d8e5148f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:09.377537 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44aaf7c-87a9-4268-be68-2e8d8e5148f7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:09.380150 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 254/502] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jul 20 19:11:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:09.381563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195daec-6894-48d0-901f-081ed5fb4ca5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:09.394340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 249/503] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:09.394340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44aaf7c-87a9-4268-be68-2e8d8e5148f7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:09.485752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195daec-6894-48d0-901f-081ed5fb4ca5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:09.501702 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44aaf7c-87a9-4268-be68-2e8d8e5148f7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:09.524763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9604e4-03df-4565-8109-012f8fd9fef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:09.525442 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9604e4-03df-4565-8109-012f8fd9fef2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:09.525724 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9604e4-03df-4565-8109-012f8fd9fef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:09.526001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9604e4-03df-4565-8109-012f8fd9fef2 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:09.526882 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9604e4-03df-4565-8109-012f8fd9fef2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:09.527197 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9604e4-03df-4565-8109-012f8fd9fef2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:09.528754 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9604e4-03df-4565-8109-012f8fd9fef2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:09.538428 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e7d86-868c-4797-8285-5684d4a93686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:09.539306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e7d86-868c-4797-8285-5684d4a93686 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:09.539592 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e7d86-868c-4797-8285-5684d4a93686 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:09.540022 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e7d86-868c-4797-8285-5684d4a93686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:09.547704 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 255/504] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jul 20 19:11:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:09.548376 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9604e4-03df-4565-8109-012f8fd9fef2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:09.551643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e7d86-868c-4797-8285-5684d4a93686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:09.553357 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e7d86-868c-4797-8285-5684d4a93686 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:09.571763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d77e7d86-868c-4797-8285-5684d4a93686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:09.571763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:09.571763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:09.571763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:09.571763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:09.571763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:09.571763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:09.571763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:09.571763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:09.571763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:09.571763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:09.571763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:09.571763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:09.571763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:09.571763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:09.572845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:09.572845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:09.572845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:09.572845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:09.572845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:09.572845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:09.572845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:09.572845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:09.572845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:09.572845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:09.572845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:09.572845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:09.572845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:09.572845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:09.572845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:09.572845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:09.572845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:09.573742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:09.573742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:09.573742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:09.573742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:09.573742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 250/505] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:09.574042 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e7d86-868c-4797-8285-5684d4a93686 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:09.591817 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:09.593012 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:09.668954 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9604e4-03df-4565-8109-012f8fd9fef2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:09.685097 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e7d86-868c-4797-8285-5684d4a93686 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:09.705768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aab35a-4b87-45d5-8c88-06e2a543690c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:09.706604 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aab35a-4b87-45d5-8c88-06e2a543690c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:09.706890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aab35a-4b87-45d5-8c88-06e2a543690c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:09.707165 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aab35a-4b87-45d5-8c88-06e2a543690c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:09.719846 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aab35a-4b87-45d5-8c88-06e2a543690c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:09.721118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c79f2-0880-44f1-9134-3cb7353fefb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:09.721255 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c79f2-0880-44f1-9134-3cb7353fefb2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:09.721448 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c79f2-0880-44f1-9134-3cb7353fefb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:09.721727 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c79f2-0880-44f1-9134-3cb7353fefb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:09.727812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-88aab35a-4b87-45d5-8c88-06e2a543690c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:09.727812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:09.727812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:09.727812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:09.727812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:09.727812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:09.727812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:09.727812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:09.727812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:09.727812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:09.727812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:09.727812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:09.727812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:09.727812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:09.727812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:09.727812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:09.728734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:09.728734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:09.728734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:09.728734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:09.728734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:09.728734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:09.728734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:09.728734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:09.728734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:09.728734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:09.728734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:09.728734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:09.728734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:09.728734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:09.728734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:09.728734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:09.729562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:09.729562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:09.729562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:09.729562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:09.729562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:09.729562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:09.729562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:09.729562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:09.729562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:09.729562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:09.729562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:09.729562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:09.729562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 256/506] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:09.730234 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aab35a-4b87-45d5-8c88-06e2a543690c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:09.794977 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c79f2-0880-44f1-9134-3cb7353fefb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:09.797557 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802c79f2-0880-44f1-9134-3cb7353fefb2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:09.814373 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:09.833405 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:09.840967 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aab35a-4b87-45d5-8c88-06e2a543690c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:09.876093 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe6e64-db91-413c-ab1e-0d819eb444a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:09.876892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe6e64-db91-413c-ab1e-0d819eb444a1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:09.877182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe6e64-db91-413c-ab1e-0d819eb444a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:09.877464 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe6e64-db91-413c-ab1e-0d819eb444a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:09.890455 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe6e64-db91-413c-ab1e-0d819eb444a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:09.891947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe6e64-db91-413c-ab1e-0d819eb444a1 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:09.910207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-bdbe6e64-db91-413c-ab1e-0d819eb444a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:09.910207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:09.910207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:09.910207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:09.910207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:09.910207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:09.910207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:09.910207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:09.910207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:09.910207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:09.910207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:09.910207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:09.910207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:09.910207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:09.910207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:09.911175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:09.911175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:09.911175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:09.911175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:09.911175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:09.911175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:09.911175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:09.911175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:09.911175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:09.911175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:09.911175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:09.911175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:09.911175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:09.911175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:09.911175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:09.911175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:09.911175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:09.912039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:09.912039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:09.912039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:09.912039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:09.912039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 257/507] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:09.912303 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe6e64-db91-413c-ab1e-0d819eb444a1 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:09.923298 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 251/508] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:09.924152 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c79f2-0880-44f1-9134-3cb7353fefb2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:10.024280 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe6e64-db91-413c-ab1e-0d819eb444a1 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:10.041118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c79f2-0880-44f1-9134-3cb7353fefb2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:10.055514 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:10.060826 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1ca66-ae66-46d8-8760-87c60b2a1a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:10.061773 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1ca66-ae66-46d8-8760-87c60b2a1a2a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:10.062058 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1ca66-ae66-46d8-8760-87c60b2a1a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:10.062360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1ca66-ae66-46d8-8760-87c60b2a1a2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:10.079246 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77569e1f-e9fb-4cc6-ae4e-a36aa6f4fb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:10.079914 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77569e1f-e9fb-4cc6-ae4e-a36aa6f4fb43 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:10.080030 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:10.080201 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77569e1f-e9fb-4cc6-ae4e-a36aa6f4fb43 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:10.080485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77569e1f-e9fb-4cc6-ae4e-a36aa6f4fb43 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:10.081229 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77569e1f-e9fb-4cc6-ae4e-a36aa6f4fb43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:10.081519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77569e1f-e9fb-4cc6-ae4e-a36aa6f4fb43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:10.082957 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77569e1f-e9fb-4cc6-ae4e-a36aa6f4fb43 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:10.094681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 252/509] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:10.096093 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77569e1f-e9fb-4cc6-ae4e-a36aa6f4fb43 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:10.149320 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1ca66-ae66-46d8-8760-87c60b2a1a2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:10.151966 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1ca66-ae66-46d8-8760-87c60b2a1a2a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:10.208568 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77569e1f-e9fb-4cc6-ae4e-a36aa6f4fb43 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:10.246953 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06001e-6ccf-482c-a4b4-bdeb3596cc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:10.247623 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06001e-6ccf-482c-a4b4-bdeb3596cc32 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:10.247912 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06001e-6ccf-482c-a4b4-bdeb3596cc32 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:10.248189 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c06001e-6ccf-482c-a4b4-bdeb3596cc32 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:10.248949 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06001e-6ccf-482c-a4b4-bdeb3596cc32 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:10.249258 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06001e-6ccf-482c-a4b4-bdeb3596cc32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:10.250657 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c06001e-6ccf-482c-a4b4-bdeb3596cc32 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:10.259383 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 253/510] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:10.260213 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06001e-6ccf-482c-a4b4-bdeb3596cc32 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:10.292816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 258/511] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:10.293683 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1ca66-ae66-46d8-8760-87c60b2a1a2a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:10.305905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:10.348314 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:10.375698 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c06001e-6ccf-482c-a4b4-bdeb3596cc32 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:10.401541 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1ca66-ae66-46d8-8760-87c60b2a1a2a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:10.408458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d059cd9-287f-470a-afe7-af2104addbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:10.409355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d059cd9-287f-470a-afe7-af2104addbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:10.409635 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d059cd9-287f-470a-afe7-af2104addbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:10.409911 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d059cd9-287f-470a-afe7-af2104addbb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:10.410660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d059cd9-287f-470a-afe7-af2104addbb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:10.410966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d059cd9-287f-470a-afe7-af2104addbb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:10.412451 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d059cd9-287f-470a-afe7-af2104addbb4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:10.424729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 254/512] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:10.425544 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d059cd9-287f-470a-afe7-af2104addbb4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:10.439610 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb048ac-73d1-4d06-815f-7e5800d2f4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:10.440400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb048ac-73d1-4d06-815f-7e5800d2f4cf None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:10.440688 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb048ac-73d1-4d06-815f-7e5800d2f4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:10.440969 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb048ac-73d1-4d06-815f-7e5800d2f4cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:10.451138 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb048ac-73d1-4d06-815f-7e5800d2f4cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:10.452603 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb048ac-73d1-4d06-815f-7e5800d2f4cf None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:10.470193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-bcb048ac-73d1-4d06-815f-7e5800d2f4cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:10.470193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:10.470193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:10.470193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:10.470193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:10.470193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:10.470193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:10.470193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:10.470193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:10.470193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:10.470193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:10.470193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:10.470193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:10.470193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:10.470193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:10.471102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:10.471102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:10.471102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:10.471102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:10.471102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:10.471102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:10.471102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:10.471102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:10.471102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:10.471102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:10.471102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:10.471102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:10.471102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:10.471102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:10.471102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:10.471102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:10.471102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:10.477658 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:10.477658 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:10.477658 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:10.477658 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:10.477658 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 259/513] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:10.477658 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb048ac-73d1-4d06-815f-7e5800d2f4cf None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:10.515075 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:10.522420 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d059cd9-287f-470a-afe7-af2104addbb4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:10.558961 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ece09f-9e08-4712-975c-550013cc68b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:10.559562 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ece09f-9e08-4712-975c-550013cc68b3 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:10.559850 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ece09f-9e08-4712-975c-550013cc68b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:10.560129 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ece09f-9e08-4712-975c-550013cc68b3 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:10.560843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ece09f-9e08-4712-975c-550013cc68b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:10.562318 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ece09f-9e08-4712-975c-550013cc68b3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:10.570227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:10.574554 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb048ac-73d1-4d06-815f-7e5800d2f4cf None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:10.593825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 255/514] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 20 19:11:10 2022] POST /identity/v3/users => generated 247 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:11:10.594694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ece09f-9e08-4712-975c-550013cc68b3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:10.614130 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf1445-8618-4a64-8158-dea6ba30f830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:10.615332 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf1445-8618-4a64-8158-dea6ba30f830 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:10.615807 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf1445-8618-4a64-8158-dea6ba30f830 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:10.616083 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf1445-8618-4a64-8158-dea6ba30f830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:10.629222 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf1445-8618-4a64-8158-dea6ba30f830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:10.630869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf1445-8618-4a64-8158-dea6ba30f830 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:10.650881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-1cdf1445-8618-4a64-8158-dea6ba30f830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:10.650881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:10.650881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:10.650881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:10.650881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:10.650881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:10.650881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:10.650881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:10.650881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:10.650881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:10.650881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:10.650881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:10.650881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:10.650881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:10.650881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:10.651866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:10.651866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:10.651866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:10.651866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:10.651866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:10.651866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:10.651866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:10.651866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:10.651866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:10.651866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:10.651866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:10.651866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:10.651866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:10.651866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:10.651866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:10.651866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:10.651866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:10.652766 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:10.652766 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:10.652766 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:10.652766 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:10.652766 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 260/515] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:10.653043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf1445-8618-4a64-8158-dea6ba30f830 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:10.721592 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ece09f-9e08-4712-975c-550013cc68b3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:10.760330 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2d4bc-b690-47df-afb7-e6f828d6cdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:10.761132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2d4bc-b690-47df-afb7-e6f828d6cdc7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:10.761419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2d4bc-b690-47df-afb7-e6f828d6cdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:10.761695 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2d4bc-b690-47df-afb7-e6f828d6cdc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:10.765241 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf1445-8618-4a64-8158-dea6ba30f830 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:10.773626 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2d4bc-b690-47df-afb7-e6f828d6cdc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:10.775157 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2d4bc-b690-47df-afb7-e6f828d6cdc7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:10.794029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-0ee2d4bc-b690-47df-afb7-e6f828d6cdc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:10.794029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:10.794029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:10.794029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:10.794029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:10.794029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:10.794029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:10.794029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:10.794029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:10.794029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:10.794029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:10.794029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:10.794029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:10.794029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:10.794029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:10.794947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:10.794947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:10.794947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:10.794947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:10.794947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:10.794947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:10.794947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:10.794947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:10.794947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:10.794947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:10.794947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:10.794947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:10.794947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:10.794947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:10.794947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:10.794947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:10.794947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:10.795808 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:10.795808 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:10.795808 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:10.795808 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:10.795808 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 256/516] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:10.797264 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2d4bc-b690-47df-afb7-e6f828d6cdc7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:10.799636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:10.804590 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfafa2-51c8-4e0e-af78-2ea3305c717e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:10.805392 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfafa2-51c8-4e0e-af78-2ea3305c717e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:10.805675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfafa2-51c8-4e0e-af78-2ea3305c717e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:10.805945 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfafa2-51c8-4e0e-af78-2ea3305c717e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:10.814696 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfafa2-51c8-4e0e-af78-2ea3305c717e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:10.816080 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfafa2-51c8-4e0e-af78-2ea3305c717e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:10.833595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-37bfafa2-51c8-4e0e-af78-2ea3305c717e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:11:10.833595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:10.833595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:10.833595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:10.833595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:10.833595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:10.833595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:10.833595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:10.833595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:10.833595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:10.833595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:10.833595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:10.833595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:10.833595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:10.833595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:10.833595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:10.834619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:10.834619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:10.834619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:10.834619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:10.834619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:10.834619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:10.834619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:10.834619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:10.834619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:10.834619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:10.834619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:10.834619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:10.834619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:10.834619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:10.834619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:10.834619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:10.834619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:10.834619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:10.836089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:10.836089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:10.836089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:10.836089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:10.836089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:10.836089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:10.836089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:10.836089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:10.836089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:11:10.836089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:10.836089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 261/517] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:10.836679 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfafa2-51c8-4e0e-af78-2ea3305c717e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:10.852043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:10.912422 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2d4bc-b690-47df-afb7-e6f828d6cdc7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:10.943251 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfafa2-51c8-4e0e-af78-2ea3305c717e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:10.948957 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccdde5-8f6f-4c23-8306-ba507f29125f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:10.949827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccdde5-8f6f-4c23-8306-ba507f29125f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:10.950248 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccdde5-8f6f-4c23-8306-ba507f29125f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:10.950678 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccdde5-8f6f-4c23-8306-ba507f29125f None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:10.951583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccdde5-8f6f-4c23-8306-ba507f29125f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:10.952156 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccdde5-8f6f-4c23-8306-ba507f29125f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:10.953792 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccdde5-8f6f-4c23-8306-ba507f29125f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:10.967560 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 257/518] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:10.969492 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccdde5-8f6f-4c23-8306-ba507f29125f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:10.985085 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b398c7-1586-4d9f-af8c-970f0b96ff18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:10.985749 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b398c7-1586-4d9f-af8c-970f0b96ff18 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:10.986028 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b398c7-1586-4d9f-af8c-970f0b96ff18 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:10.986324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b398c7-1586-4d9f-af8c-970f0b96ff18 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:10.987040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b398c7-1586-4d9f-af8c-970f0b96ff18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:10.987346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b398c7-1586-4d9f-af8c-970f0b96ff18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:10.988727 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b398c7-1586-4d9f-af8c-970f0b96ff18 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:11.000056 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 262/519] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:11.000866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b398c7-1586-4d9f-af8c-970f0b96ff18 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:11.043459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:11.078262 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:11.086534 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccdde5-8f6f-4c23-8306-ba507f29125f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:11.119183 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b398c7-1586-4d9f-af8c-970f0b96ff18 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:11.123574 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511d6be-8d82-48ed-8eda-227cbef4ad38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:11.124240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511d6be-8d82-48ed-8eda-227cbef4ad38 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:11.124520 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511d6be-8d82-48ed-8eda-227cbef4ad38 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:11.124792 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511d6be-8d82-48ed-8eda-227cbef4ad38 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:11.125510 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511d6be-8d82-48ed-8eda-227cbef4ad38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:11.125814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511d6be-8d82-48ed-8eda-227cbef4ad38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:11.127201 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511d6be-8d82-48ed-8eda-227cbef4ad38 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:11.144161 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 258/520] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:11.144161 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511d6be-8d82-48ed-8eda-227cbef4ad38 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:11.160562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada4b3b-00c0-4df7-8a08-3962430422ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:11.161340 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada4b3b-00c0-4df7-8a08-3962430422ea None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:11.161631 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada4b3b-00c0-4df7-8a08-3962430422ea None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:11.161911 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada4b3b-00c0-4df7-8a08-3962430422ea None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:11.162791 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada4b3b-00c0-4df7-8a08-3962430422ea None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:11.163104 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada4b3b-00c0-4df7-8a08-3962430422ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:11.164588 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada4b3b-00c0-4df7-8a08-3962430422ea None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:11.187613 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 263/521] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jul 20 19:11:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:11.187613 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada4b3b-00c0-4df7-8a08-3962430422ea None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:11.250618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511d6be-8d82-48ed-8eda-227cbef4ad38 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:11.274589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:11.287320 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80080005-c358-404e-8460-6b92bd2bc74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:11.288120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80080005-c358-404e-8460-6b92bd2bc74f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:11.288445 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80080005-c358-404e-8460-6b92bd2bc74f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:11.288730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80080005-c358-404e-8460-6b92bd2bc74f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:11.294411 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada4b3b-00c0-4df7-8a08-3962430422ea None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:11.295630 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80080005-c358-404e-8460-6b92bd2bc74f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:11.297090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80080005-c358-404e-8460-6b92bd2bc74f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:11.312582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-80080005-c358-404e-8460-6b92bd2bc74f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:11.312582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:11.312582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:11.312582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:11.312582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:11.312582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:11.312582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:11.312582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:11.312582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:11.312582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:11.312582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:11.312582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:11.312582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:11.312582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:11.312582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:11.313663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:11.313663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:11.313663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:11.313663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:11.313663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:11.313663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:11.313663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:11.313663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:11.313663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:11.313663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:11.313663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:11.313663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:11.313663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:11.313663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:11.313663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:11.313663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:11.313663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:11.314729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:11.314729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:11.314729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:11.314729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:11.314729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:11.314729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:11.314729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:11.314729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:11.314729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 259/522] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:11.314729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80080005-c358-404e-8460-6b92bd2bc74f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:11.327596 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:11.336870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3b755-c6e5-4cf7-9cbf-eb408aba5354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:11.337667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3b755-c6e5-4cf7-9cbf-eb408aba5354 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:11.337954 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3b755-c6e5-4cf7-9cbf-eb408aba5354 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:11.338342 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3b755-c6e5-4cf7-9cbf-eb408aba5354 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:11.346171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3b755-c6e5-4cf7-9cbf-eb408aba5354 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:11.347760 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3b755-c6e5-4cf7-9cbf-eb408aba5354 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:11.362646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-fee3b755-c6e5-4cf7-9cbf-eb408aba5354 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 19:11:11.362646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:11.362646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:11.362646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:11.362646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:11.362646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:11.362646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:11.362646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:11.362646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:11.362646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:11.362646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:11.362646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:11.362646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:11.362646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:11.362646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:11.362646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:11.363747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:11.363747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:11.363747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:11.363747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:11.363747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:11.363747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:11.363747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:11.363747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:11.363747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:11.363747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:11.363747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:11.363747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:11.363747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:11.363747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:11.363747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:11.363747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:11.363747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:11.363747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:11.365137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:11.365137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:11.365137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:11.365137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:11.365137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:11.365137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:11.365137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:11.365137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:11.365137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 19:11:11.365137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:11.365137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 264/523] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:11.365137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3b755-c6e5-4cf7-9cbf-eb408aba5354 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:11.435593 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80080005-c358-404e-8460-6b92bd2bc74f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:11.470504 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3b755-c6e5-4cf7-9cbf-eb408aba5354 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:11.473864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e71c1-7fa0-4e0f-b5cd-3904bc5066c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:11.474959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e71c1-7fa0-4e0f-b5cd-3904bc5066c0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:11.475312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e71c1-7fa0-4e0f-b5cd-3904bc5066c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:11.475753 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e71c1-7fa0-4e0f-b5cd-3904bc5066c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:11.484378 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e71c1-7fa0-4e0f-b5cd-3904bc5066c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:11.486687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e71c1-7fa0-4e0f-b5cd-3904bc5066c0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:11.505076 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26e7ca-6958-4dd3-a1b8-7cc90e3030aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:11.505516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-804e71c1-7fa0-4e0f-b5cd-3904bc5066c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:11.505516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:11.505516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:11.505516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:11.505516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:11.505516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:11.505516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:11.505516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:11.505516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:11.505516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:11.505516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:11.505516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:11.505516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:11.505516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:11.505516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:11.506667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:11.506667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:11.506667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:11.506667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:11.506667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:11.506667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:11.506667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:11.506667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:11.506667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:11.506667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:11.506667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:11.506667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:11.506667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:11.506667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:11.506667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:11.506667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:11.506667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:11.508660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:11.508660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:11.508660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:11.508660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:11.508660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:11.508660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:11.508660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:11.508660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:11.509422 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26e7ca-6958-4dd3-a1b8-7cc90e3030aa None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:11.509422 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26e7ca-6958-4dd3-a1b8-7cc90e3030aa None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:11.509422 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26e7ca-6958-4dd3-a1b8-7cc90e3030aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:11.509646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 260/524] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:11.510857 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e71c1-7fa0-4e0f-b5cd-3904bc5066c0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:11.557294 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:11.570696 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:11.587501 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26e7ca-6958-4dd3-a1b8-7cc90e3030aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:11.588918 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26e7ca-6958-4dd3-a1b8-7cc90e3030aa None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:11.627091 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e71c1-7fa0-4e0f-b5cd-3904bc5066c0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:11.662961 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9e138-e5c8-4531-89e6-df8d9cca1f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:11.664129 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9e138-e5c8-4531-89e6-df8d9cca1f23 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:11.664422 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9e138-e5c8-4531-89e6-df8d9cca1f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:11.664691 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9e138-e5c8-4531-89e6-df8d9cca1f23 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:11.665476 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9e138-e5c8-4531-89e6-df8d9cca1f23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:11.665782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9e138-e5c8-4531-89e6-df8d9cca1f23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:11.667243 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9e138-e5c8-4531-89e6-df8d9cca1f23 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:11.686352 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 261/525] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:11.686352 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9e138-e5c8-4531-89e6-df8d9cca1f23 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:11.707837 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 265/526] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:11.708932 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26e7ca-6958-4dd3-a1b8-7cc90e3030aa None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:11.799626 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9e138-e5c8-4531-89e6-df8d9cca1f23 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:11.801254 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:11.806750 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:11.820671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26e7ca-6958-4dd3-a1b8-7cc90e3030aa None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:11.837170 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d0a28-06d1-47b5-8a72-1735206a901f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:11.837978 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d0a28-06d1-47b5-8a72-1735206a901f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:11.838314 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d0a28-06d1-47b5-8a72-1735206a901f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:11.838609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d0a28-06d1-47b5-8a72-1735206a901f None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:11.839456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d0a28-06d1-47b5-8a72-1735206a901f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:11.839771 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d0a28-06d1-47b5-8a72-1735206a901f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:11.841209 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d0a28-06d1-47b5-8a72-1735206a901f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:11.858151 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716656fb-eb34-47c0-a2fd-8cfbf0076c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:11.859140 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716656fb-eb34-47c0-a2fd-8cfbf0076c8b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:11.859598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716656fb-eb34-47c0-a2fd-8cfbf0076c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:11.860021 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716656fb-eb34-47c0-a2fd-8cfbf0076c8b None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:11.861012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716656fb-eb34-47c0-a2fd-8cfbf0076c8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:11.861466 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716656fb-eb34-47c0-a2fd-8cfbf0076c8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:11.863069 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716656fb-eb34-47c0-a2fd-8cfbf0076c8b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:11.880245 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 262/527] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Jul 20 19:11:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:11.881686 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d0a28-06d1-47b5-8a72-1735206a901f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:11.893388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 266/528] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:11.897469 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716656fb-eb34-47c0-a2fd-8cfbf0076c8b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:12.002666 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d0a28-06d1-47b5-8a72-1735206a901f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:12.005651 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716656fb-eb34-47c0-a2fd-8cfbf0076c8b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:12.038036 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a6b66-d6ae-4bfb-8ece-85c272eba438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:12.039355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a6b66-d6ae-4bfb-8ece-85c272eba438 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:12.039691 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a6b66-d6ae-4bfb-8ece-85c272eba438 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:12.039903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a6b66-d6ae-4bfb-8ece-85c272eba438 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:12.040813 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a6b66-d6ae-4bfb-8ece-85c272eba438 None admin] RBAC: Adding query filter params (role.id=3e2d1ff906b74bec9c7410e3a3ec9448, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=a1f0f6bc94de4645a8c82038ff2bd34a) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:12.041223 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a6b66-d6ae-4bfb-8ece-85c272eba438 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:12.042012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886a06c-484e-41b0-af40-9679491dc137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:12.042669 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a6b66-d6ae-4bfb-8ece-85c272eba438 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:12.042829 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886a06c-484e-41b0-af40-9679491dc137 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:12.043095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886a06c-484e-41b0-af40-9679491dc137 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:12.043364 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886a06c-484e-41b0-af40-9679491dc137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:12.058516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 263/529] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:11 2022] GET /identity/v3/role_assignments?user.id=a1f0f6bc94de4645a8c82038ff2bd34a&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=3e2d1ff906b74bec9c7410e3a3ec9448 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:12.058516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a6b66-d6ae-4bfb-8ece-85c272eba438 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:12.063666 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886a06c-484e-41b0-af40-9679491dc137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:12.065179 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886a06c-484e-41b0-af40-9679491dc137 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:12.078352 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:12.089451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-d886a06c-484e-41b0-af40-9679491dc137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:12.089451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:12.089451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:12.089451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:12.089451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:12.089451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:12.089451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:12.089451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:12.089451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:12.089451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:12.089451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:12.089451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:12.089451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:12.089451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:12.089451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:12.090404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:12.090404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:12.090404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:12.090404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:12.090404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:12.090404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:12.090404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:12.090404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:12.090404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:12.090404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:12.090404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:12.090404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:12.090404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:12.090404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:12.090404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:12.090404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:12.090404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:12.091269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:12.091269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:12.091269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:12.091269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:12.091269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 267/530] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:12.092073 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886a06c-484e-41b0-af40-9679491dc137 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:12.110713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:12.192094 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a6b66-d6ae-4bfb-8ece-85c272eba438 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:12.234480 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d92cb-68aa-46ba-a4f5-10ab6d2f9174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:12.235301 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d92cb-68aa-46ba-a4f5-10ab6d2f9174 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:12.235685 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d92cb-68aa-46ba-a4f5-10ab6d2f9174 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:12.236056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d92cb-68aa-46ba-a4f5-10ab6d2f9174 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:12.252391 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886a06c-484e-41b0-af40-9679491dc137 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:12.301086 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a3d94-c993-45f0-b509-cf5b542f3013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:12.302126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a3d94-c993-45f0-b509-cf5b542f3013 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:12.302737 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a3d94-c993-45f0-b509-cf5b542f3013 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:12.303183 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a3d94-c993-45f0-b509-cf5b542f3013 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:12.304236 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a3d94-c993-45f0-b509-cf5b542f3013 None admin] RBAC: Adding query filter params (role.id=3e2d1ff906b74bec9c7410e3a3ec9448, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=36f646c526a044e8b5b6e74aa64cf6e9) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:12.305266 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a3d94-c993-45f0-b509-cf5b542f3013 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:12.307190 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a3d94-c993-45f0-b509-cf5b542f3013 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:12.322654 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 268/531] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:12 2022] GET /identity/v3/role_assignments?user.id=36f646c526a044e8b5b6e74aa64cf6e9&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=3e2d1ff906b74bec9c7410e3a3ec9448 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:12.322654 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a3d94-c993-45f0-b509-cf5b542f3013 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:12.328768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d92cb-68aa-46ba-a4f5-10ab6d2f9174 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:12.330669 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d92cb-68aa-46ba-a4f5-10ab6d2f9174 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:12.380118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:12.457631 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:12.521422 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 264/532] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:12.530343 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a3d94-c993-45f0-b509-cf5b542f3013 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:12.531702 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d92cb-68aa-46ba-a4f5-10ab6d2f9174 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:12.587701 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c58b7-da86-4dde-bb9a-ebdc42188d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:12.588519 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c58b7-da86-4dde-bb9a-ebdc42188d5d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:12.588804 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c58b7-da86-4dde-bb9a-ebdc42188d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:12.589080 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c58b7-da86-4dde-bb9a-ebdc42188d5d None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:12.589871 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c58b7-da86-4dde-bb9a-ebdc42188d5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:12.590180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c58b7-da86-4dde-bb9a-ebdc42188d5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:12.591794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c58b7-da86-4dde-bb9a-ebdc42188d5d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:12.607234 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 269/533] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:12.612888 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c58b7-da86-4dde-bb9a-ebdc42188d5d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:12.727759 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c58b7-da86-4dde-bb9a-ebdc42188d5d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:12.752443 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d92cb-68aa-46ba-a4f5-10ab6d2f9174 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:12.754906 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:12.767468 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a8fba-9949-43e2-81f3-4dd57fd7d331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:12.769325 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a8fba-9949-43e2-81f3-4dd57fd7d331 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:12.769877 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a8fba-9949-43e2-81f3-4dd57fd7d331 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:12.770539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a8fba-9949-43e2-81f3-4dd57fd7d331 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:12.780498 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a8fba-9949-43e2-81f3-4dd57fd7d331 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:12.782541 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a8fba-9949-43e2-81f3-4dd57fd7d331 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:12.792817 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:12.804751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-ff6a8fba-9949-43e2-81f3-4dd57fd7d331 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:12.804751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:12.804751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:12.804751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:12.804751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:12.804751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:12.804751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:12.804751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:12.804751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:12.804751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:12.804751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:12.804751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:12.804751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:12.804751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:12.804751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:12.805652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:12.805652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:12.805652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:12.805652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:12.805652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:12.805652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:12.805652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:12.805652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:12.805652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:12.805652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:12.805652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:12.805652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:12.805652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:12.805652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:12.805652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:12.805652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:12.805652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:12.806562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:12.806562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:12.806562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:12.806562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:12.806562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:12.806562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:12.806562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:12.806562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:12.808488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36dfba-fc93-4b6f-a7cc-c720bf6615be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:12.809388 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36dfba-fc93-4b6f-a7cc-c720bf6615be None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:12.809795 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36dfba-fc93-4b6f-a7cc-c720bf6615be None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:12.810261 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36dfba-fc93-4b6f-a7cc-c720bf6615be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:12.810511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 270/534] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:12.819496 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a8fba-9949-43e2-81f3-4dd57fd7d331 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:12.838407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36dfba-fc93-4b6f-a7cc-c720bf6615be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:12.840586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36dfba-fc93-4b6f-a7cc-c720bf6615be None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:12.867809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-bc36dfba-fc93-4b6f-a7cc-c720bf6615be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:12.867809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:12.867809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:12.867809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:12.867809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:12.867809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:12.867809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:12.867809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:12.867809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:12.867809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:12.867809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:12.867809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:12.867809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:12.867809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:12.867809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:12.868831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:12.868831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:12.868831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:12.868831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:12.868831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:12.868831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:12.868831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:12.868831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:12.868831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:12.868831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:12.868831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:12.868831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:12.868831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:12.868831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:12.868831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:12.868831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:12.868831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:12.869707 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:12.869707 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:12.869707 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:12.869707 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:12.869707 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 265/535] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:12.874681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e03c8-9a23-4048-a193-906e6cf421e5 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:12.874978 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e03c8-9a23-4048-a193-906e6cf421e5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:12.875260 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e03c8-9a23-4048-a193-906e6cf421e5 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:12.876815 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 266/536] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:12.877994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e03c8-9a23-4048-a193-906e6cf421e5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:12.975874 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a8fba-9949-43e2-81f3-4dd57fd7d331 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:12.990465 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e03c8-9a23-4048-a193-906e6cf421e5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:13.018690 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548091a5-e8cf-4735-9d7e-b30473e2e61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:13.019358 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548091a5-e8cf-4735-9d7e-b30473e2e61b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:13.019801 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548091a5-e8cf-4735-9d7e-b30473e2e61b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:13.020087 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548091a5-e8cf-4735-9d7e-b30473e2e61b None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:13.021408 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548091a5-e8cf-4735-9d7e-b30473e2e61b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:13.021846 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548091a5-e8cf-4735-9d7e-b30473e2e61b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:13.023968 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548091a5-e8cf-4735-9d7e-b30473e2e61b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:13.031689 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efebe64-1942-4b4e-98ca-7de88db09ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:13.032957 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efebe64-1942-4b4e-98ca-7de88db09ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:13.033339 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efebe64-1942-4b4e-98ca-7de88db09ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:13.033777 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efebe64-1942-4b4e-98ca-7de88db09ef2 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:13.035306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efebe64-1942-4b4e-98ca-7de88db09ef2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:13.035719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efebe64-1942-4b4e-98ca-7de88db09ef2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:13.037458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efebe64-1942-4b4e-98ca-7de88db09ef2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:13.039028 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 271/537] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:13.040424 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0279d-1226-490d-8d75-bb302ca790e2 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:13.040720 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0279d-1226-490d-8d75-bb302ca790e2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:13.041053 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0279d-1226-490d-8d75-bb302ca790e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:13.058972 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 267/538] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:13.059813 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efebe64-1942-4b4e-98ca-7de88db09ef2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:13.068406 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4dc0279d-1226-490d-8d75-bb302ca790e2 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:13.070633 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4dc0279d-1226-490d-8d75-bb302ca790e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:13.101464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:13.128838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:13.165069 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 272/539] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:13.166215 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0279d-1226-490d-8d75-bb302ca790e2 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:13.202493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efebe64-1942-4b4e-98ca-7de88db09ef2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:13.239906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54792fed-34bc-40d3-9c5c-9c97a892a2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:13.240768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54792fed-34bc-40d3-9c5c-9c97a892a2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:13.241115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54792fed-34bc-40d3-9c5c-9c97a892a2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:13.241548 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54792fed-34bc-40d3-9c5c-9c97a892a2d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:13.242518 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54792fed-34bc-40d3-9c5c-9c97a892a2d6 None admin] RBAC: Adding query filter params (role.id=3e2d1ff906b74bec9c7410e3a3ec9448, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=bd4ce33a2a1248c6a3199265f40e86f4) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:13.242931 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54792fed-34bc-40d3-9c5c-9c97a892a2d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:13.244469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54792fed-34bc-40d3-9c5c-9c97a892a2d6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:13.258341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 268/540] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:13 2022] GET /identity/v3/role_assignments?user.id=bd4ce33a2a1248c6a3199265f40e86f4&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=3e2d1ff906b74bec9c7410e3a3ec9448 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:13.258341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54792fed-34bc-40d3-9c5c-9c97a892a2d6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:13.315384 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0279d-1226-490d-8d75-bb302ca790e2 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:13.363335 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf4fab-7510-424d-a59a-bb37b1b1846b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:13.365137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf4fab-7510-424d-a59a-bb37b1b1846b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:13.365635 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf4fab-7510-424d-a59a-bb37b1b1846b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:13.366106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf4fab-7510-424d-a59a-bb37b1b1846b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:13.375137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf4fab-7510-424d-a59a-bb37b1b1846b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:13.377313 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf4fab-7510-424d-a59a-bb37b1b1846b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:13.394956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-2dcf4fab-7510-424d-a59a-bb37b1b1846b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:13.394956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:13.394956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:13.394956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:13.394956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:13.394956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:13.394956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:13.394956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:13.394956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:13.394956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:13.394956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:13.394956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:13.394956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:13.394956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:13.394956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:13.395901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:13.395901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:13.395901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:13.395901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:13.395901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:13.395901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:13.395901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:13.395901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:13.395901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:13.395901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:13.395901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:13.395901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:13.395901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:13.395901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:13.395901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:13.395901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:13.395901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:13.396758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:13.396758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:13.396758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:13.396758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:13.396758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:13.396758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:13.396758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:13.396758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:13.400112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 273/541] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:13.406140 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf4fab-7510-424d-a59a-bb37b1b1846b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:13.447999 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:13.502620 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:13.508047 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54792fed-34bc-40d3-9c5c-9c97a892a2d6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:13.524831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf4fab-7510-424d-a59a-bb37b1b1846b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:13.551684 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b6729-fd17-429d-bd33-4235045e6999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:13.551684 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b6729-fd17-429d-bd33-4235045e6999 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:13.552966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b6729-fd17-429d-bd33-4235045e6999 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:13.553250 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b6729-fd17-429d-bd33-4235045e6999 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:13.578568 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b6729-fd17-429d-bd33-4235045e6999 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:13.586577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-338b6729-fd17-429d-bd33-4235045e6999 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:13.586577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:13.586577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:13.586577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:13.586577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:13.586577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:13.586577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:13.586577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:13.586577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:13.586577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:13.586577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:13.586577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:13.586577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:13.586577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:13.586577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:13.586577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:13.587460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:13.587460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:13.587460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:13.587460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:13.587460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:13.587460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:13.587460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:13.587460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:13.587460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:13.587460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:13.587460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:13.587460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:13.587460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:13.587460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:13.587460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:13.587460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:13.588261 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:13.588261 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:13.588261 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:13.588261 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:13.588261 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:13.588261 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:13.588261 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:13.588261 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:13.588261 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:13.588261 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:13.588261 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:13.588261 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:13.588261 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 269/542] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:13.593418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b6729-fd17-429d-bd33-4235045e6999 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:13.595087 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87a091-b65c-46e1-a0f8-989541289f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:13.595772 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87a091-b65c-46e1-a0f8-989541289f28 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:13.596059 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87a091-b65c-46e1-a0f8-989541289f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:13.596334 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87a091-b65c-46e1-a0f8-989541289f28 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:13.597135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87a091-b65c-46e1-a0f8-989541289f28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:13.597446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87a091-b65c-46e1-a0f8-989541289f28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:13.598933 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87a091-b65c-46e1-a0f8-989541289f28 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:13.620366 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 274/543] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:13.626476 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87a091-b65c-46e1-a0f8-989541289f28 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:13.827527 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b6729-fd17-429d-bd33-4235045e6999 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:13.844530 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:13.869616 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa6f7b-906f-497f-a993-789658a85de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:13.870687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa6f7b-906f-497f-a993-789658a85de4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:13.871329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa6f7b-906f-497f-a993-789658a85de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:13.871939 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa6f7b-906f-497f-a993-789658a85de4 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:13.872892 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa6f7b-906f-497f-a993-789658a85de4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:13.873394 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa6f7b-906f-497f-a993-789658a85de4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:13.875001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa6f7b-906f-497f-a993-789658a85de4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:13.876286 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87a091-b65c-46e1-a0f8-989541289f28 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:13.885949 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 270/544] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:13.891883 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa6f7b-906f-497f-a993-789658a85de4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:13.939039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:13.955058 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53b053-c21e-4b74-a303-9a974e36a7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:13.955873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53b053-c21e-4b74-a303-9a974e36a7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:13.956257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53b053-c21e-4b74-a303-9a974e36a7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:13.956632 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53b053-c21e-4b74-a303-9a974e36a7c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:13.957568 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53b053-c21e-4b74-a303-9a974e36a7c8 None admin] RBAC: Adding query filter params (role.id=3e2d1ff906b74bec9c7410e3a3ec9448, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=0c7b88e083d04718bf19d982724babd9) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:13.958001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53b053-c21e-4b74-a303-9a974e36a7c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:13.959560 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53b053-c21e-4b74-a303-9a974e36a7c8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:13.965993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 275/545] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:13 2022] GET /identity/v3/role_assignments?user.id=0c7b88e083d04718bf19d982724babd9&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=3e2d1ff906b74bec9c7410e3a3ec9448 => generated 259 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:14.059200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa6f7b-906f-497f-a993-789658a85de4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:14.110833 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1fe16-94a9-4ef7-b144-2f099eab2a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:14.112006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1fe16-94a9-4ef7-b144-2f099eab2a80 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:14.112502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1fe16-94a9-4ef7-b144-2f099eab2a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:14.112934 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1fe16-94a9-4ef7-b144-2f099eab2a80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:14.126400 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1fe16-94a9-4ef7-b144-2f099eab2a80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:14.128090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1fe16-94a9-4ef7-b144-2f099eab2a80 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:14.147231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8af1fe16-94a9-4ef7-b144-2f099eab2a80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:14.147231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:14.147231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:14.147231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:14.147231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:14.147231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:14.147231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:14.147231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:14.147231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:14.147231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:14.147231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:14.147231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:14.147231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:14.147231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:14.147231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:14.148859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:14.148859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:14.148859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:14.148859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:14.148859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:14.148859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:14.148859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:14.148859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:14.148859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:14.148859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:14.148859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:14.148859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:14.148859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:14.148859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:14.148859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:14.148859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:14.148859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:14.149744 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:14.149744 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:14.149744 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:14.149744 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:14.151667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 271/546] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:14.159701 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53b053-c21e-4b74-a303-9a974e36a7c8 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:14.296071 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53b053-c21e-4b74-a303-9a974e36a7c8 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:14.335907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e7648-1481-4d27-bf27-8bba49371bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:14.337020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e7648-1481-4d27-bf27-8bba49371bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:14.337511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e7648-1481-4d27-bf27-8bba49371bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:14.337979 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e7648-1481-4d27-bf27-8bba49371bd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:14.338928 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e7648-1481-4d27-bf27-8bba49371bd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:14.339432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e7648-1481-4d27-bf27-8bba49371bd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:14.341034 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e7648-1481-4d27-bf27-8bba49371bd3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:14.361429 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 276/547] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:14.368285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1fe16-94a9-4ef7-b144-2f099eab2a80 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:14.404640 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a91968-1b28-491c-82b8-aebd24b3a850 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:14.405268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a91968-1b28-491c-82b8-aebd24b3a850 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:14.405767 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a91968-1b28-491c-82b8-aebd24b3a850 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:14.407713 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 277/548] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:11:14.414370 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afab90-63be-4e09-a39a-0be9014b2c18 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:14.414910 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afab90-63be-4e09-a39a-0be9014b2c18 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:14.415446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62afab90-63be-4e09-a39a-0be9014b2c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:14.442445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-62afab90-63be-4e09-a39a-0be9014b2c18 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:14.446504 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-62afab90-63be-4e09-a39a-0be9014b2c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:14.476577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:14.501590 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:14.531934 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1fe16-94a9-4ef7-b144-2f099eab2a80 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:14.584745 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fcab1-045f-45ab-9dad-c48f16764d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:14.586112 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fcab1-045f-45ab-9dad-c48f16764d4f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:14.586414 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fcab1-045f-45ab-9dad-c48f16764d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:14.586687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858fcab1-045f-45ab-9dad-c48f16764d4f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:14.588429 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 278/549] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:11:14.597346 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858fcab1-045f-45ab-9dad-c48f16764d4f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:14.599261 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858fcab1-045f-45ab-9dad-c48f16764d4f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:14.626562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62afab90-63be-4e09-a39a-0be9014b2c18 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:14.635563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-858fcab1-045f-45ab-9dad-c48f16764d4f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:11:14.635563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:14.635563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:14.635563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:14.635563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:14.635563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:14.635563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:14.635563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:14.635563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:14.635563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:14.635563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:14.635563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:14.635563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:14.635563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:14.635563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:14.635563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:14.637001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:14.637001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:14.637001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:14.637001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:14.637001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:14.637001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:14.637001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:14.637001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:14.637001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:14.637001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:14.637001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:14.637001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:14.637001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:14.637001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:14.637001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:14.637001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:14.637001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:14.637001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:14.638068 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:14.638068 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:14.638068 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:14.638068 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:14.638068 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:14.638068 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:14.638068 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:14.638068 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:14.638068 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:11:14.638068 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:14.640542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 272/550] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:11:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:14.646318 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fcab1-045f-45ab-9dad-c48f16764d4f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:14.769199 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62afab90-63be-4e09-a39a-0be9014b2c18 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:14.785853 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858fcab1-045f-45ab-9dad-c48f16764d4f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:14.807852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d7b21-301e-4357-8b3c-0746c711fcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:14.809006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d7b21-301e-4357-8b3c-0746c711fcfc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:14.809505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d7b21-301e-4357-8b3c-0746c711fcfc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:14.810132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d7b21-301e-4357-8b3c-0746c711fcfc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:14.821358 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d7b21-301e-4357-8b3c-0746c711fcfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:14.829409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-b15d7b21-301e-4357-8b3c-0746c711fcfc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:14.829409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:14.829409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:14.829409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:14.829409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:14.829409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:14.829409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:14.829409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:14.829409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:14.829409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:14.829409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:14.829409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:14.829409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:14.829409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:14.829409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:14.829409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:14.830738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:14.830738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:14.830738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:14.830738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:14.830738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:14.830738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:14.830738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:14.830738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:14.830738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:14.830738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:14.830738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:14.830738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:14.830738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:14.830738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:14.830738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:14.830738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:14.831776 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:14.831776 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:14.831776 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:14.831776 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:14.831776 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:14.831776 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:14.831776 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:14.831776 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:14.831776 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:14.831776 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:14.831776 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:14.831776 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:14.832427 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c0c79-9d1c-411a-b9c6-ce00dd104507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:14.832427 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0c79-9d1c-411a-b9c6-ce00dd104507 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:14.832427 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0c79-9d1c-411a-b9c6-ce00dd104507 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:14.832969 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c0c79-9d1c-411a-b9c6-ce00dd104507 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:14.833567 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c0c79-9d1c-411a-b9c6-ce00dd104507 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:14.833740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c0c79-9d1c-411a-b9c6-ce00dd104507 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:14.835742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c0c79-9d1c-411a-b9c6-ce00dd104507 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:14.837373 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:14.841467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 279/551] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:14.843006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339e5bb-4e84-416b-ad2b-ce2ee66c9fdd None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:14.843392 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339e5bb-4e84-416b-ad2b-ce2ee66c9fdd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:14.843817 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339e5bb-4e84-416b-ad2b-ce2ee66c9fdd None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:14.845493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 280/552] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:14.846282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339e5bb-4e84-416b-ad2b-ce2ee66c9fdd None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:14.859166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:14.860898 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 273/553] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jul 20 19:11:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:14.863197 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40525a0-6820-4e5e-bca5-15c6db69a6eb None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:14.863656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40525a0-6820-4e5e-bca5-15c6db69a6eb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:14.864074 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40525a0-6820-4e5e-bca5-15c6db69a6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:14.885527 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f40525a0-6820-4e5e-bca5-15c6db69a6eb None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:14.887018 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f40525a0-6820-4e5e-bca5-15c6db69a6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:14.959765 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339e5bb-4e84-416b-ad2b-ce2ee66c9fdd None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:14.974589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 274/554] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:14.975822 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40525a0-6820-4e5e-bca5-15c6db69a6eb None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:14.996724 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd82435-169c-4875-bae8-536ce75c47cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:14.997437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd82435-169c-4875-bae8-536ce75c47cb None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:14.997816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd82435-169c-4875-bae8-536ce75c47cb None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:14.998182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd82435-169c-4875-bae8-536ce75c47cb None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:14.999068 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd82435-169c-4875-bae8-536ce75c47cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:14.999498 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd82435-169c-4875-bae8-536ce75c47cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:15.000940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd82435-169c-4875-bae8-536ce75c47cb None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:15.010427 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 281/555] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:15.015876 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd82435-169c-4875-bae8-536ce75c47cb None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:15.086918 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:15.087552 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40525a0-6820-4e5e-bca5-15c6db69a6eb None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:15.111418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:15.121321 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd82435-169c-4875-bae8-536ce75c47cb None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:15.125391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9a530-d286-43aa-89a7-547a81189230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:15.126210 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9a530-d286-43aa-89a7-547a81189230 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:15.126655 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9a530-d286-43aa-89a7-547a81189230 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:15.127099 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9a530-d286-43aa-89a7-547a81189230 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:15.159469 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a198de1-cb60-4aa1-99ed-f3870228e1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:15.160290 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a198de1-cb60-4aa1-99ed-f3870228e1fe None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:15.160840 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a198de1-cb60-4aa1-99ed-f3870228e1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:15.161066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a198de1-cb60-4aa1-99ed-f3870228e1fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:15.172050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a198de1-cb60-4aa1-99ed-f3870228e1fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:15.180412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-1a198de1-cb60-4aa1-99ed-f3870228e1fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:15.180412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:15.180412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:15.180412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:15.180412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:15.180412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:15.180412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:15.180412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:15.180412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:15.180412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:15.180412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:15.180412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:15.180412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:15.180412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:15.180412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:15.180412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:15.181551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:15.181551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:15.181551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:15.181551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:15.181551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:15.181551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:15.181551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:15.181551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:15.181551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:15.181551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:15.181551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:15.181551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:15.181551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:15.181551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:15.181551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:15.181551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:15.182617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:15.182617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:15.182617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:15.182617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:15.182617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:15.182617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:15.182617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:15.182617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:15.182617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:15.182617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:15.182617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:15.182617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:15.184746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 282/556] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:15.185649 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a198de1-cb60-4aa1-99ed-f3870228e1fe None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:15.205046 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9a530-d286-43aa-89a7-547a81189230 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:15.206856 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9a530-d286-43aa-89a7-547a81189230 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:15.293171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a198de1-cb60-4aa1-99ed-f3870228e1fe None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:15.312048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 275/557] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:15.313116 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9a530-d286-43aa-89a7-547a81189230 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:15.326121 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:15.333742 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436ef19-a93e-45e6-90cb-dcf48567b80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:15.334819 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436ef19-a93e-45e6-90cb-dcf48567b80d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:15.335221 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436ef19-a93e-45e6-90cb-dcf48567b80d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:15.335598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436ef19-a93e-45e6-90cb-dcf48567b80d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:15.342388 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:15.351442 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436ef19-a93e-45e6-90cb-dcf48567b80d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:15.353090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436ef19-a93e-45e6-90cb-dcf48567b80d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:15.372576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-c436ef19-a93e-45e6-90cb-dcf48567b80d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:15.372576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:15.372576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:15.372576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:15.372576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:15.372576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:15.372576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:15.372576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:15.372576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:15.372576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:15.372576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:15.372576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:15.372576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:15.372576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:15.372576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:15.374198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:15.374198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:15.374198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:15.374198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:15.374198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:15.374198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:15.374198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:15.374198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:15.374198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:15.374198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:15.374198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:15.374198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:15.374198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:15.374198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:15.374198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:15.374198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:15.374198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:15.375347 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:15.375347 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:15.375347 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:15.375347 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:15.380949 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 283/558] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:15.381987 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436ef19-a93e-45e6-90cb-dcf48567b80d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:15.437991 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9a530-d286-43aa-89a7-547a81189230 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:15.483331 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b7b51-b974-4b21-8803-bb07bd82f982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:15.484621 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b7b51-b974-4b21-8803-bb07bd82f982 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:15.485014 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b7b51-b974-4b21-8803-bb07bd82f982 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:15.485386 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b7b51-b974-4b21-8803-bb07bd82f982 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:15.486520 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b7b51-b974-4b21-8803-bb07bd82f982 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:15.486929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b7b51-b974-4b21-8803-bb07bd82f982 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:15.489092 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b7b51-b974-4b21-8803-bb07bd82f982 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:15.501245 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 276/559] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:15.502213 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b7b51-b974-4b21-8803-bb07bd82f982 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:15.507743 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436ef19-a93e-45e6-90cb-dcf48567b80d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:15.554696 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e7131-bc6f-4b18-a2eb-ac703504e341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:15.556162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e7131-bc6f-4b18-a2eb-ac703504e341 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:15.556162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e7131-bc6f-4b18-a2eb-ac703504e341 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:15.556362 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e7131-bc6f-4b18-a2eb-ac703504e341 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:15.567617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e7131-bc6f-4b18-a2eb-ac703504e341 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:15.569274 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e7131-bc6f-4b18-a2eb-ac703504e341 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:15.592257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-558e7131-bc6f-4b18-a2eb-ac703504e341 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:15.592257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:15.592257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:15.592257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:15.592257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:15.592257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:15.592257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:15.592257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:15.592257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:15.592257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:15.592257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:15.592257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:15.592257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:15.592257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:15.592257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:15.593264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:15.593264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:15.593264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:15.593264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:15.593264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:15.593264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:15.593264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:15.593264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:15.593264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:15.593264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:15.593264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:15.593264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:15.593264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:15.593264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:15.593264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:15.593264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:15.593264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:15.594162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:15.594162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:15.594162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:15.594162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:15.594162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 284/560] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:15.595174 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e7131-bc6f-4b18-a2eb-ac703504e341 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:15.624789 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:15.640946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:15.648741 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b7b51-b974-4b21-8803-bb07bd82f982 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:15.689067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4628a2-94e6-4eca-8ade-16c23bfe9a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:15.689472 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4628a2-94e6-4eca-8ade-16c23bfe9a3d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:15.689853 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4628a2-94e6-4eca-8ade-16c23bfe9a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:15.690229 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4628a2-94e6-4eca-8ade-16c23bfe9a3d None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:15.691465 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4628a2-94e6-4eca-8ade-16c23bfe9a3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:15.691875 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4628a2-94e6-4eca-8ade-16c23bfe9a3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:15.693343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4628a2-94e6-4eca-8ade-16c23bfe9a3d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:15.710686 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 277/561] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:15.711687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4628a2-94e6-4eca-8ade-16c23bfe9a3d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:15.732287 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e7131-bc6f-4b18-a2eb-ac703504e341 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:15.779181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a731596-1c6b-4ce4-9b76-416f173fe7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:15.780891 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a731596-1c6b-4ce4-9b76-416f173fe7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:15.781350 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a731596-1c6b-4ce4-9b76-416f173fe7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:15.781771 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a731596-1c6b-4ce4-9b76-416f173fe7c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:15.797275 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a731596-1c6b-4ce4-9b76-416f173fe7c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:15.799683 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a731596-1c6b-4ce4-9b76-416f173fe7c8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:15.821781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-0a731596-1c6b-4ce4-9b76-416f173fe7c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:15.821781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:15.821781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:15.821781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:15.821781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:15.821781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:15.821781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:15.821781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:15.821781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:15.821781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:15.821781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:15.821781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:15.821781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:15.821781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:15.821781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:15.823002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:15.823002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:15.823002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:15.823002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:15.823002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:15.823002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:15.823002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:15.823002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:15.823002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:15.823002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:15.823002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:15.823002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:15.823002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:15.823002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:15.823002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:15.823002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:15.823002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:15.824110 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:15.824110 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:15.824110 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:15.824110 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:15.825146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4628a2-94e6-4eca-8ade-16c23bfe9a3d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:15.825420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 285/562] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:15.826844 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a731596-1c6b-4ce4-9b76-416f173fe7c8 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:15.863895 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbde847-e509-4a24-9e8f-efef4502e279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:15.864581 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbde847-e509-4a24-9e8f-efef4502e279 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:15.864828 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbde847-e509-4a24-9e8f-efef4502e279 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:15.865099 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbde847-e509-4a24-9e8f-efef4502e279 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:15.865825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbde847-e509-4a24-9e8f-efef4502e279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:15.866192 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbde847-e509-4a24-9e8f-efef4502e279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:15.867691 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbde847-e509-4a24-9e8f-efef4502e279 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:15.879660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 278/563] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:15.880918 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d0b39-b96c-4c0a-a69f-9a9d7947be33 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:15.881204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d0b39-b96c-4c0a-a69f-9a9d7947be33 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:15.881479 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d0b39-b96c-4c0a-a69f-9a9d7947be33 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:15.882910 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 279/564] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:15.883439 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d0b39-b96c-4c0a-a69f-9a9d7947be33 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:15.890205 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:15.928815 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:15.945011 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a731596-1c6b-4ce4-9b76-416f173fe7c8 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:15.980197 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f411e-fc88-401c-8798-8155b6910914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:15.981000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f411e-fc88-401c-8798-8155b6910914 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:15.981278 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f411e-fc88-401c-8798-8155b6910914 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:15.981549 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f411e-fc88-401c-8798-8155b6910914 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:15.990379 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f411e-fc88-401c-8798-8155b6910914 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:15.991901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f411e-fc88-401c-8798-8155b6910914 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:15.995823 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d0b39-b96c-4c0a-a69f-9a9d7947be33 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:16.007508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-b66f411e-fc88-401c-8798-8155b6910914 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:11:16.007508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:16.007508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:16.007508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:16.007508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:16.007508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:16.007508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:16.007508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:16.007508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:16.007508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:16.007508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:16.007508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:16.007508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:16.007508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:16.007508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:16.007508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:16.008508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:16.008508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:16.008508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:16.008508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:16.008508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:16.008508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:16.008508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:16.008508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:16.008508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:16.008508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:16.008508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:16.008508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:16.008508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:16.008508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:16.008508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:16.008508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:16.008508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:16.008508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:16.009441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:16.009441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:16.009441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:16.009441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:16.009441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:16.009441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:16.009441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:16.009441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:16.009441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:11:16.009441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:16.009441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 286/565] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jul 20 19:11:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:16.010052 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f411e-fc88-401c-8798-8155b6910914 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:16.039535 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0959e-b618-4328-bad6-986237112a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:16.040194 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0959e-b618-4328-bad6-986237112a7c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:16.040481 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0959e-b618-4328-bad6-986237112a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:16.040761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0959e-b618-4328-bad6-986237112a7c None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:16.041484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0959e-b618-4328-bad6-986237112a7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:16.041793 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0959e-b618-4328-bad6-986237112a7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:16.043195 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0959e-b618-4328-bad6-986237112a7c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:16.054598 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 280/566] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:16.055649 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be293f54-2f98-4066-82bc-72d1d990a8c2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:16.055938 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be293f54-2f98-4066-82bc-72d1d990a8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:16.056215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be293f54-2f98-4066-82bc-72d1d990a8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:16.072930 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-be293f54-2f98-4066-82bc-72d1d990a8c2 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:16.074131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-be293f54-2f98-4066-82bc-72d1d990a8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:16.131516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f411e-fc88-401c-8798-8155b6910914 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:16.140028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:16.150427 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 281/567] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:16.151266 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be293f54-2f98-4066-82bc-72d1d990a8c2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:16.181238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c57a7-8327-4648-a1ac-28ce47bf5539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:16.182028 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c57a7-8327-4648-a1ac-28ce47bf5539 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:16.182326 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c57a7-8327-4648-a1ac-28ce47bf5539 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:16.182610 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c57a7-8327-4648-a1ac-28ce47bf5539 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:16.192033 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c57a7-8327-4648-a1ac-28ce47bf5539 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:16.194203 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c57a7-8327-4648-a1ac-28ce47bf5539 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:16.214503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-d83c57a7-8327-4648-a1ac-28ce47bf5539 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:16.214503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:16.214503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:16.214503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:16.214503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:16.214503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:16.214503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:16.214503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:16.214503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:16.214503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:16.214503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:16.214503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:16.214503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:16.214503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:16.214503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:16.215579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:16.215579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:16.215579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:16.215579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:16.215579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:16.215579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:16.215579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:16.215579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:16.215579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:16.215579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:16.215579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:16.215579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:16.215579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:16.215579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:16.215579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:16.215579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:16.215579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:16.216713 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:16.216713 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:16.216713 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:16.216713 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:16.216713 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:16.216713 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:16.216713 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:16.216713 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:16.219097 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 287/568] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:16.220174 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c57a7-8327-4648-a1ac-28ce47bf5539 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:16.231600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:16.258068 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be293f54-2f98-4066-82bc-72d1d990a8c2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:16.295505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524285f1-c424-40d8-ba09-6209fb020a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:16.296286 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524285f1-c424-40d8-ba09-6209fb020a70 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:16.296567 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524285f1-c424-40d8-ba09-6209fb020a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:16.296836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524285f1-c424-40d8-ba09-6209fb020a70 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:16.297677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524285f1-c424-40d8-ba09-6209fb020a70 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:16.297982 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524285f1-c424-40d8-ba09-6209fb020a70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:16.299444 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524285f1-c424-40d8-ba09-6209fb020a70 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:16.319950 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 282/569] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jul 20 19:11:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:16.320780 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524285f1-c424-40d8-ba09-6209fb020a70 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:16.340034 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c57a7-8327-4648-a1ac-28ce47bf5539 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:16.375646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:16.376080 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7e082-30a5-44fb-ac37-794d018b9d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:16.376881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7e082-30a5-44fb-ac37-794d018b9d87 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:16.377170 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7e082-30a5-44fb-ac37-794d018b9d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:16.377452 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7e082-30a5-44fb-ac37-794d018b9d87 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:16.385014 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7e082-30a5-44fb-ac37-794d018b9d87 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:16.386493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7e082-30a5-44fb-ac37-794d018b9d87 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:16.401311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-30d7e082-30a5-44fb-ac37-794d018b9d87 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 19:11:16.401311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:16.401311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:16.401311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:16.401311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:16.401311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:16.401311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:16.401311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:16.401311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:16.401311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:16.401311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:16.401311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:16.401311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:16.401311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:16.401311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:16.401311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:16.403346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:16.403346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:16.403346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:16.403346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:16.403346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:16.403346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:16.403346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:16.403346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:16.403346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:16.403346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:16.403346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:16.403346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:16.403346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:16.403346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:16.403346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:16.403346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:16.403346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:16.403346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:16.405112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:16.405112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:16.405112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:16.405112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:16.405112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:16.405112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:16.405112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:16.405112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:16.405112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 19:11:16.405112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:16.405112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 288/570] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:16.405112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7e082-30a5-44fb-ac37-794d018b9d87 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:16.442229 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524285f1-c424-40d8-ba09-6209fb020a70 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:16.471684 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:16.490590 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcaf63-0f15-4324-adff-60528ade8ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:16.491477 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcaf63-0f15-4324-adff-60528ade8ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:16.491755 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcaf63-0f15-4324-adff-60528ade8ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:16.492028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcaf63-0f15-4324-adff-60528ade8ed2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:16.502176 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fcaf63-0f15-4324-adff-60528ade8ed2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:16.510082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c6fcaf63-0f15-4324-adff-60528ade8ed2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:16.510082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:16.510082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:16.510082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:16.510082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:16.510082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:16.510082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:16.510082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:16.510082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:16.510082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:16.510082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:16.510082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:16.510082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:16.510082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:16.510082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:16.510082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:16.511162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:16.511162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:16.511162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:16.511162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:16.511162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:16.511162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:16.511162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:16.511162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:16.511162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:16.511162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:16.511162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:16.511162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:16.511162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:16.511162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:16.511162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:16.511162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:16.512034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:16.512034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:16.512034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:16.512034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:16.512034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:16.512034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:16.512034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:16.512034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:16.512034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:16.512034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:16.512034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:16.512034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:16.512679 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7e082-30a5-44fb-ac37-794d018b9d87 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:16.512755 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 283/571] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:16.512755 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc4850-8b87-4ffd-91dc-c988add320a4 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:16.512755 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc4850-8b87-4ffd-91dc-c988add320a4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:16.513606 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc4850-8b87-4ffd-91dc-c988add320a4 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:16.514640 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 284/572] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:16.514950 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc4850-8b87-4ffd-91dc-c988add320a4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:16.559338 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a203d-0717-46cb-81fa-7f21036e5dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:16.559996 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a203d-0717-46cb-81fa-7f21036e5dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:16.560277 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a203d-0717-46cb-81fa-7f21036e5dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:16.560554 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a203d-0717-46cb-81fa-7f21036e5dc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:16.561333 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a203d-0717-46cb-81fa-7f21036e5dc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:16.561639 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a203d-0717-46cb-81fa-7f21036e5dc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:16.563096 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a203d-0717-46cb-81fa-7f21036e5dc0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:16.576279 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 289/573] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:16.577963 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a203d-0717-46cb-81fa-7f21036e5dc0 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:16.627203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc4850-8b87-4ffd-91dc-c988add320a4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:16.639903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:16.662577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405ada8-42ec-4177-beda-2223d05056af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:16.663906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405ada8-42ec-4177-beda-2223d05056af None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:16.664184 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405ada8-42ec-4177-beda-2223d05056af None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:16.664454 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405ada8-42ec-4177-beda-2223d05056af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:16.674164 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405ada8-42ec-4177-beda-2223d05056af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:16.675635 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405ada8-42ec-4177-beda-2223d05056af None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:16.680786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a203d-0717-46cb-81fa-7f21036e5dc0 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:16.695556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1405ada8-42ec-4177-beda-2223d05056af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:16.695556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:16.695556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:16.695556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:16.695556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:16.695556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:16.695556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:16.695556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:16.695556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:16.695556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:16.695556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:16.695556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:16.695556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:16.695556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:16.695556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:16.696488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:16.696488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:16.696488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:16.696488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:16.696488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:16.696488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:16.696488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:16.696488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:16.696488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:16.696488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:16.696488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:16.696488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:16.696488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:16.696488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:16.696488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:16.696488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:16.696488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:16.697380 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:16.697380 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:16.697380 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:16.697380 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:16.697380 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 285/574] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:16.698052 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405ada8-42ec-4177-beda-2223d05056af None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:16.712822 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:16.723300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e1876-aaaf-4341-871d-c5b06df098d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:16.723913 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e1876-aaaf-4341-871d-c5b06df098d1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:16.724196 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e1876-aaaf-4341-871d-c5b06df098d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:16.724469 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e1876-aaaf-4341-871d-c5b06df098d1 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:16.725343 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e1876-aaaf-4341-871d-c5b06df098d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:16.726179 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e1876-aaaf-4341-871d-c5b06df098d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:16.727648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e1876-aaaf-4341-871d-c5b06df098d1 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:16.744929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 290/575] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jul 20 19:11:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:16.746243 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65a761-fecd-43b6-97b0-048dcb25c6b7 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:16.746561 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65a761-fecd-43b6-97b0-048dcb25c6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:16.746840 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65a761-fecd-43b6-97b0-048dcb25c6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:16.763948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4f65a761-fecd-43b6-97b0-048dcb25c6b7 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:16.765149 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4f65a761-fecd-43b6-97b0-048dcb25c6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:16.805512 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405ada8-42ec-4177-beda-2223d05056af None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:16.846419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed2d6a-0a2f-40bb-8bf0-7e855c5dfe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:16.846681 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 291/576] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:16.847135 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed2d6a-0a2f-40bb-8bf0-7e855c5dfe22 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:16.847420 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed2d6a-0a2f-40bb-8bf0-7e855c5dfe22 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:16.847691 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed2d6a-0a2f-40bb-8bf0-7e855c5dfe22 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:16.848187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65a761-fecd-43b6-97b0-048dcb25c6b7 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:16.848526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed2d6a-0a2f-40bb-8bf0-7e855c5dfe22 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:16.848836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed2d6a-0a2f-40bb-8bf0-7e855c5dfe22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:16.850827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed2d6a-0a2f-40bb-8bf0-7e855c5dfe22 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:16.867631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 286/577] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:16.867631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed2d6a-0a2f-40bb-8bf0-7e855c5dfe22 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:16.896687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:16.953713 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65a761-fecd-43b6-97b0-048dcb25c6b7 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:16.968630 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:16.973065 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed2d6a-0a2f-40bb-8bf0-7e855c5dfe22 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:16.988858 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12591fd9-a66d-4bc4-8cfa-2a3f01fb3b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:16.989449 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12591fd9-a66d-4bc4-8cfa-2a3f01fb3b3c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:16.989839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12591fd9-a66d-4bc4-8cfa-2a3f01fb3b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:16.990119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12591fd9-a66d-4bc4-8cfa-2a3f01fb3b3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:16.991001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12591fd9-a66d-4bc4-8cfa-2a3f01fb3b3c None admin] RBAC: Adding query filter params (role.id=3e2d1ff906b74bec9c7410e3a3ec9448, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=0ebd7c59f0014a3886fa75fb35a40e64) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:16.991344 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12591fd9-a66d-4bc4-8cfa-2a3f01fb3b3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:16.992764 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12591fd9-a66d-4bc4-8cfa-2a3f01fb3b3c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:16.998326 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 292/578] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:16 2022] GET /identity/v3/role_assignments?user.id=0ebd7c59f0014a3886fa75fb35a40e64&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=3e2d1ff906b74bec9c7410e3a3ec9448 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:16.999106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12591fd9-a66d-4bc4-8cfa-2a3f01fb3b3c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:17.014106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda9de7-23c1-4c4d-a62c-9dca240566e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:17.014835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda9de7-23c1-4c4d-a62c-9dca240566e5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:17.015116 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda9de7-23c1-4c4d-a62c-9dca240566e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:17.015392 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda9de7-23c1-4c4d-a62c-9dca240566e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:17.016137 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda9de7-23c1-4c4d-a62c-9dca240566e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:17.016444 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda9de7-23c1-4c4d-a62c-9dca240566e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:17.017853 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda9de7-23c1-4c4d-a62c-9dca240566e5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:17.043561 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 287/579] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:17.044540 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda9de7-23c1-4c4d-a62c-9dca240566e5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:17.124120 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12591fd9-a66d-4bc4-8cfa-2a3f01fb3b3c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:17.139552 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:17.157495 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda9de7-23c1-4c4d-a62c-9dca240566e5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:17.176558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce564437-46bc-4a75-983a-fe606a9c2dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:17.177791 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce564437-46bc-4a75-983a-fe606a9c2dbf None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:17.178075 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce564437-46bc-4a75-983a-fe606a9c2dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:17.178371 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce564437-46bc-4a75-983a-fe606a9c2dbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:17.195253 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce564437-46bc-4a75-983a-fe606a9c2dbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:17.198115 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce564437-46bc-4a75-983a-fe606a9c2dbf None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:17.199455 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02362c69-f04c-46f2-be5f-c0170bd24576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:17.200418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02362c69-f04c-46f2-be5f-c0170bd24576 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:17.200703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02362c69-f04c-46f2-be5f-c0170bd24576 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:17.200983 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02362c69-f04c-46f2-be5f-c0170bd24576 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:17.212491 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02362c69-f04c-46f2-be5f-c0170bd24576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:17.213942 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02362c69-f04c-46f2-be5f-c0170bd24576 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:17.219601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-ce564437-46bc-4a75-983a-fe606a9c2dbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:17.219601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:17.219601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:17.219601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:17.219601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:17.219601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:17.219601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:17.219601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:17.219601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:17.219601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:17.219601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:17.219601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:17.219601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:17.219601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:17.219601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:17.220552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:17.220552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:17.220552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:17.220552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:17.220552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:17.220552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:17.220552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:17.220552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:17.220552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:17.220552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:17.220552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:17.220552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:17.220552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:17.220552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:17.220552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:17.220552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:17.220552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:17.221468 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:17.221468 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:17.221468 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:17.221468 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:17.225564 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 293/580] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:17.226263 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce564437-46bc-4a75-983a-fe606a9c2dbf None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:17.233300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-02362c69-f04c-46f2-be5f-c0170bd24576 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:17.233300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:17.233300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:17.233300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:17.233300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:17.233300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:17.233300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:17.233300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:17.233300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:17.233300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:17.233300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:17.233300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:17.233300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:17.233300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:17.233300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:17.234222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:17.234222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:17.234222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:17.234222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:17.234222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:17.234222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:17.234222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:17.234222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:17.234222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:17.234222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:17.234222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:17.234222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:17.234222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:17.234222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:17.234222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:17.234222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:17.234222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:17.235854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:17.235854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:17.235854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:17.235854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:17.235854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 288/581] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:17.235854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02362c69-f04c-46f2-be5f-c0170bd24576 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:17.264237 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:17.345802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce564437-46bc-4a75-983a-fe606a9c2dbf None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:17.346377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02362c69-f04c-46f2-be5f-c0170bd24576 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:17.382936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfc90d-c273-43e5-97a8-2dd56547bf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:17.383145 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521d785-1f2f-4224-882f-a36c1f1eeb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:17.383734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfc90d-c273-43e5-97a8-2dd56547bf1f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:17.383936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521d785-1f2f-4224-882f-a36c1f1eeb5f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:17.384035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfc90d-c273-43e5-97a8-2dd56547bf1f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:17.384183 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521d785-1f2f-4224-882f-a36c1f1eeb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:17.384275 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfc90d-c273-43e5-97a8-2dd56547bf1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:17.384469 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521d785-1f2f-4224-882f-a36c1f1eeb5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:17.391273 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfc90d-c273-43e5-97a8-2dd56547bf1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:17.392893 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfc90d-c273-43e5-97a8-2dd56547bf1f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:17.394707 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:17.395763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521d785-1f2f-4224-882f-a36c1f1eeb5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:17.404617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-a521d785-1f2f-4224-882f-a36c1f1eeb5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:17.404617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:17.404617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:17.404617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:17.404617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:17.404617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:17.404617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:17.404617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:17.404617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:17.404617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:17.404617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:17.404617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:17.404617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:17.404617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:17.404617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:17.404617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:17.405616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:17.405616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:17.405616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:17.405616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:17.405616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:17.405616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:17.405616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:17.405616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:17.405616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:17.405616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:17.405616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:17.405616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:17.405616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:17.405616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:17.405616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:17.405616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:17.406521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:17.406521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:17.406521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:17.406521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:17.406521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:17.406521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:17.406521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:17.406521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:17.406521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:17.406521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:17.406521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:17.406521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:17.406521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 294/582] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:17.407256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521d785-1f2f-4224-882f-a36c1f1eeb5f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:17.414336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-3ebfc90d-c273-43e5-97a8-2dd56547bf1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:17.414336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:17.414336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:17.414336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:17.414336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:17.414336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:17.414336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:17.414336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:17.414336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:17.414336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:17.414336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:17.414336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:17.414336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:17.414336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:17.414336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:17.415267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:17.415267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:17.415267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:17.415267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:17.415267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:17.415267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:17.415267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:17.415267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:17.415267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:17.415267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:17.415267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:17.415267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:17.415267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:17.415267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:17.415267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:17.415267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:17.415267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:17.416162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:17.416162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:17.416162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:17.416162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:17.416162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:17.416162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:17.416162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:17.416162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:17.419919 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 289/583] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:17.420755 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfc90d-c273-43e5-97a8-2dd56547bf1f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:17.513587 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:17.525887 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521d785-1f2f-4224-882f-a36c1f1eeb5f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:17.527271 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfc90d-c273-43e5-97a8-2dd56547bf1f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:17.564482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20009f8b-028a-422a-8ca3-1f9cdb54b2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:17.565052 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a7d08-53f8-4177-9d3b-95abadf45346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:17.565199 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20009f8b-028a-422a-8ca3-1f9cdb54b2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:17.565411 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20009f8b-028a-422a-8ca3-1f9cdb54b2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:17.565684 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20009f8b-028a-422a-8ca3-1f9cdb54b2d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:17.565785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a7d08-53f8-4177-9d3b-95abadf45346 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:17.565983 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a7d08-53f8-4177-9d3b-95abadf45346 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:17.566258 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a7d08-53f8-4177-9d3b-95abadf45346 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:17.566440 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20009f8b-028a-422a-8ca3-1f9cdb54b2d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:17.566743 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20009f8b-028a-422a-8ca3-1f9cdb54b2d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:17.567014 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a7d08-53f8-4177-9d3b-95abadf45346 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:17.567322 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a7d08-53f8-4177-9d3b-95abadf45346 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:17.568092 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20009f8b-028a-422a-8ca3-1f9cdb54b2d8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:17.568664 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a7d08-53f8-4177-9d3b-95abadf45346 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:17.587702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 295/584] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:17.587833 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 290/585] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:17.587833 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20009f8b-028a-422a-8ca3-1f9cdb54b2d8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:17.588750 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a7d08-53f8-4177-9d3b-95abadf45346 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:17.648250 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:17.694979 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20009f8b-028a-422a-8ca3-1f9cdb54b2d8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:17.695348 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a7d08-53f8-4177-9d3b-95abadf45346 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:17.732156 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23fa7bb-07db-41e7-8909-d5606cc43018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:17.732590 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2b573-1aa1-4290-ad00-3c23456a00b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:17.732855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fa7bb-07db-41e7-8909-d5606cc43018 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:17.733138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fa7bb-07db-41e7-8909-d5606cc43018 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:17.733246 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2b573-1aa1-4290-ad00-3c23456a00b0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:17.733454 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23fa7bb-07db-41e7-8909-d5606cc43018 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:17.733565 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2b573-1aa1-4290-ad00-3c23456a00b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:17.733788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2b573-1aa1-4290-ad00-3c23456a00b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:17.734172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23fa7bb-07db-41e7-8909-d5606cc43018 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:17.734533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23fa7bb-07db-41e7-8909-d5606cc43018 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:17.734646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2b573-1aa1-4290-ad00-3c23456a00b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:17.734852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2b573-1aa1-4290-ad00-3c23456a00b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:17.735929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23fa7bb-07db-41e7-8909-d5606cc43018 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:17.736200 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2b573-1aa1-4290-ad00-3c23456a00b0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:17.749335 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 296/586] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:17.749335 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2b573-1aa1-4290-ad00-3c23456a00b0 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:17.753665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 291/587] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:17.757322 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23fa7bb-07db-41e7-8909-d5606cc43018 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:17.762759 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:17.876938 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23fa7bb-07db-41e7-8909-d5606cc43018 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:17.877726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2b573-1aa1-4290-ad00-3c23456a00b0 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:17.912035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:17.928371 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ba7f9-599e-4979-8206-4f7cc881073b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:17.929256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ba7f9-599e-4979-8206-4f7cc881073b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:17.929536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ba7f9-599e-4979-8206-4f7cc881073b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:17.929865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ba7f9-599e-4979-8206-4f7cc881073b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:17.936951 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ba7f9-599e-4979-8206-4f7cc881073b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:17.938000 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ea44f-510b-4707-b147-23ecc5686a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:17.938456 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ba7f9-599e-4979-8206-4f7cc881073b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:17.938892 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ea44f-510b-4707-b147-23ecc5686a56 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:17.939170 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ea44f-510b-4707-b147-23ecc5686a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:17.939443 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ea44f-510b-4707-b147-23ecc5686a56 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:17.948471 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ea44f-510b-4707-b147-23ecc5686a56 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:17.949986 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ea44f-510b-4707-b147-23ecc5686a56 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:17.954448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-db9ba7f9-599e-4979-8206-4f7cc881073b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:17.954448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:17.954448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:17.954448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:17.954448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:17.954448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:17.954448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:17.954448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:17.954448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:17.954448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:17.954448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:17.954448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:17.954448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:17.954448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:17.954448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:17.955752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:17.955752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:17.955752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:17.955752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:17.955752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:17.955752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:17.955752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:17.955752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:17.955752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:17.955752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:17.955752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:17.955752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:17.955752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:17.955752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:17.955752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:17.955752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:17.955752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:17.956697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:17.956697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:17.956697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:17.956697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:17.956697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:17.956697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:17.956697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:17.956697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:17.956697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 297/588] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:17.957236 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ba7f9-599e-4979-8206-4f7cc881073b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:17.970871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-6a6ea44f-510b-4707-b147-23ecc5686a56 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:11:17.970871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:17.970871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:17.970871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:17.970871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:17.970871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:17.970871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:17.970871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:17.970871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:17.970871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:17.970871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:17.970871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:17.970871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:17.970871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:17.970871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:17.970871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:17.972268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:17.972268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:17.972268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:17.972268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:17.972268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:17.972268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:17.972268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:17.972268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:17.972268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:17.972268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:17.972268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:17.972268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:17.972268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:17.972268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:17.972268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:17.972268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:17.972268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:17.972268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:17.973747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:17.973747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:17.973747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:17.973747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:17.973747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:17.973747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:17.973747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:17.973747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:17.973747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:11:17.973747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:17.973747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 292/589] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:17.973747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ea44f-510b-4707-b147-23ecc5686a56 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:18.040953 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:18.081332 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ba7f9-599e-4979-8206-4f7cc881073b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:18.095904 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ea44f-510b-4707-b147-23ecc5686a56 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:18.128378 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c7920-a79b-456a-997f-32aa391e1c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:18.129094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c7920-a79b-456a-997f-32aa391e1c07 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:18.129385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c7920-a79b-456a-997f-32aa391e1c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:18.129670 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c7920-a79b-456a-997f-32aa391e1c07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:18.137175 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863d8a2-f64b-47f1-9999-212ad8cde5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:18.138841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863d8a2-f64b-47f1-9999-212ad8cde5de None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:18.138841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863d8a2-f64b-47f1-9999-212ad8cde5de None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:18.138841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863d8a2-f64b-47f1-9999-212ad8cde5de None admin] PATH_INFO: `/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/a1f0f6bc94de4645a8c82038ff2bd34a/roles/3e2d1ff906b74bec9c7410e3a3ec9448` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:18.141547 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c7920-a79b-456a-997f-32aa391e1c07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:18.143043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c7920-a79b-456a-997f-32aa391e1c07 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:18.155806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863d8a2-f64b-47f1-9999-212ad8cde5de None admin] RBAC: Authorizing `identity:create_grant(project_id=416a38494ed54934ba8ab0d8e18afb35, user_id=a1f0f6bc94de4645a8c82038ff2bd34a, role_id=3e2d1ff906b74bec9c7410e3a3ec9448)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:18.157252 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863d8a2-f64b-47f1-9999-212ad8cde5de None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:18.164084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-004c7920-a79b-456a-997f-32aa391e1c07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:18.164084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:18.164084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:18.164084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:18.164084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:18.164084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:18.164084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:18.164084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:18.164084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:18.164084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:18.164084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:18.164084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:18.164084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:18.164084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:18.164084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:18.165191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:18.165191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:18.165191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:18.165191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:18.165191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:18.165191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:18.165191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:18.165191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:18.165191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:18.165191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:18.165191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:18.165191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:18.165191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:18.165191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:18.165191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:18.165191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:18.165191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:18.166091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:18.166091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:18.166091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:18.166091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:18.166091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 298/590] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:18.166947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c7920-a79b-456a-997f-32aa391e1c07 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:18.177111 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 293/591] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:11:17 2022] PUT /identity/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/a1f0f6bc94de4645a8c82038ff2bd34a/roles/3e2d1ff906b74bec9c7410e3a3ec9448 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:11:18.187364 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863d8a2-f64b-47f1-9999-212ad8cde5de None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:18.237812 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:18.293531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c7920-a79b-456a-997f-32aa391e1c07 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:18.322511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:18.337047 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9608e-cec4-4104-b49b-a28d814244d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:18.338595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9608e-cec4-4104-b49b-a28d814244d9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:18.339130 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9608e-cec4-4104-b49b-a28d814244d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:18.339430 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9608e-cec4-4104-b49b-a28d814244d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:18.340288 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9608e-cec4-4104-b49b-a28d814244d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:18.340630 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9608e-cec4-4104-b49b-a28d814244d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:18.342164 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9608e-cec4-4104-b49b-a28d814244d9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:18.345935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863d8a2-f64b-47f1-9999-212ad8cde5de None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:18.355400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 299/592] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:18.356296 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9608e-cec4-4104-b49b-a28d814244d9 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:18.389631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e790b16-801b-428f-8b26-a48b8071601d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:18.390234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e790b16-801b-428f-8b26-a48b8071601d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:18.390549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e790b16-801b-428f-8b26-a48b8071601d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:18.390832 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e790b16-801b-428f-8b26-a48b8071601d None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:18.391687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e790b16-801b-428f-8b26-a48b8071601d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:18.392000 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e790b16-801b-428f-8b26-a48b8071601d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:18.393441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e790b16-801b-428f-8b26-a48b8071601d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:18.427971 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 294/593] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jul 20 19:11:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:18.428861 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e790b16-801b-428f-8b26-a48b8071601d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:18.497942 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9608e-cec4-4104-b49b-a28d814244d9 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:18.560870 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:18.567921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323655b7-40f2-4e6c-8bff-92e9b59d14bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:18.569663 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323655b7-40f2-4e6c-8bff-92e9b59d14bb None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:18.570400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323655b7-40f2-4e6c-8bff-92e9b59d14bb None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:18.571477 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323655b7-40f2-4e6c-8bff-92e9b59d14bb None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:18.573527 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323655b7-40f2-4e6c-8bff-92e9b59d14bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:18.574602 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323655b7-40f2-4e6c-8bff-92e9b59d14bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:18.576714 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323655b7-40f2-4e6c-8bff-92e9b59d14bb None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:18.581522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e790b16-801b-428f-8b26-a48b8071601d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:18.602335 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 300/594] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:18.602335 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323655b7-40f2-4e6c-8bff-92e9b59d14bb None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:18.625305 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24732d2a-f39a-4b54-92b5-58fc8179dbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:18.626221 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24732d2a-f39a-4b54-92b5-58fc8179dbdf None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:18.626539 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24732d2a-f39a-4b54-92b5-58fc8179dbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:18.626823 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24732d2a-f39a-4b54-92b5-58fc8179dbdf None admin] PATH_INFO: `/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/36f646c526a044e8b5b6e74aa64cf6e9/roles/3e2d1ff906b74bec9c7410e3a3ec9448` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:18.654040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:18.655112 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24732d2a-f39a-4b54-92b5-58fc8179dbdf None admin] RBAC: Authorizing `identity:create_grant(project_id=416a38494ed54934ba8ab0d8e18afb35, user_id=36f646c526a044e8b5b6e74aa64cf6e9, role_id=3e2d1ff906b74bec9c7410e3a3ec9448)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:18.656937 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24732d2a-f39a-4b54-92b5-58fc8179dbdf None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:18.678849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 295/595] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:11:18 2022] PUT /identity/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/36f646c526a044e8b5b6e74aa64cf6e9/roles/3e2d1ff906b74bec9c7410e3a3ec9448 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:11:18.678849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24732d2a-f39a-4b54-92b5-58fc8179dbdf None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:18.768614 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323655b7-40f2-4e6c-8bff-92e9b59d14bb None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:18.843386 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24732d2a-f39a-4b54-92b5-58fc8179dbdf None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:18.864179 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16374714-dda1-4ae0-9b8a-83ca4501923b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:18.865204 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16374714-dda1-4ae0-9b8a-83ca4501923b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:18.865713 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16374714-dda1-4ae0-9b8a-83ca4501923b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:18.866707 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16374714-dda1-4ae0-9b8a-83ca4501923b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:18.877861 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16374714-dda1-4ae0-9b8a-83ca4501923b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:18.879483 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16374714-dda1-4ae0-9b8a-83ca4501923b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:18.884673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1eaf87-907b-4967-acad-443aca190d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:18.885489 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1eaf87-907b-4967-acad-443aca190d0e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:18.885774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1eaf87-907b-4967-acad-443aca190d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:18.886056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1eaf87-907b-4967-acad-443aca190d0e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:18.888989 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:18.895310 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1eaf87-907b-4967-acad-443aca190d0e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:18.896944 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1eaf87-907b-4967-acad-443aca190d0e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:18.904656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-16374714-dda1-4ae0-9b8a-83ca4501923b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:18.904656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:18.904656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:18.904656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:18.904656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:18.904656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:18.904656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:18.904656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:18.904656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:18.904656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:18.904656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:18.904656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:18.904656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:18.904656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:18.904656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:18.905577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:18.905577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:18.905577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:18.905577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:18.905577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:18.905577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:18.905577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:18.905577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:18.905577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:18.905577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:18.905577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:18.905577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:18.905577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:18.905577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:18.905577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:18.905577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:18.905577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:18.906589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:18.906589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:18.906589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:18.906589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:18.906589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 301/596] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:18.915271 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16374714-dda1-4ae0-9b8a-83ca4501923b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:18.916474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-5c1eaf87-907b-4967-acad-443aca190d0e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 19:11:18.916474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:18.916474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:18.916474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:18.916474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:18.916474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:18.916474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:18.916474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:18.916474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:18.916474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:18.916474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:18.916474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:18.916474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:18.916474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:18.916474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:18.916474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:18.918419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:18.918419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:18.918419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:18.918419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:18.918419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:18.918419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:18.918419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:18.918419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:18.918419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:18.918419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:18.918419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:18.918419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:18.918419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:18.918419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:18.918419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:18.918419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:18.918419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:18.918419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:18.919878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:18.919878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:18.919878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:18.919878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:18.919878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:18.919878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:18.919878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:18.919878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:18.919878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 19:11:18.919878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:18.919878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 296/597] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:18.926323 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1eaf87-907b-4967-acad-443aca190d0e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:19.042139 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:19.051631 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16374714-dda1-4ae0-9b8a-83ca4501923b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:19.094164 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70141c-9481-4504-b4b2-85c1b92638b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:19.095020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70141c-9481-4504-b4b2-85c1b92638b2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:19.095309 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70141c-9481-4504-b4b2-85c1b92638b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:19.095592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70141c-9481-4504-b4b2-85c1b92638b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:19.096592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70141c-9481-4504-b4b2-85c1b92638b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:19.096903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70141c-9481-4504-b4b2-85c1b92638b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:19.098317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70141c-9481-4504-b4b2-85c1b92638b2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:19.113336 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 302/598] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:19.118533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8593f-ed16-479c-9b33-0ddc7b6f7ecb None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:19.118825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8593f-ed16-479c-9b33-0ddc7b6f7ecb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:19.119107 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8593f-ed16-479c-9b33-0ddc7b6f7ecb None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:19.120046 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1eaf87-907b-4967-acad-443aca190d0e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:19.120676 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 303/599] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:11:19.123080 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8593f-ed16-479c-9b33-0ddc7b6f7ecb None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:19.156845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3376dca-7ca7-4ae3-9635-9617a3916ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:19.157432 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3376dca-7ca7-4ae3-9635-9617a3916ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:19.157710 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3376dca-7ca7-4ae3-9635-9617a3916ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:19.157984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3376dca-7ca7-4ae3-9635-9617a3916ff0 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:19.159105 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3376dca-7ca7-4ae3-9635-9617a3916ff0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:19.159409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3376dca-7ca7-4ae3-9635-9617a3916ff0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:19.160861 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3376dca-7ca7-4ae3-9635-9617a3916ff0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:19.180289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 297/600] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Jul 20 19:11:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:19.181658 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c5207-b3a4-4817-9e05-794a31749658 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:19.181946 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c5207-b3a4-4817-9e05-794a31749658 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:19.182221 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c5207-b3a4-4817-9e05-794a31749658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:19.198885 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6a0c5207-b3a4-4817-9e05-794a31749658 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:19.200079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6a0c5207-b3a4-4817-9e05-794a31749658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:19.252384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:19.260630 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8593f-ed16-479c-9b33-0ddc7b6f7ecb None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:19.273175 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 298/601] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:19.274022 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c5207-b3a4-4817-9e05-794a31749658 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:19.315206 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5845747-132a-491c-bbf9-da1197072951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:19.316325 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5845747-132a-491c-bbf9-da1197072951 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:19.317083 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5845747-132a-491c-bbf9-da1197072951 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:19.317374 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5845747-132a-491c-bbf9-da1197072951 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:19.327364 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5845747-132a-491c-bbf9-da1197072951 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:19.329374 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5845747-132a-491c-bbf9-da1197072951 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:19.350892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-e5845747-132a-491c-bbf9-da1197072951 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:19.350892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:19.350892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:19.350892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:19.350892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:19.350892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:19.350892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:19.350892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:19.350892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:19.350892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:19.350892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:19.350892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:19.350892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:19.350892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:19.350892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:19.352268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:19.352268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:19.352268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:19.352268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:19.352268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:19.352268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:19.352268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:19.352268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:19.352268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:19.352268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:19.352268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:19.352268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:19.352268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:19.352268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:19.352268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:19.352268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:19.352268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:19.353416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:19.353416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:19.353416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:19.353416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:19.353416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:19.353416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:19.353416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:19.353416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:19.358335 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 304/602] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:19.358335 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5845747-132a-491c-bbf9-da1197072951 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:19.384362 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:19.412381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c5207-b3a4-4817-9e05-794a31749658 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:19.464586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600869d-5c98-4421-b5d7-56c87d4554e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:19.466148 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600869d-5c98-4421-b5d7-56c87d4554e2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:19.466869 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600869d-5c98-4421-b5d7-56c87d4554e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:19.467320 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600869d-5c98-4421-b5d7-56c87d4554e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:19.483694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600869d-5c98-4421-b5d7-56c87d4554e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:19.485123 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5845747-132a-491c-bbf9-da1197072951 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:19.485713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600869d-5c98-4421-b5d7-56c87d4554e2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:19.511583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-5600869d-5c98-4421-b5d7-56c87d4554e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:19.511583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:19.511583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:19.511583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:19.511583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:19.511583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:19.511583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:19.511583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:19.511583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:19.511583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:19.511583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:19.511583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:19.511583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:19.511583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:19.511583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:19.512786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:19.512786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:19.512786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:19.512786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:19.512786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:19.512786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:19.512786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:19.512786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:19.512786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:19.512786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:19.512786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:19.512786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:19.512786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:19.512786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:19.512786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:19.512786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:19.512786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:19.514011 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:19.514011 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:19.514011 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:19.514011 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:19.521214 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 299/603] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:19.521214 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600869d-5c98-4421-b5d7-56c87d4554e2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:19.535259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24626344-6044-432c-86bf-9df91eafc256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:19.536232 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24626344-6044-432c-86bf-9df91eafc256 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:19.536596 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24626344-6044-432c-86bf-9df91eafc256 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:19.536972 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24626344-6044-432c-86bf-9df91eafc256 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:19.566036 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24626344-6044-432c-86bf-9df91eafc256 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:19.574023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-24626344-6044-432c-86bf-9df91eafc256 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:19.574023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:19.574023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:19.574023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:19.574023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:19.574023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:19.574023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:19.574023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:19.574023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:19.574023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:19.574023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:19.574023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:19.574023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:19.574023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:19.574023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:19.574023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:19.576074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:19.576074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:19.576074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:19.576074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:19.576074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:19.576074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:19.576074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:19.576074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:19.576074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:19.576074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:19.576074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:19.576074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:19.576074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:19.576074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:19.576074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:19.576074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:19.577879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:19.577879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:19.577879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:19.577879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:19.577879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:19.577879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:19.577879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:19.577879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:19.577879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:19.577879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:19.577879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:19.577879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:19.582553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 305/604] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:19.583295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24626344-6044-432c-86bf-9df91eafc256 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:19.605447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:19.670765 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:19.695900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24626344-6044-432c-86bf-9df91eafc256 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:19.726091 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600869d-5c98-4421-b5d7-56c87d4554e2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:19.732088 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573914c-9349-4be5-af98-06680925615b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:19.732976 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573914c-9349-4be5-af98-06680925615b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:19.733357 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573914c-9349-4be5-af98-06680925615b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:19.733730 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573914c-9349-4be5-af98-06680925615b None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:19.734626 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573914c-9349-4be5-af98-06680925615b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:19.735025 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573914c-9349-4be5-af98-06680925615b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:19.736528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573914c-9349-4be5-af98-06680925615b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:19.750340 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 306/605] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:19.750870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573914c-9349-4be5-af98-06680925615b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:19.784887 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79101d9-649d-456f-81d3-6f46498c706d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:19.785695 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79101d9-649d-456f-81d3-6f46498c706d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:19.785981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79101d9-649d-456f-81d3-6f46498c706d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:19.786260 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79101d9-649d-456f-81d3-6f46498c706d None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:19.787082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79101d9-649d-456f-81d3-6f46498c706d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:19.787430 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79101d9-649d-456f-81d3-6f46498c706d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:19.789137 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79101d9-649d-456f-81d3-6f46498c706d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:19.807618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 300/606] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:19.808587 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79101d9-649d-456f-81d3-6f46498c706d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:19.861201 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573914c-9349-4be5-af98-06680925615b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:19.901083 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51651c0e-97b9-450d-a884-3bc6cafa5bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:19.902166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51651c0e-97b9-450d-a884-3bc6cafa5bbb None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:19.902581 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51651c0e-97b9-450d-a884-3bc6cafa5bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:19.902952 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51651c0e-97b9-450d-a884-3bc6cafa5bbb None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:19.904343 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51651c0e-97b9-450d-a884-3bc6cafa5bbb None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:19.904343 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51651c0e-97b9-450d-a884-3bc6cafa5bbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:19.905865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51651c0e-97b9-450d-a884-3bc6cafa5bbb None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:19.908583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:19.915952 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:19.922563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79101d9-649d-456f-81d3-6f46498c706d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:19.923176 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 307/607] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:19.924045 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51651c0e-97b9-450d-a884-3bc6cafa5bbb None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:19.961129 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a00d8-b224-4bc3-870c-a6c1eac003bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:19.962257 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a00d8-b224-4bc3-870c-a6c1eac003bb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:19.962784 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a00d8-b224-4bc3-870c-a6c1eac003bb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:19.963217 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a00d8-b224-4bc3-870c-a6c1eac003bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:19.971242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a00d8-b224-4bc3-870c-a6c1eac003bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:19.973046 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a00d8-b224-4bc3-870c-a6c1eac003bb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:19.988959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a08a00d8-b224-4bc3-870c-a6c1eac003bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:19.988959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:19.988959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:19.988959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:19.988959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:19.988959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:19.988959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:19.988959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:19.988959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:19.988959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:19.988959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:19.988959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:19.988959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:19.988959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:19.988959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:19.990120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:19.990120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:19.990120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:19.990120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:19.990120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:19.990120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:19.990120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:19.990120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:19.990120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:19.990120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:19.990120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:19.990120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:19.990120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:19.990120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:19.990120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:19.990120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:19.990120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:19.991316 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:19.991316 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:19.991316 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:19.991316 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:19.991316 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:19.991316 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:19.991316 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:19.991316 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:19.997989 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 301/608] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:19.999314 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a00d8-b224-4bc3-870c-a6c1eac003bb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:20.035926 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51651c0e-97b9-450d-a884-3bc6cafa5bbb None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:20.073979 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37385886-e85a-42eb-992a-5ae3ef2f5690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:20.075208 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37385886-e85a-42eb-992a-5ae3ef2f5690 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:20.075360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37385886-e85a-42eb-992a-5ae3ef2f5690 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:20.075536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37385886-e85a-42eb-992a-5ae3ef2f5690 None admin] PATH_INFO: `/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/bd4ce33a2a1248c6a3199265f40e86f4/roles/3e2d1ff906b74bec9c7410e3a3ec9448` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:20.092041 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37385886-e85a-42eb-992a-5ae3ef2f5690 None admin] RBAC: Authorizing `identity:create_grant(project_id=416a38494ed54934ba8ab0d8e18afb35, user_id=bd4ce33a2a1248c6a3199265f40e86f4, role_id=3e2d1ff906b74bec9c7410e3a3ec9448)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:20.093587 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37385886-e85a-42eb-992a-5ae3ef2f5690 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:20.114264 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a00d8-b224-4bc3-870c-a6c1eac003bb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:20.116256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 308/609] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:11:19 2022] PUT /identity/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/bd4ce33a2a1248c6a3199265f40e86f4/roles/3e2d1ff906b74bec9c7410e3a3ec9448 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:11:20.123175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37385886-e85a-42eb-992a-5ae3ef2f5690 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:20.154197 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43dae7-0463-4286-9e96-bb251efdcd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:20.155336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43dae7-0463-4286-9e96-bb251efdcd32 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:20.155788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43dae7-0463-4286-9e96-bb251efdcd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:20.156212 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43dae7-0463-4286-9e96-bb251efdcd32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:20.169490 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43dae7-0463-4286-9e96-bb251efdcd32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:20.171271 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43dae7-0463-4286-9e96-bb251efdcd32 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:20.191912 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-7a43dae7-0463-4286-9e96-bb251efdcd32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:20.191912 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:20.191912 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:20.191912 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:20.191912 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:20.191912 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:20.191912 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:20.191912 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:20.191912 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:20.191912 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:20.191912 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:20.191912 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:20.191912 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:20.191912 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:20.191912 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:20.193048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:20.193048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:20.193048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:20.193048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:20.193048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:20.193048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:20.193048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:20.193048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:20.193048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:20.193048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:20.193048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:20.193048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:20.193048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:20.193048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:20.193048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:20.193048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:20.193048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:20.194746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:20.194746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:20.194746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:20.194746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:20.196799 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 302/610] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:20.202187 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43dae7-0463-4286-9e96-bb251efdcd32 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:20.218394 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:20.265133 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:20.345237 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37385886-e85a-42eb-992a-5ae3ef2f5690 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:20.369384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43dae7-0463-4286-9e96-bb251efdcd32 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:20.386459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296555e-060d-471e-a7cc-52faf9cfb7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:20.387461 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296555e-060d-471e-a7cc-52faf9cfb7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:20.388002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296555e-060d-471e-a7cc-52faf9cfb7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:20.388457 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296555e-060d-471e-a7cc-52faf9cfb7d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:20.389495 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296555e-060d-471e-a7cc-52faf9cfb7d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:20.389999 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296555e-060d-471e-a7cc-52faf9cfb7d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:20.391711 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296555e-060d-471e-a7cc-52faf9cfb7d1 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:20.406270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 309/611] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:20.410096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a4aa0-9754-4278-a627-a75f1702aeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:20.410794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a4aa0-9754-4278-a627-a75f1702aeeb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:20.411083 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a4aa0-9754-4278-a627-a75f1702aeeb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:20.411362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a4aa0-9754-4278-a627-a75f1702aeeb None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:20.412100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a4aa0-9754-4278-a627-a75f1702aeeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:20.412411 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a4aa0-9754-4278-a627-a75f1702aeeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:20.412820 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296555e-060d-471e-a7cc-52faf9cfb7d1 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:20.413837 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a4aa0-9754-4278-a627-a75f1702aeeb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:20.430173 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 303/612] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:20.435830 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a4aa0-9754-4278-a627-a75f1702aeeb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:20.543181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296555e-060d-471e-a7cc-52faf9cfb7d1 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:20.556650 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:20.563936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:20.595517 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a4aa0-9754-4278-a627-a75f1702aeeb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:20.605076 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5454f-787f-4c8c-bc4e-382165795b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:20.607372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5454f-787f-4c8c-bc4e-382165795b28 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:20.608686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5454f-787f-4c8c-bc4e-382165795b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:20.609796 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5454f-787f-4c8c-bc4e-382165795b28 None admin] PATH_INFO: `/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/0c7b88e083d04718bf19d982724babd9/roles/3e2d1ff906b74bec9c7410e3a3ec9448` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:20.635638 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65342742-d76e-41fb-993e-f4b713d3c2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:20.636455 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65342742-d76e-41fb-993e-f4b713d3c2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:20.636741 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65342742-d76e-41fb-993e-f4b713d3c2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:20.637020 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65342742-d76e-41fb-993e-f4b713d3c2e5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:20.645600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65342742-d76e-41fb-993e-f4b713d3c2e5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:20.646216 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e5454f-787f-4c8c-bc4e-382165795b28 None admin] RBAC: Authorizing `identity:create_grant(project_id=416a38494ed54934ba8ab0d8e18afb35, user_id=0c7b88e083d04718bf19d982724babd9, role_id=3e2d1ff906b74bec9c7410e3a3ec9448)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:20.647114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65342742-d76e-41fb-993e-f4b713d3c2e5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:20.648261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e5454f-787f-4c8c-bc4e-382165795b28 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:20.664671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-65342742-d76e-41fb-993e-f4b713d3c2e5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:11:20.664671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:20.664671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:20.664671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:20.664671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:20.664671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:20.664671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:20.664671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:20.664671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:20.664671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:20.664671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:20.664671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:20.664671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:20.664671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:20.664671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:20.664671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:20.665900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:20.665900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:20.665900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:20.665900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:20.665900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:20.665900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:20.665900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:20.665900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:20.665900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:20.665900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:20.665900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:20.665900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:20.665900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:20.665900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:20.665900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:20.665900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:20.665900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:20.665900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:20.667030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:20.667030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:20.667030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:20.667030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:20.667030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:20.667030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:20.667030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:20.667030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:20.667030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:11:20.667030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:20.674410 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 304/614] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:11:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:20.674410 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c8c75-b23b-4382-a89b-57f974facd4a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:20.674410 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c8c75-b23b-4382-a89b-57f974facd4a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:20.674410 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c8c75-b23b-4382-a89b-57f974facd4a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:20.675042 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 305/615] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:20.675247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 310/615] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:11:20 2022] PUT /identity/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/0c7b88e083d04718bf19d982724babd9/roles/3e2d1ff906b74bec9c7410e3a3ec9448 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:11:20.675838 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c8c75-b23b-4382-a89b-57f974facd4a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:20.691131 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656f4ba-fb85-4465-8b22-41e3cb39587a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:20.691671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656f4ba-fb85-4465-8b22-41e3cb39587a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:20.692401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656f4ba-fb85-4465-8b22-41e3cb39587a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:20.730429 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4656f4ba-fb85-4465-8b22-41e3cb39587a None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:20.731682 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4656f4ba-fb85-4465-8b22-41e3cb39587a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:20.846264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 311/616] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:11:20.878911 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c8c75-b23b-4382-a89b-57f974facd4a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:20.882554 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656f4ba-fb85-4465-8b22-41e3cb39587a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:20.907894 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:20.918119 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84464dd-9b5c-469b-b793-a60222a8100d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:20.918820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84464dd-9b5c-469b-b793-a60222a8100d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:20.919108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84464dd-9b5c-469b-b793-a60222a8100d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:20.919386 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84464dd-9b5c-469b-b793-a60222a8100d None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:20.920224 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84464dd-9b5c-469b-b793-a60222a8100d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:20.920533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84464dd-9b5c-469b-b793-a60222a8100d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:20.922076 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84464dd-9b5c-469b-b793-a60222a8100d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:20.941420 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 306/617] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jul 20 19:11:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:20.947325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84464dd-9b5c-469b-b793-a60222a8100d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:21.004627 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:21.021021 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656f4ba-fb85-4465-8b22-41e3cb39587a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:21.057745 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84464dd-9b5c-469b-b793-a60222a8100d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:21.065446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02188b7a-7355-4bf2-ad76-0c6c7bc96691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:21.066261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02188b7a-7355-4bf2-ad76-0c6c7bc96691 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:21.067075 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02188b7a-7355-4bf2-ad76-0c6c7bc96691 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:21.067075 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02188b7a-7355-4bf2-ad76-0c6c7bc96691 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:21.078663 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02188b7a-7355-4bf2-ad76-0c6c7bc96691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:21.098064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-02188b7a-7355-4bf2-ad76-0c6c7bc96691 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:21.098064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:21.098064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:21.098064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:21.098064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:21.098064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:21.098064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:21.098064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:21.098064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:21.098064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:21.098064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:21.098064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:21.098064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:21.098064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:21.098064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:21.098064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:21.099101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:21.099101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:21.099101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:21.099101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:21.099101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:21.099101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:21.099101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:21.099101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:21.099101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:21.099101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:21.099101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:21.099101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:21.099101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:21.099101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:21.099101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:21.099101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:21.100247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:21.100247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:21.100247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:21.100247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:21.100247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:21.100247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:21.100247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:21.100247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:21.100247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:21.100247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:21.100247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:21.100247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:21.100247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 312/618] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:21.105844 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02188b7a-7355-4bf2-ad76-0c6c7bc96691 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:21.111179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124340e-60e5-4657-abdc-eb7c1d155e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:21.112309 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124340e-60e5-4657-abdc-eb7c1d155e51 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:21.112764 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124340e-60e5-4657-abdc-eb7c1d155e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:21.113188 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124340e-60e5-4657-abdc-eb7c1d155e51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:21.125151 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124340e-60e5-4657-abdc-eb7c1d155e51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:21.126907 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124340e-60e5-4657-abdc-eb7c1d155e51 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:21.146024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a124340e-60e5-4657-abdc-eb7c1d155e51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:21.146024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:21.146024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:21.146024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:21.146024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:21.146024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:21.146024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:21.146024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:21.146024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:21.146024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:21.146024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:21.146024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:21.146024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:21.146024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:21.146024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:21.147131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:21.147131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:21.147131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:21.147131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:21.147131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:21.147131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:21.147131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:21.147131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:21.147131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:21.147131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:21.147131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:21.147131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:21.147131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:21.147131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:21.147131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:21.147131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:21.147131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:21.148256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:21.148256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:21.148256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:21.148256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:21.150157 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 307/619] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:21.157204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124340e-60e5-4657-abdc-eb7c1d155e51 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:21.206260 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:21.238983 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02188b7a-7355-4bf2-ad76-0c6c7bc96691 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:21.268922 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124340e-60e5-4657-abdc-eb7c1d155e51 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:21.275555 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0de9f2-ad04-4949-9c17-de49e1b7e1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:21.276484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0de9f2-ad04-4949-9c17-de49e1b7e1aa None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:21.276985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0de9f2-ad04-4949-9c17-de49e1b7e1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:21.277447 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0de9f2-ad04-4949-9c17-de49e1b7e1aa None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:21.278412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0de9f2-ad04-4949-9c17-de49e1b7e1aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:21.278905 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0de9f2-ad04-4949-9c17-de49e1b7e1aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:21.280476 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0de9f2-ad04-4949-9c17-de49e1b7e1aa None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:21.294679 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 313/620] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:21.296405 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935bdb2-2a08-4339-a144-8afb285fb892 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:21.296884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935bdb2-2a08-4339-a144-8afb285fb892 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:21.297352 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935bdb2-2a08-4339-a144-8afb285fb892 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:21.299181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 314/621] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:21.300056 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935bdb2-2a08-4339-a144-8afb285fb892 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:21.309906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81294839-56f1-4b09-91ce-e5499ecab1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:21.310607 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81294839-56f1-4b09-91ce-e5499ecab1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:21.310893 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81294839-56f1-4b09-91ce-e5499ecab1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:21.311177 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81294839-56f1-4b09-91ce-e5499ecab1f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:21.311967 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81294839-56f1-4b09-91ce-e5499ecab1f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:21.312279 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81294839-56f1-4b09-91ce-e5499ecab1f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:21.313700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81294839-56f1-4b09-91ce-e5499ecab1f4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:21.318763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:21.326289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 308/622] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:21.327587 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801c1e3-a2e4-4880-bca7-319fd156b981 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:21.327932 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801c1e3-a2e4-4880-bca7-319fd156b981 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:21.328219 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801c1e3-a2e4-4880-bca7-319fd156b981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:21.346083 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5801c1e3-a2e4-4880-bca7-319fd156b981 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:21.347312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5801c1e3-a2e4-4880-bca7-319fd156b981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:21.434269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935bdb2-2a08-4339-a144-8afb285fb892 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:21.434497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 309/623] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:21.435705 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801c1e3-a2e4-4880-bca7-319fd156b981 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:21.472412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b456b06-b43b-4e3d-896a-cbaa2bbc839e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:21.473479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b456b06-b43b-4e3d-896a-cbaa2bbc839e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:21.473794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b456b06-b43b-4e3d-896a-cbaa2bbc839e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:21.474077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b456b06-b43b-4e3d-896a-cbaa2bbc839e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:21.488311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b456b06-b43b-4e3d-896a-cbaa2bbc839e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:21.490146 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b456b06-b43b-4e3d-896a-cbaa2bbc839e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:21.496350 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:21.516166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-3b456b06-b43b-4e3d-896a-cbaa2bbc839e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:21.516166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:21.516166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:21.516166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:21.516166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:21.516166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:21.516166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:21.516166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:21.516166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:21.516166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:21.516166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:21.516166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:21.516166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:21.516166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:21.516166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:21.517163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:21.517163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:21.517163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:21.517163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:21.517163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:21.517163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:21.517163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:21.517163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:21.517163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:21.517163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:21.517163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:21.517163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:21.517163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:21.517163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:21.517163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:21.517163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:21.517163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:21.518069 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:21.518069 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:21.518069 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:21.518069 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:21.518612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 315/624] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:21.519372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b456b06-b43b-4e3d-896a-cbaa2bbc839e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:21.597470 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801c1e3-a2e4-4880-bca7-319fd156b981 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:21.604108 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:21.642062 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e128463-551e-475a-a4e5-b052b10f3eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:21.642916 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e128463-551e-475a-a4e5-b052b10f3eaf None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:21.643189 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e128463-551e-475a-a4e5-b052b10f3eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:21.643899 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e128463-551e-475a-a4e5-b052b10f3eaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:21.653230 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e128463-551e-475a-a4e5-b052b10f3eaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:21.654945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e128463-551e-475a-a4e5-b052b10f3eaf None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:21.672159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-4e128463-551e-475a-a4e5-b052b10f3eaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:21.672159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:21.672159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:21.672159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:21.672159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:21.672159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:21.672159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:21.672159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:21.672159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:21.672159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:21.672159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:21.672159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:21.672159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:21.672159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:21.672159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:21.673805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:21.673805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:21.673805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:21.673805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:21.673805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:21.673805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:21.673805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:21.673805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:21.673805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:21.673805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:21.673805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:21.673805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:21.673805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:21.673805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:21.673805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:21.673805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:21.673805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:21.675407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:21.675407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:21.675407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:21.675407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:21.675407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:21.675407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:21.675407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:21.675407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:21.678662 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 310/625] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:21.680267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e128463-551e-475a-a4e5-b052b10f3eaf None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:21.689795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b456b06-b43b-4e3d-896a-cbaa2bbc839e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:21.735271 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf32b42-46ce-4f32-87b9-aa00df6d5028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:21.736126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf32b42-46ce-4f32-87b9-aa00df6d5028 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:21.736458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf32b42-46ce-4f32-87b9-aa00df6d5028 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:21.736738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf32b42-46ce-4f32-87b9-aa00df6d5028 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:21.752313 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf32b42-46ce-4f32-87b9-aa00df6d5028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:21.763094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-3bf32b42-46ce-4f32-87b9-aa00df6d5028 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:21.763094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:21.763094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:21.763094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:21.763094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:21.763094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:21.763094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:21.763094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:21.763094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:21.763094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:21.763094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:21.763094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:21.763094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:21.763094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:21.763094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:21.763094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:21.764284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:21.764284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:21.764284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:21.764284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:21.764284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:21.764284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:21.764284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:21.764284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:21.764284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:21.764284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:21.764284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:21.764284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:21.764284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:21.764284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:21.764284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:21.764284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:21.765310 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:21.765310 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:21.765310 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:21.765310 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:21.765310 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:21.765310 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:21.765310 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:21.765310 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:21.765310 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:21.765310 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:21.765310 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:21.765310 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:21.765310 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 316/626] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:21.766049 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf32b42-46ce-4f32-87b9-aa00df6d5028 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:21.807549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:21.827319 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e128463-551e-475a-a4e5-b052b10f3eaf None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:21.870029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fc1ce-1825-4620-8eb6-e6fb1f44e1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:21.870814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fc1ce-1825-4620-8eb6-e6fb1f44e1dc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:21.871100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fc1ce-1825-4620-8eb6-e6fb1f44e1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:21.871367 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fc1ce-1825-4620-8eb6-e6fb1f44e1dc None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:21.872268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fc1ce-1825-4620-8eb6-e6fb1f44e1dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:21.872573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fc1ce-1825-4620-8eb6-e6fb1f44e1dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:21.874631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fc1ce-1825-4620-8eb6-e6fb1f44e1dc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:21.890658 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 311/627] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:21.891861 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fc1ce-1825-4620-8eb6-e6fb1f44e1dc None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:21.893696 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf32b42-46ce-4f32-87b9-aa00df6d5028 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:21.919624 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:21.935548 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb6c2c-2b3c-4c3c-92b0-1cd626658462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:21.936741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb6c2c-2b3c-4c3c-92b0-1cd626658462 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:21.937504 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb6c2c-2b3c-4c3c-92b0-1cd626658462 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:21.938226 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb6c2c-2b3c-4c3c-92b0-1cd626658462 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:21.939426 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb6c2c-2b3c-4c3c-92b0-1cd626658462 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:21.939962 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb6c2c-2b3c-4c3c-92b0-1cd626658462 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:21.941946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb6c2c-2b3c-4c3c-92b0-1cd626658462 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:21.962568 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 317/628] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:21.963992 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb6c2c-2b3c-4c3c-92b0-1cd626658462 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:22.030547 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fc1ce-1825-4620-8eb6-e6fb1f44e1dc None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:22.069514 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5521b8-44a5-4298-a369-e7fc68ce7fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:22.070567 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5521b8-44a5-4298-a369-e7fc68ce7fad None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:22.070969 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5521b8-44a5-4298-a369-e7fc68ce7fad None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:22.071383 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5521b8-44a5-4298-a369-e7fc68ce7fad None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:22.072264 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5521b8-44a5-4298-a369-e7fc68ce7fad None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:22.072684 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5521b8-44a5-4298-a369-e7fc68ce7fad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:22.074173 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5521b8-44a5-4298-a369-e7fc68ce7fad None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:22.083825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 312/629] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:22.084887 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5521b8-44a5-4298-a369-e7fc68ce7fad None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:22.098351 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:22.104786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb6c2c-2b3c-4c3c-92b0-1cd626658462 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:22.156997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ceb191-970a-4841-93d8-2e422fdb44f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:22.158442 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceb191-970a-4841-93d8-2e422fdb44f5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:22.159199 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceb191-970a-4841-93d8-2e422fdb44f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:22.159673 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ceb191-970a-4841-93d8-2e422fdb44f5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:22.170840 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ceb191-970a-4841-93d8-2e422fdb44f5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:22.173167 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ceb191-970a-4841-93d8-2e422fdb44f5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:22.196848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-16ceb191-970a-4841-93d8-2e422fdb44f5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:11:22.196848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:22.196848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:22.196848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:22.196848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:22.196848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:22.196848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:22.196848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:22.196848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:22.196848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:22.196848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:22.196848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:22.196848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:22.196848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:22.196848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:22.196848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:22.197875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:22.197875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:22.197875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:22.197875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:22.197875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:22.197875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:22.197875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:22.197875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:22.197875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:22.197875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:22.197875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:22.197875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:22.197875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:22.197875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:22.197875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:22.197875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:22.197875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:22.197875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:22.198893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:22.198893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:22.198893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:22.198893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:22.198893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:22.198893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:22.198893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:22.198893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:22.198893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:11:22.198893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:22.201377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 318/630] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jul 20 19:11:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:22.201377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ceb191-970a-4841-93d8-2e422fdb44f5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:22.213943 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5521b8-44a5-4298-a369-e7fc68ce7fad None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:22.262797 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:22.269617 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd29c5-9705-4357-bfca-dfcbb3823061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:22.270615 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd29c5-9705-4357-bfca-dfcbb3823061 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:22.270911 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd29c5-9705-4357-bfca-dfcbb3823061 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:22.271289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd29c5-9705-4357-bfca-dfcbb3823061 None admin] PATH_INFO: `/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/0ebd7c59f0014a3886fa75fb35a40e64/roles/3e2d1ff906b74bec9c7410e3a3ec9448` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:22.288112 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd29c5-9705-4357-bfca-dfcbb3823061 None admin] RBAC: Authorizing `identity:create_grant(project_id=416a38494ed54934ba8ab0d8e18afb35, user_id=0ebd7c59f0014a3886fa75fb35a40e64, role_id=3e2d1ff906b74bec9c7410e3a3ec9448)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:22.289719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd29c5-9705-4357-bfca-dfcbb3823061 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:22.304650 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 313/631] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:11:22 2022] PUT /identity/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/0ebd7c59f0014a3886fa75fb35a40e64/roles/3e2d1ff906b74bec9c7410e3a3ec9448 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:11:22.305610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd29c5-9705-4357-bfca-dfcbb3823061 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:22.335915 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ceb191-970a-4841-93d8-2e422fdb44f5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:22.374900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:22.422940 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd29c5-9705-4357-bfca-dfcbb3823061 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:22.439148 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89ed18-0383-4c5c-b5f8-a42bfb445fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:22.439972 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89ed18-0383-4c5c-b5f8-a42bfb445fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:22.440255 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89ed18-0383-4c5c-b5f8-a42bfb445fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:22.440532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b89ed18-0383-4c5c-b5f8-a42bfb445fa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:22.462342 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d00bd7-1dce-4efb-8013-4458bc62e761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:22.462981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d00bd7-1dce-4efb-8013-4458bc62e761 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:22.463271 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d00bd7-1dce-4efb-8013-4458bc62e761 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:22.463553 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d00bd7-1dce-4efb-8013-4458bc62e761 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:22.464481 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d00bd7-1dce-4efb-8013-4458bc62e761 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:22.464795 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d00bd7-1dce-4efb-8013-4458bc62e761 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:22.466327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d00bd7-1dce-4efb-8013-4458bc62e761 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:22.476148 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89ed18-0383-4c5c-b5f8-a42bfb445fa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:22.477638 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b89ed18-0383-4c5c-b5f8-a42bfb445fa8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:22.488180 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 314/632] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jul 20 19:11:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:22.499207 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d00bd7-1dce-4efb-8013-4458bc62e761 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:22.508043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-8b89ed18-0383-4c5c-b5f8-a42bfb445fa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:22.508043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:22.508043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:22.508043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:22.508043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:22.508043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:22.508043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:22.508043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:22.508043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:22.508043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:22.508043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:22.508043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:22.508043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:22.508043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:22.508043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:22.508993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:22.508993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:22.508993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:22.508993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:22.508993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:22.508993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:22.508993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:22.508993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:22.508993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:22.508993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:22.508993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:22.508993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:22.508993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:22.508993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:22.508993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:22.508993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:22.508993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:22.509917 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:22.509917 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:22.509917 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:22.509917 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:22.509917 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 319/633] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:22.514947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89ed18-0383-4c5c-b5f8-a42bfb445fa8 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:22.626606 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d00bd7-1dce-4efb-8013-4458bc62e761 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:22.660384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:22.661367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:22.674327 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b89ed18-0383-4c5c-b5f8-a42bfb445fa8 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:22.696564 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bc105-8280-4d9a-8fc6-1c9e5369543d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:22.697149 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bc105-8280-4d9a-8fc6-1c9e5369543d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:22.697479 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bc105-8280-4d9a-8fc6-1c9e5369543d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:22.697759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bc105-8280-4d9a-8fc6-1c9e5369543d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:22.738666 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49646f37-518b-47f5-a6eb-bc1d2e1d7901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:22.739401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49646f37-518b-47f5-a6eb-bc1d2e1d7901 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:22.739701 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49646f37-518b-47f5-a6eb-bc1d2e1d7901 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:22.739957 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49646f37-518b-47f5-a6eb-bc1d2e1d7901 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:22.741109 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49646f37-518b-47f5-a6eb-bc1d2e1d7901 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:22.741555 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49646f37-518b-47f5-a6eb-bc1d2e1d7901 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:22.743288 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49646f37-518b-47f5-a6eb-bc1d2e1d7901 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:22.762427 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 320/634] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:22.767068 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245547aa-6c8e-4554-84a2-c3d95cbdf52a None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:22.767522 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245547aa-6c8e-4554-84a2-c3d95cbdf52a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:22.767808 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245547aa-6c8e-4554-84a2-c3d95cbdf52a None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:22.769423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 321/635] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:22.776641 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245547aa-6c8e-4554-84a2-c3d95cbdf52a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:22.812979 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bc105-8280-4d9a-8fc6-1c9e5369543d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:22.815430 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bc105-8280-4d9a-8fc6-1c9e5369543d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:22.886957 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245547aa-6c8e-4554-84a2-c3d95cbdf52a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:22.922269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b83c7-3cc2-41e1-9d78-d1ff0b588a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:22.923062 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b83c7-3cc2-41e1-9d78-d1ff0b588a5c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:22.923348 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b83c7-3cc2-41e1-9d78-d1ff0b588a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:22.923633 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b83c7-3cc2-41e1-9d78-d1ff0b588a5c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:22.931835 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b83c7-3cc2-41e1-9d78-d1ff0b588a5c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:22.934182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b83c7-3cc2-41e1-9d78-d1ff0b588a5c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:22.941999 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 315/636] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 19:11:22.944327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22d435-f14c-4dfa-9258-2b326986db6e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:22.944831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22d435-f14c-4dfa-9258-2b326986db6e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:22.945332 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22d435-f14c-4dfa-9258-2b326986db6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:22.950169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-dc7b83c7-3cc2-41e1-9d78-d1ff0b588a5c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 19:11:22.950169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:22.950169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:22.950169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:22.950169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:22.950169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:22.950169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:22.950169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:22.950169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:22.950169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:22.950169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:22.950169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:22.950169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:22.950169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:22.950169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:22.950169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:22.951187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:22.951187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:22.951187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:22.951187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:22.951187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:22.951187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:22.951187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:22.951187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:22.951187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:22.951187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:22.951187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:22.951187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:22.951187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:22.951187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:22.951187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:22.951187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:22.951187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:22.951187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:22.952627 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:22.952627 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:22.952627 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:22.952627 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:22.952627 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:22.952627 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:22.952627 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:22.952627 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:22.952627 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 19:11:22.952627 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:22.952627 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 322/637] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:22.953443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b83c7-3cc2-41e1-9d78-d1ff0b588a5c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:22.972931 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:22.974522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fb22d435-f14c-4dfa-9258-2b326986db6e None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:22.976420 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fb22d435-f14c-4dfa-9258-2b326986db6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:23.010763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:23.078673 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b83c7-3cc2-41e1-9d78-d1ff0b588a5c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:23.081089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 316/638] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:23.083160 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22d435-f14c-4dfa-9258-2b326986db6e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:23.136954 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec17f6-9cb4-4de7-bec3-4eaeff284c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:23.137945 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec17f6-9cb4-4de7-bec3-4eaeff284c1a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:23.138142 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec17f6-9cb4-4de7-bec3-4eaeff284c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:23.138444 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec17f6-9cb4-4de7-bec3-4eaeff284c1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:23.153273 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec17f6-9cb4-4de7-bec3-4eaeff284c1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:23.154803 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec17f6-9cb4-4de7-bec3-4eaeff284c1a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:23.173853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-26ec17f6-9cb4-4de7-bec3-4eaeff284c1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:23.173853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:23.173853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:23.173853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:23.173853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:23.173853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:23.173853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:23.173853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:23.173853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:23.173853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:23.173853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:23.173853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:23.173853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:23.173853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:23.173853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:23.175063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:23.175063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:23.175063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:23.175063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:23.175063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:23.175063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:23.175063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:23.175063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:23.175063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:23.175063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:23.175063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:23.175063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:23.175063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:23.175063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:23.175063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:23.175063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:23.175063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:23.175984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:23.175984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:23.175984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:23.175984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:23.175984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 323/639] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:23.176755 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a59d6-af1f-47b2-919c-19a0652bb4e3 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:23.176936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a59d6-af1f-47b2-919c-19a0652bb4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:23.177186 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a59d6-af1f-47b2-919c-19a0652bb4e3 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:23.179216 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 324/640] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:23.183113 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a59d6-af1f-47b2-919c-19a0652bb4e3 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:23.221457 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22d435-f14c-4dfa-9258-2b326986db6e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:23.264484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:23.267519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c69db-e220-429a-8b12-6a4f1f4e02ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:23.268205 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c69db-e220-429a-8b12-6a4f1f4e02ce None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:23.268517 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c69db-e220-429a-8b12-6a4f1f4e02ce None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:23.268768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c69db-e220-429a-8b12-6a4f1f4e02ce None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:23.269616 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c69db-e220-429a-8b12-6a4f1f4e02ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:23.269943 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c69db-e220-429a-8b12-6a4f1f4e02ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:23.271391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c69db-e220-429a-8b12-6a4f1f4e02ce None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:23.291578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 317/641] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jul 20 19:11:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:23.292409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c69db-e220-429a-8b12-6a4f1f4e02ce None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:23.304095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:23.314629 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a59d6-af1f-47b2-919c-19a0652bb4e3 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:23.353885 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85bde8a-7d60-4a67-bb7f-a1de05569abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:23.354720 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bde8a-7d60-4a67-bb7f-a1de05569abc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:23.355005 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bde8a-7d60-4a67-bb7f-a1de05569abc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:23.355283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bde8a-7d60-4a67-bb7f-a1de05569abc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:23.366094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85bde8a-7d60-4a67-bb7f-a1de05569abc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:23.373770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-f85bde8a-7d60-4a67-bb7f-a1de05569abc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:23.373770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:23.373770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:23.373770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:23.373770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:23.373770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:23.373770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:23.373770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:23.373770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:23.373770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:23.373770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:23.373770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:23.373770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:23.373770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:23.373770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:23.373770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:23.375040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:23.375040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:23.375040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:23.375040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:23.375040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:23.375040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:23.375040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:23.375040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:23.375040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:23.375040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:23.375040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:23.375040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:23.375040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:23.375040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:23.375040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:23.375040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:23.376180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:23.376180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:23.376180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:23.376180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:23.376180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:23.376180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:23.376180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:23.376180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:23.376180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:23.376180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:23.376180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:23.376180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:23.380065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 325/642] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:23.381988 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc74240-e9a6-4f81-b0aa-fd93a297ddda None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:23.382278 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc74240-e9a6-4f81-b0aa-fd93a297ddda None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:23.382584 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc74240-e9a6-4f81-b0aa-fd93a297ddda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:23.399838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8bc74240-e9a6-4f81-b0aa-fd93a297ddda None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:23.401067 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8bc74240-e9a6-4f81-b0aa-fd93a297ddda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:23.431134 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c69db-e220-429a-8b12-6a4f1f4e02ce None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:23.466656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae932b5-b57c-45e1-b9c0-dc9ee4bad0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:23.467585 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae932b5-b57c-45e1-b9c0-dc9ee4bad0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:23.468027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae932b5-b57c-45e1-b9c0-dc9ee4bad0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:23.468299 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae932b5-b57c-45e1-b9c0-dc9ee4bad0c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:23.469021 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae932b5-b57c-45e1-b9c0-dc9ee4bad0c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:23.469327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae932b5-b57c-45e1-b9c0-dc9ee4bad0c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:23.470838 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae932b5-b57c-45e1-b9c0-dc9ee4bad0c4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:23.482366 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 326/643] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:23.482366 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc74240-e9a6-4f81-b0aa-fd93a297ddda None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:23.493239 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 318/644] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:23.493239 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae932b5-b57c-45e1-b9c0-dc9ee4bad0c4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:23.553946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:23.576483 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:23.620068 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc74240-e9a6-4f81-b0aa-fd93a297ddda None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:23.620841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae932b5-b57c-45e1-b9c0-dc9ee4bad0c4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:23.664975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18526004-4785-4d8a-96ef-982dbaaffc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:23.665572 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bef5e3-d659-4ce3-bf61-a60f2e3d571b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:23.665704 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18526004-4785-4d8a-96ef-982dbaaffc2b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:23.665814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bef5e3-d659-4ce3-bf61-a60f2e3d571b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:23.665943 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18526004-4785-4d8a-96ef-982dbaaffc2b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:23.666020 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bef5e3-d659-4ce3-bf61-a60f2e3d571b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:23.666136 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18526004-4785-4d8a-96ef-982dbaaffc2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:23.666237 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bef5e3-d659-4ce3-bf61-a60f2e3d571b None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:23.666617 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bef5e3-d659-4ce3-bf61-a60f2e3d571b None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:23.666722 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bef5e3-d659-4ce3-bf61-a60f2e3d571b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:23.668010 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bef5e3-d659-4ce3-bf61-a60f2e3d571b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:23.680965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 319/645] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:23.682416 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bef5e3-d659-4ce3-bf61-a60f2e3d571b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:23.755843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18526004-4785-4d8a-96ef-982dbaaffc2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:23.757787 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18526004-4785-4d8a-96ef-982dbaaffc2b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:23.809884 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bef5e3-d659-4ce3-bf61-a60f2e3d571b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:23.819722 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:23.841137 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:23.851446 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11c904-dc2d-40d0-8f68-c05707240cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:23.852250 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11c904-dc2d-40d0-8f68-c05707240cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:23.852535 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11c904-dc2d-40d0-8f68-c05707240cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:23.852813 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11c904-dc2d-40d0-8f68-c05707240cb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:23.859934 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11c904-dc2d-40d0-8f68-c05707240cb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:23.861253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11c904-dc2d-40d0-8f68-c05707240cb5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:23.878247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-7b11c904-dc2d-40d0-8f68-c05707240cb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:23.878247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:23.878247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:23.878247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:23.878247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:23.878247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:23.878247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:23.878247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:23.878247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:23.878247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:23.878247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:23.878247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:23.878247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:23.878247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:23.878247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:23.879441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:23.879441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:23.879441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:23.879441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:23.879441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:23.879441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:23.879441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:23.879441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:23.879441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:23.879441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:23.879441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:23.879441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:23.879441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:23.879441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:23.879441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:23.879441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:23.879441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:23.880499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:23.880499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:23.880499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:23.880499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:23.880499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:23.880499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:23.880499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:23.880499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:23.880499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 320/646] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:23.880499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11c904-dc2d-40d0-8f68-c05707240cb5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:23.881478 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 327/647] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:23.882485 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18526004-4785-4d8a-96ef-982dbaaffc2b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:23.989738 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11c904-dc2d-40d0-8f68-c05707240cb5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:23.990549 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18526004-4785-4d8a-96ef-982dbaaffc2b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:24.025443 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3f566-5dd4-4f2b-99e7-99191b51e68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:24.026238 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3f566-5dd4-4f2b-99e7-99191b51e68d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:24.026555 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3f566-5dd4-4f2b-99e7-99191b51e68d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:24.026829 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3f566-5dd4-4f2b-99e7-99191b51e68d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:24.027408 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d35c5-f5cb-4223-a727-34b9f827bc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:24.028200 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d35c5-f5cb-4223-a727-34b9f827bc9a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:24.028483 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d35c5-f5cb-4223-a727-34b9f827bc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:24.028932 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d35c5-f5cb-4223-a727-34b9f827bc9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:24.038604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3f566-5dd4-4f2b-99e7-99191b51e68d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:24.041076 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d35c5-f5cb-4223-a727-34b9f827bc9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:24.042576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d35c5-f5cb-4223-a727-34b9f827bc9a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:24.046530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c1d3f566-5dd4-4f2b-99e7-99191b51e68d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:24.046530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:24.046530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:24.046530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:24.046530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:24.046530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:24.046530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:24.046530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:24.046530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:24.046530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:24.046530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:24.046530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:24.046530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:24.046530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:24.046530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:24.046530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:24.047500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:24.047500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:24.047500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:24.047500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:24.047500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:24.047500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:24.047500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:24.047500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:24.047500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:24.047500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:24.047500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:24.047500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:24.047500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:24.047500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:24.047500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:24.047500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:24.048984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:24.048984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:24.048984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:24.048984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:24.048984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:24.048984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:24.048984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:24.048984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:24.048984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:24.048984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:24.048984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:24.048984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:24.048984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 321/648] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:24.048984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3f566-5dd4-4f2b-99e7-99191b51e68d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:24.061839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-444d35c5-f5cb-4223-a727-34b9f827bc9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:24.061839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:24.061839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:24.061839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:24.061839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:24.061839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:24.061839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:24.061839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:24.061839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:24.061839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:24.061839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:24.061839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:24.061839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:24.061839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:24.061839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:24.062811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:24.062811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:24.062811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:24.062811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:24.062811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:24.062811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:24.062811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:24.062811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:24.062811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:24.062811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:24.062811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:24.062811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:24.062811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:24.062811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:24.062811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:24.062811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:24.062811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:24.065071 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:24.065071 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:24.065071 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:24.065071 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:24.065071 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 328/649] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:24.065071 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d35c5-f5cb-4223-a727-34b9f827bc9a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:24.078164 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:24.108848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:24.173805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3f566-5dd4-4f2b-99e7-99191b51e68d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:24.194881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d35c5-f5cb-4223-a727-34b9f827bc9a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:24.210179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c896c-5e82-4278-8742-09a7f74f16ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:24.211164 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c896c-5e82-4278-8742-09a7f74f16ff None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:24.211446 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c896c-5e82-4278-8742-09a7f74f16ff None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:24.211718 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c896c-5e82-4278-8742-09a7f74f16ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:24.222612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c896c-5e82-4278-8742-09a7f74f16ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:24.224052 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c896c-5e82-4278-8742-09a7f74f16ff None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:24.232260 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fb2c8-ea91-4720-bddf-c2b75f34c66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:24.233148 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fb2c8-ea91-4720-bddf-c2b75f34c66d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:24.233586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fb2c8-ea91-4720-bddf-c2b75f34c66d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:24.234070 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fb2c8-ea91-4720-bddf-c2b75f34c66d None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:24.235081 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fb2c8-ea91-4720-bddf-c2b75f34c66d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:24.235543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fb2c8-ea91-4720-bddf-c2b75f34c66d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:24.237135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fb2c8-ea91-4720-bddf-c2b75f34c66d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:24.242110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-926c896c-5e82-4278-8742-09a7f74f16ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:24.242110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:24.242110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:24.242110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:24.242110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:24.242110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:24.242110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:24.242110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:24.242110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:24.242110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:24.242110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:24.242110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:24.242110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:24.242110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:24.242110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:24.243234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:24.243234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:24.243234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:24.243234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:24.243234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:24.243234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:24.243234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:24.243234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:24.243234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:24.243234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:24.243234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:24.243234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:24.243234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:24.243234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:24.243234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:24.243234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:24.243234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:24.244369 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:24.244369 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:24.244369 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:24.244369 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:24.247977 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 322/650] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:24.248823 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c896c-5e82-4278-8742-09a7f74f16ff None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:24.253162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 329/651] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:24.254178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fb2c8-ea91-4720-bddf-c2b75f34c66d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:24.341085 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:24.380219 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:24.383321 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c896c-5e82-4278-8742-09a7f74f16ff None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:24.385516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fb2c8-ea91-4720-bddf-c2b75f34c66d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:24.421309 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b6ca9-c156-4525-b02c-258b4d7935e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:24.421988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b6ca9-c156-4525-b02c-258b4d7935e9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:24.422278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b6ca9-c156-4525-b02c-258b4d7935e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:24.422594 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b6ca9-c156-4525-b02c-258b4d7935e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:24.423349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b6ca9-c156-4525-b02c-258b4d7935e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:24.423687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b6ca9-c156-4525-b02c-258b4d7935e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:24.424313 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c1f41-84ee-4a9a-8efe-ac856d179616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:24.424978 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c1f41-84ee-4a9a-8efe-ac856d179616 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:24.425105 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b6ca9-c156-4525-b02c-258b4d7935e9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:24.425302 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c1f41-84ee-4a9a-8efe-ac856d179616 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:24.425534 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c1f41-84ee-4a9a-8efe-ac856d179616 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:24.426246 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c1f41-84ee-4a9a-8efe-ac856d179616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:24.426582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c1f41-84ee-4a9a-8efe-ac856d179616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:24.427957 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c1f41-84ee-4a9a-8efe-ac856d179616 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:24.438677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 323/652] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:24.438677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b6ca9-c156-4525-b02c-258b4d7935e9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:24.445076 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 330/653] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:24.449990 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c1f41-84ee-4a9a-8efe-ac856d179616 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:24.558014 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c1f41-84ee-4a9a-8efe-ac856d179616 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:24.564318 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b6ca9-c156-4525-b02c-258b4d7935e9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:24.586756 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:24.596389 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28a7ef-d529-430b-8dc1-a5add6bf772a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:24.596985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28a7ef-d529-430b-8dc1-a5add6bf772a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:24.597272 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28a7ef-d529-430b-8dc1-a5add6bf772a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:24.597551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28a7ef-d529-430b-8dc1-a5add6bf772a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:24.598412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28a7ef-d529-430b-8dc1-a5add6bf772a None admin] RBAC: Adding query filter params (role.id=3e2d1ff906b74bec9c7410e3a3ec9448, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=a1f0f6bc94de4645a8c82038ff2bd34a) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:24.598730 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28a7ef-d529-430b-8dc1-a5add6bf772a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:24.599538 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3f7d0-7601-4c92-a537-b6fa33f552ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:24.600205 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28a7ef-d529-430b-8dc1-a5add6bf772a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:24.600319 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3f7d0-7601-4c92-a537-b6fa33f552ec None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:24.600516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3f7d0-7601-4c92-a537-b6fa33f552ec None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:24.600788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3f7d0-7601-4c92-a537-b6fa33f552ec None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:24.601530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3f7d0-7601-4c92-a537-b6fa33f552ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:24.601868 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3f7d0-7601-4c92-a537-b6fa33f552ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:24.603306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3f7d0-7601-4c92-a537-b6fa33f552ec None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:24.607471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 331/654] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:24 2022] GET /identity/v3/role_assignments?user.id=a1f0f6bc94de4645a8c82038ff2bd34a&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=3e2d1ff906b74bec9c7410e3a3ec9448 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:24.610450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28a7ef-d529-430b-8dc1-a5add6bf772a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:24.622147 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 324/655] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:24.623185 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3f7d0-7601-4c92-a537-b6fa33f552ec None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:24.650734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:24.743194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28a7ef-d529-430b-8dc1-a5add6bf772a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:24.743991 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3f7d0-7601-4c92-a537-b6fa33f552ec None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:24.785207 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9b800-acd4-4991-8c71-63f80546b6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:24.786000 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9b800-acd4-4991-8c71-63f80546b6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:24.786286 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9b800-acd4-4991-8c71-63f80546b6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:24.786585 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9b800-acd4-4991-8c71-63f80546b6d5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:24.787993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36657e0a-3340-416b-a4b8-c9c8ebf581b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:24.788826 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36657e0a-3340-416b-a4b8-c9c8ebf581b1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:24.789116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36657e0a-3340-416b-a4b8-c9c8ebf581b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:24.789747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36657e0a-3340-416b-a4b8-c9c8ebf581b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:24.794669 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9b800-acd4-4991-8c71-63f80546b6d5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:24.796295 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9b800-acd4-4991-8c71-63f80546b6d5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:24.805053 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36657e0a-3340-416b-a4b8-c9c8ebf581b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:24.806627 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36657e0a-3340-416b-a4b8-c9c8ebf581b1 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:24.812139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-97c9b800-acd4-4991-8c71-63f80546b6d5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:11:24.812139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:24.812139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:24.812139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:24.812139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:24.812139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:24.812139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:24.812139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:24.812139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:24.812139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:24.812139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:24.812139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:24.812139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:24.812139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:24.812139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:24.812139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:24.813089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:24.813089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:24.813089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:24.813089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:24.813089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:24.813089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:24.813089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:24.813089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:24.813089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:24.813089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:24.813089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:24.813089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:24.813089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:24.813089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:24.813089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:24.813089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:24.813089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:24.813089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:24.814045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:24.814045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:24.814045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:24.814045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:24.814045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:24.814045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:24.814045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:24.814045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:24.814045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:11:24.814045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:24.814045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 325/656] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:24.815262 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19ea9b-3e2f-4412-941d-748b607d9c64 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:24.815262 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19ea9b-3e2f-4412-941d-748b607d9c64 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:24.815446 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19ea9b-3e2f-4412-941d-748b607d9c64 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:24.817249 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 326/657] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:24.822244 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19ea9b-3e2f-4412-941d-748b607d9c64 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:24.830655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-36657e0a-3340-416b-a4b8-c9c8ebf581b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:24.830655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:24.830655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:24.830655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:24.830655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:24.830655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:24.830655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:24.830655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:24.830655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:24.830655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:24.830655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:24.830655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:24.830655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:24.830655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:24.830655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:24.831607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:24.831607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:24.831607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:24.831607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:24.831607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:24.831607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:24.831607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:24.831607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:24.831607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:24.831607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:24.831607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:24.831607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:24.831607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:24.831607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:24.831607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:24.831607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:24.831607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:24.832527 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:24.832527 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:24.832527 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:24.832527 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:24.832527 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 332/658] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:24.833226 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36657e0a-3340-416b-a4b8-c9c8ebf581b1 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:24.886403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:24.930815 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:24.953188 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19ea9b-3e2f-4412-941d-748b607d9c64 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:24.953915 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36657e0a-3340-416b-a4b8-c9c8ebf581b1 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:24.990329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49a99c-a79e-4a2d-8fc0-b57a3916be06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:24.991159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49a99c-a79e-4a2d-8fc0-b57a3916be06 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:24.991444 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49a99c-a79e-4a2d-8fc0-b57a3916be06 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:24.991724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49a99c-a79e-4a2d-8fc0-b57a3916be06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:24.992906 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28081e6-5e1b-4a1a-8135-1814f2ea8be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:24.993752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28081e6-5e1b-4a1a-8135-1814f2ea8be5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:24.994188 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28081e6-5e1b-4a1a-8135-1814f2ea8be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:24.994650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28081e6-5e1b-4a1a-8135-1814f2ea8be5 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:24.995553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28081e6-5e1b-4a1a-8135-1814f2ea8be5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:24.995871 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28081e6-5e1b-4a1a-8135-1814f2ea8be5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:24.997443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28081e6-5e1b-4a1a-8135-1814f2ea8be5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:24.998914 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc49a99c-a79e-4a2d-8fc0-b57a3916be06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:25.000347 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc49a99c-a79e-4a2d-8fc0-b57a3916be06 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:25.014724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-bc49a99c-a79e-4a2d-8fc0-b57a3916be06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:25.014724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:25.014724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:25.014724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:25.014724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:25.014724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:25.014724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:25.014724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:25.014724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:25.014724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:25.014724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:25.014724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:25.014724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:25.014724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:25.014724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:25.015715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:25.015715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:25.015715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:25.015715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:25.015715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:25.015715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:25.015715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:25.015715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:25.015715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:25.015715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:25.015715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:25.015715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:25.015715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:25.015715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:25.015715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:25.015715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:25.015715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:25.016643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:25.016643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:25.016643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:25.016643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:25.016643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:25.016643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:25.016643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:25.016643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:25.016643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 327/659] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:25.017531 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9f4ec-4a95-45e5-81bd-ba28bb1315a4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:25.017531 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9f4ec-4a95-45e5-81bd-ba28bb1315a4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:25.017670 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9f4ec-4a95-45e5-81bd-ba28bb1315a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:25.021081 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 333/660] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Jul 20 19:11:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:25.022638 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28081e6-5e1b-4a1a-8135-1814f2ea8be5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:25.038816 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2cf9f4ec-4a95-45e5-81bd-ba28bb1315a4 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:25.040310 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2cf9f4ec-4a95-45e5-81bd-ba28bb1315a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:25.122353 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 328/661] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:25.122353 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9f4ec-4a95-45e5-81bd-ba28bb1315a4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:25.160399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28081e6-5e1b-4a1a-8135-1814f2ea8be5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:25.162008 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:25.197838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd33d7d-4ffb-48c8-82eb-3ce2ca7fbf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:25.198942 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd33d7d-4ffb-48c8-82eb-3ce2ca7fbf83 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:25.198942 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd33d7d-4ffb-48c8-82eb-3ce2ca7fbf83 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:25.199197 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd33d7d-4ffb-48c8-82eb-3ce2ca7fbf83 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:25.199782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:25.199959 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd33d7d-4ffb-48c8-82eb-3ce2ca7fbf83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:25.200095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd33d7d-4ffb-48c8-82eb-3ce2ca7fbf83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:25.201460 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd33d7d-4ffb-48c8-82eb-3ce2ca7fbf83 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:25.219158 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 334/662] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:25.219158 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd33d7d-4ffb-48c8-82eb-3ce2ca7fbf83 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:25.233523 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9f4ec-4a95-45e5-81bd-ba28bb1315a4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:25.280281 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048951f-0966-49a0-917c-f3043b2be77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:25.281374 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048951f-0966-49a0-917c-f3043b2be77b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:25.281867 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048951f-0966-49a0-917c-f3043b2be77b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:25.282372 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048951f-0966-49a0-917c-f3043b2be77b None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:25.284054 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048951f-0966-49a0-917c-f3043b2be77b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:25.284592 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048951f-0966-49a0-917c-f3043b2be77b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:25.287190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7048951f-0966-49a0-917c-f3043b2be77b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:25.311996 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 329/663] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:25.311996 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048951f-0966-49a0-917c-f3043b2be77b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:25.329598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd33d7d-4ffb-48c8-82eb-3ce2ca7fbf83 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:25.368734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f635ae9-96ee-4120-a2fe-78e5093db383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:25.369392 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f635ae9-96ee-4120-a2fe-78e5093db383 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:25.369673 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f635ae9-96ee-4120-a2fe-78e5093db383 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:25.369952 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f635ae9-96ee-4120-a2fe-78e5093db383 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:25.404039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:25.443249 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048951f-0966-49a0-917c-f3043b2be77b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:25.454855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f635ae9-96ee-4120-a2fe-78e5093db383 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:25.456306 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f635ae9-96ee-4120-a2fe-78e5093db383 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:25.480346 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:25.486354 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57e114-0e33-4326-8ecf-6393c06e0f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:25.487182 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57e114-0e33-4326-8ecf-6393c06e0f2f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:25.487467 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57e114-0e33-4326-8ecf-6393c06e0f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:25.487743 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57e114-0e33-4326-8ecf-6393c06e0f2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:25.498498 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57e114-0e33-4326-8ecf-6393c06e0f2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:25.506841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8f57e114-0e33-4326-8ecf-6393c06e0f2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:25.506841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:25.506841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:25.506841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:25.506841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:25.506841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:25.506841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:25.506841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:25.506841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:25.506841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:25.506841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:25.506841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:25.506841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:25.506841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:25.506841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:25.506841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:25.507981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:25.507981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:25.507981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:25.507981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:25.507981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:25.507981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:25.507981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:25.507981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:25.507981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:25.507981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:25.507981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:25.507981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:25.507981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:25.507981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:25.507981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:25.507981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:25.508839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:25.508839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:25.508839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:25.508839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:25.508839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:25.508839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:25.508839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:25.508839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:25.508839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:25.508839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:25.508839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:25.508839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:25.508839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 330/664] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:25.509873 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57e114-0e33-4326-8ecf-6393c06e0f2f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:25.592606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 335/665] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:25.592606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f635ae9-96ee-4120-a2fe-78e5093db383 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:25.637423 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57e114-0e33-4326-8ecf-6393c06e0f2f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:25.658374 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:25.682107 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cfba9-dd12-4b50-a59c-90b8488bb6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:25.683146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cfba9-dd12-4b50-a59c-90b8488bb6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:25.683430 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cfba9-dd12-4b50-a59c-90b8488bb6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:25.683707 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cfba9-dd12-4b50-a59c-90b8488bb6f1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:25.692547 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cfba9-dd12-4b50-a59c-90b8488bb6f1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:25.694834 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cfba9-dd12-4b50-a59c-90b8488bb6f1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:25.698199 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f635ae9-96ee-4120-a2fe-78e5093db383 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:25.709673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ba7cfba9-dd12-4b50-a59c-90b8488bb6f1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 19:11:25.709673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:25.709673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:25.709673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:25.709673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:25.709673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:25.709673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:25.709673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:25.709673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:25.709673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:25.709673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:25.709673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:25.709673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:25.709673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:25.709673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:25.709673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:25.710733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:25.710733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:25.710733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:25.710733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:25.710733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:25.710733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:25.710733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:25.710733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:25.710733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:25.710733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:25.710733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:25.710733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:25.710733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:25.710733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:25.710733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:25.710733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:25.710733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:25.710733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:25.711732 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:25.711732 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:25.711732 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:25.711732 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:25.711732 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:25.711732 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:25.711732 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:25.711732 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:25.711732 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 19:11:25.711732 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:25.711732 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 331/666] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:25.711732 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cfba9-dd12-4b50-a59c-90b8488bb6f1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:25.743182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd775132-3f3d-45b1-a99f-82ea6759454d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:25.743839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd775132-3f3d-45b1-a99f-82ea6759454d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:25.744115 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd775132-3f3d-45b1-a99f-82ea6759454d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:25.744423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd775132-3f3d-45b1-a99f-82ea6759454d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:25.745219 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd775132-3f3d-45b1-a99f-82ea6759454d None admin] RBAC: Adding query filter params (role.id=3e2d1ff906b74bec9c7410e3a3ec9448, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=36f646c526a044e8b5b6e74aa64cf6e9) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:25.745532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd775132-3f3d-45b1-a99f-82ea6759454d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:25.747217 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd775132-3f3d-45b1-a99f-82ea6759454d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:25.755341 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 336/667] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:25 2022] GET /identity/v3/role_assignments?user.id=36f646c526a044e8b5b6e74aa64cf6e9&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=3e2d1ff906b74bec9c7410e3a3ec9448 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:25.756055 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd775132-3f3d-45b1-a99f-82ea6759454d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:25.788023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:25.852844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cfba9-dd12-4b50-a59c-90b8488bb6f1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:25.893660 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd775132-3f3d-45b1-a99f-82ea6759454d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:25.907912 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c0b73-7db1-4fde-8cb0-ead8f0df4c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:25.908855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c0b73-7db1-4fde-8cb0-ead8f0df4c26 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:25.909141 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c0b73-7db1-4fde-8cb0-ead8f0df4c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:25.909418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c0b73-7db1-4fde-8cb0-ead8f0df4c26 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:25.910182 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c0b73-7db1-4fde-8cb0-ead8f0df4c26 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:25.910527 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c0b73-7db1-4fde-8cb0-ead8f0df4c26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:25.911913 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c0b73-7db1-4fde-8cb0-ead8f0df4c26 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:25.922177 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 332/668] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:25.922874 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c0b73-7db1-4fde-8cb0-ead8f0df4c26 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:25.929790 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:25.942588 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65ac29-ee66-4ed0-ba06-dc598a04d50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:25.943389 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65ac29-ee66-4ed0-ba06-dc598a04d50a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:25.943723 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65ac29-ee66-4ed0-ba06-dc598a04d50a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:25.944001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65ac29-ee66-4ed0-ba06-dc598a04d50a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:25.958533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65ac29-ee66-4ed0-ba06-dc598a04d50a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:25.960262 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65ac29-ee66-4ed0-ba06-dc598a04d50a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:25.984533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-9d65ac29-ee66-4ed0-ba06-dc598a04d50a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:25.984533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:25.984533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:25.984533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:25.984533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:25.984533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:25.984533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:25.984533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:25.984533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:25.984533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:25.984533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:25.984533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:25.984533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:25.984533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:25.984533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:25.985510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:25.985510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:25.985510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:25.985510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:25.985510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:25.985510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:25.985510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:25.985510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:25.985510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:25.985510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:25.985510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:25.985510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:25.985510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:25.985510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:25.985510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:25.985510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:25.985510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:25.986842 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:25.986842 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:25.986842 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:25.986842 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:25.986842 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 337/669] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:25.987139 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65ac29-ee66-4ed0-ba06-dc598a04d50a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:26.044120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c0b73-7db1-4fde-8cb0-ead8f0df4c26 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:26.061709 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:26.095805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226e377-5a02-4619-8d0d-fd4a151a68d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:26.096572 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226e377-5a02-4619-8d0d-fd4a151a68d7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:26.096922 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226e377-5a02-4619-8d0d-fd4a151a68d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:26.097264 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8226e377-5a02-4619-8d0d-fd4a151a68d7 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:26.098168 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226e377-5a02-4619-8d0d-fd4a151a68d7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:26.098596 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226e377-5a02-4619-8d0d-fd4a151a68d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:26.100625 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8226e377-5a02-4619-8d0d-fd4a151a68d7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:26.120684 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65ac29-ee66-4ed0-ba06-dc598a04d50a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:26.121334 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 333/670] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Jul 20 19:11:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:26.122312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226e377-5a02-4619-8d0d-fd4a151a68d7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:26.166908 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7340d1-c20f-4517-8fb4-b8a680e3f40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:26.168510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7340d1-c20f-4517-8fb4-b8a680e3f40d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:26.169351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7340d1-c20f-4517-8fb4-b8a680e3f40d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:26.169811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7340d1-c20f-4517-8fb4-b8a680e3f40d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:26.184719 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7340d1-c20f-4517-8fb4-b8a680e3f40d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:26.187368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7340d1-c20f-4517-8fb4-b8a680e3f40d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:26.213768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-0e7340d1-c20f-4517-8fb4-b8a680e3f40d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:26.213768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:26.213768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:26.213768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:26.213768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:26.213768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:26.213768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:26.213768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:26.213768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:26.213768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:26.213768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:26.213768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:26.213768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:26.213768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:26.213768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:26.216006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:26.216006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:26.216006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:26.216006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:26.216006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:26.216006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:26.216006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:26.216006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:26.216006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:26.216006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:26.216006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:26.216006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:26.216006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:26.216006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:26.216006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:26.216006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:26.216006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:26.217588 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:26.217588 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:26.217588 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:26.217588 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:26.222171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 338/671] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:26.225513 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7340d1-c20f-4517-8fb4-b8a680e3f40d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:26.239623 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8226e377-5a02-4619-8d0d-fd4a151a68d7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:26.273611 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:26.281799 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c3fd6-12a2-4e7d-a986-6646ce6616bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:26.282007 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c3fd6-12a2-4e7d-a986-6646ce6616bb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:26.282317 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c3fd6-12a2-4e7d-a986-6646ce6616bb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:26.282629 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c3fd6-12a2-4e7d-a986-6646ce6616bb None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:26.284001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c3fd6-12a2-4e7d-a986-6646ce6616bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:26.284316 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c3fd6-12a2-4e7d-a986-6646ce6616bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:26.285808 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c3fd6-12a2-4e7d-a986-6646ce6616bb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:26.304052 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 334/672] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:26.304712 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c3fd6-12a2-4e7d-a986-6646ce6616bb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:26.343134 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:26.367546 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7340d1-c20f-4517-8fb4-b8a680e3f40d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:26.407046 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f6e41-f859-42ac-8306-6c6ba0389476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:26.408005 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f6e41-f859-42ac-8306-6c6ba0389476 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:26.408754 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f6e41-f859-42ac-8306-6c6ba0389476 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:26.409289 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f6e41-f859-42ac-8306-6c6ba0389476 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:26.417160 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c3fd6-12a2-4e7d-a986-6646ce6616bb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:26.454119 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b95dd-1df1-4ef7-b303-48ab8e0a6797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:26.455476 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b95dd-1df1-4ef7-b303-48ab8e0a6797 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:26.455767 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b95dd-1df1-4ef7-b303-48ab8e0a6797 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:26.456451 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b95dd-1df1-4ef7-b303-48ab8e0a6797 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:26.457963 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b95dd-1df1-4ef7-b303-48ab8e0a6797 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:26.458438 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b95dd-1df1-4ef7-b303-48ab8e0a6797 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:26.459946 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b95dd-1df1-4ef7-b303-48ab8e0a6797 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:26.476986 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 335/673] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:26.478591 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b95dd-1df1-4ef7-b303-48ab8e0a6797 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:26.488753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f6e41-f859-42ac-8306-6c6ba0389476 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:26.491014 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f6e41-f859-42ac-8306-6c6ba0389476 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:26.522080 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:26.595164 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b95dd-1df1-4ef7-b303-48ab8e0a6797 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:26.601609 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 339/674] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:26.602646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f6e41-f859-42ac-8306-6c6ba0389476 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:26.614724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:26.637517 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1b994-0f58-422b-b25d-68c80080128d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:26.638419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1b994-0f58-422b-b25d-68c80080128d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:26.638852 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1b994-0f58-422b-b25d-68c80080128d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:26.639250 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1b994-0f58-422b-b25d-68c80080128d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:26.648511 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1b994-0f58-422b-b25d-68c80080128d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:26.649961 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1b994-0f58-422b-b25d-68c80080128d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:26.669211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-16d1b994-0f58-422b-b25d-68c80080128d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:26.669211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:26.669211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:26.669211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:26.669211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:26.669211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:26.669211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:26.669211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:26.669211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:26.669211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:26.669211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:26.669211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:26.669211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:26.669211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:26.669211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:26.670234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:26.670234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:26.670234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:26.670234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:26.670234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:26.670234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:26.670234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:26.670234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:26.670234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:26.670234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:26.670234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:26.670234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:26.670234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:26.670234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:26.670234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:26.670234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:26.670234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:26.671220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:26.671220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:26.671220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:26.671220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:26.671220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:26.671220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:26.671220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:26.671220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:26.671220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 336/675] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:26.672026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1b994-0f58-422b-b25d-68c80080128d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:26.739176 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f6e41-f859-42ac-8306-6c6ba0389476 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:26.772365 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:26.780628 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01b181-f030-44f1-aa1d-42010905c3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:26.781442 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01b181-f030-44f1-aa1d-42010905c3de None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:26.781722 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01b181-f030-44f1-aa1d-42010905c3de None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:26.781999 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01b181-f030-44f1-aa1d-42010905c3de None admin] PATH_INFO: `/v3/users/swift` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:26.791232 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01b181-f030-44f1-aa1d-42010905c3de None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:26.792818 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01b181-f030-44f1-aa1d-42010905c3de None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:26.794828 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1b994-0f58-422b-b25d-68c80080128d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:26.810869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-3d01b181-f030-44f1-aa1d-42010905c3de None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:11:26.810869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:26.810869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:26.810869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:26.810869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:26.810869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:26.810869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:26.810869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:26.810869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:26.810869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:26.810869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:26.810869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:26.810869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:26.810869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:26.810869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:26.810869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:26.811900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:26.811900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:26.811900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:26.811900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:26.811900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:26.811900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:26.811900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:26.811900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:26.811900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:26.811900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:26.811900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:26.811900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:26.811900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:26.811900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:26.811900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:26.811900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:26.811900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:26.811900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:26.812865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:26.812865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:26.812865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:26.812865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:26.812865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:26.812865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:26.812865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:26.812865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:26.812865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:11:26.812865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:26.812865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 340/676] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:11:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:26.813516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01b181-f030-44f1-aa1d-42010905c3de None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:26.846112 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186101f3-c845-4bc8-b653-82bb5a67a3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:26.846937 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186101f3-c845-4bc8-b653-82bb5a67a3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:26.847220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186101f3-c845-4bc8-b653-82bb5a67a3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:26.847502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186101f3-c845-4bc8-b653-82bb5a67a3e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:26.859335 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186101f3-c845-4bc8-b653-82bb5a67a3e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:26.860786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186101f3-c845-4bc8-b653-82bb5a67a3e7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:26.881190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-186101f3-c845-4bc8-b653-82bb5a67a3e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:26.881190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:26.881190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:26.881190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:26.881190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:26.881190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:26.881190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:26.881190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:26.881190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:26.881190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:26.881190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:26.881190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:26.881190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:26.881190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:26.881190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:26.882172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:26.882172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:26.882172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:26.882172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:26.882172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:26.882172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:26.882172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:26.882172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:26.882172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:26.882172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:26.882172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:26.882172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:26.882172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:26.882172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:26.882172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:26.882172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:26.882172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:26.883140 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:26.883140 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:26.883140 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:26.883140 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:26.883140 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 337/677] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:26.884011 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b21ee8-a794-45c5-8899-b19df77a518f None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:26.884011 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b21ee8-a794-45c5-8899-b19df77a518f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:26.884247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b21ee8-a794-45c5-8899-b19df77a518f None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:26.885645 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 338/678] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:26.886218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b21ee8-a794-45c5-8899-b19df77a518f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:26.892089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:26.946887 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01b181-f030-44f1-aa1d-42010905c3de None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:26.983117 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db447b-54c3-45e7-8005-5c53a9dbbda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:26.984107 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db447b-54c3-45e7-8005-5c53a9dbbda4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:26.984396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db447b-54c3-45e7-8005-5c53a9dbbda4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:26.984676 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db447b-54c3-45e7-8005-5c53a9dbbda4 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:26.985459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db447b-54c3-45e7-8005-5c53a9dbbda4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:26.985768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db447b-54c3-45e7-8005-5c53a9dbbda4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:26.987261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db447b-54c3-45e7-8005-5c53a9dbbda4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:26.999787 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 341/679] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:27.000470 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db447b-54c3-45e7-8005-5c53a9dbbda4 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:27.009805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b21ee8-a794-45c5-8899-b19df77a518f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:27.049701 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02914869-7056-4407-9474-cccffbec0ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:27.050411 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02914869-7056-4407-9474-cccffbec0ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:27.050696 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02914869-7056-4407-9474-cccffbec0ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:27.050980 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02914869-7056-4407-9474-cccffbec0ab7 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:27.051823 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02914869-7056-4407-9474-cccffbec0ab7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:27.052133 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02914869-7056-4407-9474-cccffbec0ab7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:27.053624 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02914869-7056-4407-9474-cccffbec0ab7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:27.058592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:27.079099 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 339/680] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jul 20 19:11:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:27.080571 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcc8ae-8350-42d2-ac49-f2ca4e6eb0df None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:27.080914 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcc8ae-8350-42d2-ac49-f2ca4e6eb0df None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:27.081197 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcc8ae-8350-42d2-ac49-f2ca4e6eb0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:27.100426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fafcc8ae-8350-42d2-ac49-f2ca4e6eb0df None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:27.101729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fafcc8ae-8350-42d2-ac49-f2ca4e6eb0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:27.121012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db447b-54c3-45e7-8005-5c53a9dbbda4 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:27.159228 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5114b48-2481-4b23-b390-dda4b0dc55be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:27.159899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5114b48-2481-4b23-b390-dda4b0dc55be None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:27.160186 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5114b48-2481-4b23-b390-dda4b0dc55be None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:27.160465 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5114b48-2481-4b23-b390-dda4b0dc55be None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:27.161187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5114b48-2481-4b23-b390-dda4b0dc55be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:27.161495 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5114b48-2481-4b23-b390-dda4b0dc55be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:27.162985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5114b48-2481-4b23-b390-dda4b0dc55be None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:27.166965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:27.180813 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 342/681] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:27.180813 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5114b48-2481-4b23-b390-dda4b0dc55be None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:27.182619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 340/682] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:27.190408 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcc8ae-8350-42d2-ac49-f2ca4e6eb0df None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:27.293059 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5114b48-2481-4b23-b390-dda4b0dc55be None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:27.304410 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcc8ae-8350-42d2-ac49-f2ca4e6eb0df None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:27.305085 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:27.333811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2ff93-4575-4077-a413-c1bb8069a28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:27.335452 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2ff93-4575-4077-a413-c1bb8069a28c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:27.335963 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2ff93-4575-4077-a413-c1bb8069a28c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:27.336416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2ff93-4575-4077-a413-c1bb8069a28c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:27.337648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2ff93-4575-4077-a413-c1bb8069a28c None admin] RBAC: Adding query filter params (role.id=3e2d1ff906b74bec9c7410e3a3ec9448, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=bd4ce33a2a1248c6a3199265f40e86f4) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:27.338108 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2ff93-4575-4077-a413-c1bb8069a28c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:27.339974 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2ff93-4575-4077-a413-c1bb8069a28c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:27.342704 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30e21f-7e0d-4dff-8400-bdc73e26ee7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:27.343354 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30e21f-7e0d-4dff-8400-bdc73e26ee7a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:27.343718 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30e21f-7e0d-4dff-8400-bdc73e26ee7a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:27.344004 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30e21f-7e0d-4dff-8400-bdc73e26ee7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:27.346860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 343/683] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:27 2022] GET /identity/v3/role_assignments?user.id=bd4ce33a2a1248c6a3199265f40e86f4&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=3e2d1ff906b74bec9c7410e3a3ec9448 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:27.347797 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2ff93-4575-4077-a413-c1bb8069a28c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:27.430418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:27.446453 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30e21f-7e0d-4dff-8400-bdc73e26ee7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:27.448232 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30e21f-7e0d-4dff-8400-bdc73e26ee7a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:27.495386 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2ff93-4575-4077-a413-c1bb8069a28c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:27.551466 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258210e-eecb-4e15-a015-002e9fe4c8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:27.554910 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258210e-eecb-4e15-a015-002e9fe4c8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:27.555376 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258210e-eecb-4e15-a015-002e9fe4c8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:27.555786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258210e-eecb-4e15-a015-002e9fe4c8a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:27.567101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258210e-eecb-4e15-a015-002e9fe4c8a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:27.569474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258210e-eecb-4e15-a015-002e9fe4c8a0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:27.592741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-6258210e-eecb-4e15-a015-002e9fe4c8a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:27.592741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:27.592741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:27.592741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:27.592741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:27.592741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:27.592741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:27.592741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:27.592741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:27.592741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:27.592741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:27.592741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:27.592741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:27.592741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:27.592741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:27.593907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:27.593907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:27.593907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:27.593907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:27.593907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:27.593907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:27.593907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:27.593907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:27.593907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:27.593907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:27.593907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:27.593907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:27.593907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:27.593907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:27.593907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:27.593907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:27.593907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:27.594925 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:27.594925 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:27.594925 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:27.594925 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:27.594925 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:27.594925 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:27.594925 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:27.594925 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:27.594925 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 344/684] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:27.594925 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258210e-eecb-4e15-a015-002e9fe4c8a0 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:27.603091 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 341/685] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:27.604911 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30e21f-7e0d-4dff-8400-bdc73e26ee7a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:27.649778 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:27.719619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:27.729954 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30e21f-7e0d-4dff-8400-bdc73e26ee7a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:27.749155 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258210e-eecb-4e15-a015-002e9fe4c8a0 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:27.769987 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2ce47-062a-4b14-9917-5a6eb9a16b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:27.770677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2ce47-062a-4b14-9917-5a6eb9a16b5a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:27.770955 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2ce47-062a-4b14-9917-5a6eb9a16b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:27.771223 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2ce47-062a-4b14-9917-5a6eb9a16b5a None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:27.772049 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2ce47-062a-4b14-9917-5a6eb9a16b5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:27.772352 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2ce47-062a-4b14-9917-5a6eb9a16b5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:27.773772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2ce47-062a-4b14-9917-5a6eb9a16b5a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:27.787367 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 342/686] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:27.788002 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2ce47-062a-4b14-9917-5a6eb9a16b5a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:27.801256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a6e3c-3f6a-4224-9ded-776bc760f425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:27.803640 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a6e3c-3f6a-4224-9ded-776bc760f425 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:27.804178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a6e3c-3f6a-4224-9ded-776bc760f425 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:27.805143 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a6e3c-3f6a-4224-9ded-776bc760f425 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:27.821029 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a6e3c-3f6a-4224-9ded-776bc760f425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:27.832471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-712a6e3c-3f6a-4224-9ded-776bc760f425 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:27.832471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:27.832471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:27.832471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:27.832471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:27.832471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:27.832471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:27.832471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:27.832471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:27.832471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:27.832471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:27.832471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:27.832471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:27.832471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:27.832471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:27.832471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:27.833505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:27.833505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:27.833505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:27.833505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:27.833505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:27.833505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:27.833505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:27.833505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:27.833505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:27.833505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:27.833505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:27.833505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:27.833505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:27.833505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:27.833505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:27.833505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:27.834946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:27.834946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:27.834946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:27.834946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:27.834946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:27.834946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:27.834946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:27.834946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:27.834946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:27.834946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:27.834946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:27.834946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:27.838277 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 345/687] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:11:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:27.839736 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a6e3c-3f6a-4224-9ded-776bc760f425 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:27.930844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2ce47-062a-4b14-9917-5a6eb9a16b5a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:27.967975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:27.973993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a6e3c-3f6a-4224-9ded-776bc760f425 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:27.983164 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f344c9d-4fda-4d67-9428-6a963b6b3416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:27.983970 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f344c9d-4fda-4d67-9428-6a963b6b3416 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:27.984257 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f344c9d-4fda-4d67-9428-6a963b6b3416 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:27.984528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f344c9d-4fda-4d67-9428-6a963b6b3416 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:27.996564 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f344c9d-4fda-4d67-9428-6a963b6b3416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:27.998372 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f344c9d-4fda-4d67-9428-6a963b6b3416 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:28.018271 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5e0c0-6e92-46e5-8f40-d6535ecd9632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:28.019020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5e0c0-6e92-46e5-8f40-d6535ecd9632 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:28.019300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5e0c0-6e92-46e5-8f40-d6535ecd9632 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:28.019623 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5e0c0-6e92-46e5-8f40-d6535ecd9632 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:28.020453 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5e0c0-6e92-46e5-8f40-d6535ecd9632 None admin] RBAC: Adding query filter params (role.id=3e2d1ff906b74bec9c7410e3a3ec9448, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=0c7b88e083d04718bf19d982724babd9) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:28.020764 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5e0c0-6e92-46e5-8f40-d6535ecd9632 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:28.022839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5e0c0-6e92-46e5-8f40-d6535ecd9632 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:28.023485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8f344c9d-4fda-4d67-9428-6a963b6b3416 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:28.023485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:28.023485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:28.023485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:28.023485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:28.023485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:28.023485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:28.023485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:28.023485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:28.023485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:28.023485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:28.023485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:28.023485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:28.023485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:28.023485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:28.024355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:28.024355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:28.024355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:28.024355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:28.024355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:28.024355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:28.024355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:28.024355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:28.024355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:28.024355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:28.024355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:28.024355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:28.024355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:28.024355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:28.024355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:28.024355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:28.024355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:28.025265 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:28.025265 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:28.025265 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:28.025265 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:28.032241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 343/688] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:28.032241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f344c9d-4fda-4d67-9428-6a963b6b3416 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:28.037333 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:28.038077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 346/689] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:27 2022] GET /identity/v3/role_assignments?user.id=0c7b88e083d04718bf19d982724babd9&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=3e2d1ff906b74bec9c7410e3a3ec9448 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:28.039099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5e0c0-6e92-46e5-8f40-d6535ecd9632 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:28.192868 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f344c9d-4fda-4d67-9428-6a963b6b3416 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:28.204961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5e0c0-6e92-46e5-8f40-d6535ecd9632 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:28.247742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c187bf6-fe36-48b7-a793-60198ddf8f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:28.248327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c187bf6-fe36-48b7-a793-60198ddf8f9a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:28.248745 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c187bf6-fe36-48b7-a793-60198ddf8f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:28.249148 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c187bf6-fe36-48b7-a793-60198ddf8f9a None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:28.250211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c187bf6-fe36-48b7-a793-60198ddf8f9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:28.250703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c187bf6-fe36-48b7-a793-60198ddf8f9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:28.252753 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c187bf6-fe36-48b7-a793-60198ddf8f9a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:28.268659 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 344/690] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:28.270976 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d21a7c-92bf-417a-8df4-3c1ecc3b7f9a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:28.271278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d21a7c-92bf-417a-8df4-3c1ecc3b7f9a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:28.272224 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d21a7c-92bf-417a-8df4-3c1ecc3b7f9a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:28.272837 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6d7e2-a799-40c5-8c64-c755ac10a125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:28.277697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 345/691] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:28.277697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d21a7c-92bf-417a-8df4-3c1ecc3b7f9a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:28.278121 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6d7e2-a799-40c5-8c64-c755ac10a125 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:28.278715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6d7e2-a799-40c5-8c64-c755ac10a125 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:28.279197 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6d7e2-a799-40c5-8c64-c755ac10a125 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:28.279989 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6d7e2-a799-40c5-8c64-c755ac10a125 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:28.280311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6d7e2-a799-40c5-8c64-c755ac10a125 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:28.281729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6d7e2-a799-40c5-8c64-c755ac10a125 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:28.297814 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 347/692] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:28.299780 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f981c19-9a3b-4bd5-b58b-d4d0091a55b9 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:28.300069 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f981c19-9a3b-4bd5-b58b-d4d0091a55b9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:28.300357 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f981c19-9a3b-4bd5-b58b-d4d0091a55b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:28.319688 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8f981c19-9a3b-4bd5-b58b-d4d0091a55b9 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:28.321017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8f981c19-9a3b-4bd5-b58b-d4d0091a55b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:28.337694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:28.366753 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:28.420147 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d21a7c-92bf-417a-8df4-3c1ecc3b7f9a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:28.430386 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 348/693] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:28.431505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f981c19-9a3b-4bd5-b58b-d4d0091a55b9 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:28.473078 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7ec2c-4f8c-4e2c-b38e-9dc5dfdaf157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:28.474134 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7ec2c-4f8c-4e2c-b38e-9dc5dfdaf157 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:28.474608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7ec2c-4f8c-4e2c-b38e-9dc5dfdaf157 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:28.474987 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7ec2c-4f8c-4e2c-b38e-9dc5dfdaf157 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:28.486873 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7ec2c-4f8c-4e2c-b38e-9dc5dfdaf157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:28.488617 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7ec2c-4f8c-4e2c-b38e-9dc5dfdaf157 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:28.509879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c9a7ec2c-4f8c-4e2c-b38e-9dc5dfdaf157 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:28.509879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:28.509879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:28.509879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:28.509879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:28.509879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:28.509879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:28.509879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:28.509879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:28.509879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:28.509879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:28.509879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:28.509879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:28.509879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:28.509879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:28.510909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:28.510909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:28.510909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:28.510909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:28.510909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:28.510909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:28.510909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:28.510909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:28.510909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:28.510909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:28.510909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:28.510909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:28.510909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:28.510909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:28.510909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:28.510909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:28.510909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:28.511823 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:28.511823 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:28.511823 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:28.511823 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:28.516003 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 346/694] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:28.516851 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7ec2c-4f8c-4e2c-b38e-9dc5dfdaf157 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:28.557883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f981c19-9a3b-4bd5-b58b-d4d0091a55b9 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:28.603392 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c01252-38d3-4a24-b096-5894cd18d25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:28.604238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c01252-38d3-4a24-b096-5894cd18d25f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:28.604530 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c01252-38d3-4a24-b096-5894cd18d25f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:28.604814 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c01252-38d3-4a24-b096-5894cd18d25f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:28.612797 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c01252-38d3-4a24-b096-5894cd18d25f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:28.614280 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c01252-38d3-4a24-b096-5894cd18d25f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:28.629432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-15c01252-38d3-4a24-b096-5894cd18d25f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:28.629432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:28.629432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:28.629432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:28.629432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:28.629432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:28.629432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:28.629432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:28.629432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:28.629432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:28.629432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:28.629432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:28.629432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:28.629432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:28.629432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:28.630441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:28.630441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:28.630441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:28.630441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:28.630441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:28.630441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:28.630441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:28.630441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:28.630441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:28.630441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:28.630441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:28.630441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:28.630441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:28.630441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:28.630441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:28.630441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:28.630441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:28.631980 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:28.631980 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:28.631980 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:28.631980 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:28.631980 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:28.631980 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:28.631980 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:28.631980 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:28.633646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 349/695] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:28.634905 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c01252-38d3-4a24-b096-5894cd18d25f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:28.648136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7ec2c-4f8c-4e2c-b38e-9dc5dfdaf157 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:28.649140 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:28.670640 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:28.690617 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a195660-6c9d-4ded-8cf3-38c64d08bbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:28.691576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a195660-6c9d-4ded-8cf3-38c64d08bbcd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:28.691921 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a195660-6c9d-4ded-8cf3-38c64d08bbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:28.692568 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a195660-6c9d-4ded-8cf3-38c64d08bbcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:28.704494 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a195660-6c9d-4ded-8cf3-38c64d08bbcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:28.706141 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a195660-6c9d-4ded-8cf3-38c64d08bbcd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:28.724646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8a195660-6c9d-4ded-8cf3-38c64d08bbcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:28.724646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:28.724646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:28.724646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:28.724646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:28.724646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:28.724646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:28.724646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:28.724646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:28.724646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:28.724646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:28.724646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:28.724646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:28.724646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:28.724646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:28.725578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:28.725578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:28.725578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:28.725578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:28.725578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:28.725578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:28.725578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:28.725578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:28.725578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:28.725578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:28.725578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:28.725578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:28.725578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:28.725578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:28.725578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:28.725578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:28.725578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:28.726522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:28.726522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:28.726522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:28.726522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:28.726522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 347/696] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:28.727452 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a195660-6c9d-4ded-8cf3-38c64d08bbcd None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:28.764854 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c01252-38d3-4a24-b096-5894cd18d25f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:28.801567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8e639-f628-4b3e-95e3-3b08f4e167fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:28.802681 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8e639-f628-4b3e-95e3-3b08f4e167fb None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:28.803665 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8e639-f628-4b3e-95e3-3b08f4e167fb None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:28.804157 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8e639-f628-4b3e-95e3-3b08f4e167fb None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:28.805121 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8e639-f628-4b3e-95e3-3b08f4e167fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:28.805629 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8e639-f628-4b3e-95e3-3b08f4e167fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:28.807235 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8e639-f628-4b3e-95e3-3b08f4e167fb None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:28.827930 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 350/697] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:28.829503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8e639-f628-4b3e-95e3-3b08f4e167fb None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:28.836747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a195660-6c9d-4ded-8cf3-38c64d08bbcd None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:28.873734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b186c3b-f09e-488a-bb2a-dd863193206b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:28.874486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b186c3b-f09e-488a-bb2a-dd863193206b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:28.874769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b186c3b-f09e-488a-bb2a-dd863193206b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:28.875047 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b186c3b-f09e-488a-bb2a-dd863193206b None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:28.875889 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b186c3b-f09e-488a-bb2a-dd863193206b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:28.876199 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b186c3b-f09e-488a-bb2a-dd863193206b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:28.877829 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b186c3b-f09e-488a-bb2a-dd863193206b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:28.891293 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 348/698] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:28.892386 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b186c3b-f09e-488a-bb2a-dd863193206b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:28.903206 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:28.925314 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:28.947998 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8e639-f628-4b3e-95e3-3b08f4e167fb None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:28.988103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b972a-45f9-477a-ac51-f95342fabc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:28.989131 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b972a-45f9-477a-ac51-f95342fabc8f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:28.989645 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b972a-45f9-477a-ac51-f95342fabc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:28.990151 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b972a-45f9-477a-ac51-f95342fabc8f None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:28.991612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b972a-45f9-477a-ac51-f95342fabc8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:28.992125 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b972a-45f9-477a-ac51-f95342fabc8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:28.993713 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b972a-45f9-477a-ac51-f95342fabc8f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:29.006280 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 351/699] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:29.007140 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b186c3b-f09e-488a-bb2a-dd863193206b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:29.007650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b972a-45f9-477a-ac51-f95342fabc8f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:29.044183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95647884-4711-488c-abd3-5ac61b234eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:29.045024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95647884-4711-488c-abd3-5ac61b234eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:29.045333 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95647884-4711-488c-abd3-5ac61b234eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:29.045612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95647884-4711-488c-abd3-5ac61b234eb1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:29.053994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95647884-4711-488c-abd3-5ac61b234eb1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:29.056240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95647884-4711-488c-abd3-5ac61b234eb1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:29.073325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-95647884-4711-488c-abd3-5ac61b234eb1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:11:29.073325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:29.073325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:29.073325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:29.073325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:29.073325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:29.073325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:29.073325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:29.073325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:29.073325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:29.073325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:29.073325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:29.073325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:29.073325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:29.073325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:29.073325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:29.074375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:29.074375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:29.074375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:29.074375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:29.074375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:29.074375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:29.074375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:29.074375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:29.074375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:29.074375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:29.074375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:29.074375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:29.074375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:29.074375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:29.074375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:29.074375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:29.074375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:29.074375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:29.075677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:29.075677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:29.075677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:29.075677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:29.075677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:29.075677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:29.075677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:29.075677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:29.075677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:11:29.075677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:29.075677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 349/700] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jul 20 19:11:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:29.075677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95647884-4711-488c-abd3-5ac61b234eb1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:29.122026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b972a-45f9-477a-ac51-f95342fabc8f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:29.151797 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:29.161425 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37356e1-7839-4628-9395-847963ad8a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:29.163070 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37356e1-7839-4628-9395-847963ad8a3d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:29.163569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37356e1-7839-4628-9395-847963ad8a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:29.164048 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37356e1-7839-4628-9395-847963ad8a3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:29.165073 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37356e1-7839-4628-9395-847963ad8a3d None admin] RBAC: Adding query filter params (role.id=3e2d1ff906b74bec9c7410e3a3ec9448, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=0ebd7c59f0014a3886fa75fb35a40e64) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:29.165591 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37356e1-7839-4628-9395-847963ad8a3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:29.167276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37356e1-7839-4628-9395-847963ad8a3d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:29.174395 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 352/701] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:29 2022] GET /identity/v3/role_assignments?user.id=0ebd7c59f0014a3886fa75fb35a40e64&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=3e2d1ff906b74bec9c7410e3a3ec9448 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:29.175469 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37356e1-7839-4628-9395-847963ad8a3d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:29.180215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:29.192868 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95647884-4711-488c-abd3-5ac61b234eb1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:29.242974 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31929138-37e8-4050-8c32-e4fc939c006e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:29.243683 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31929138-37e8-4050-8c32-e4fc939c006e None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:29.244086 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31929138-37e8-4050-8c32-e4fc939c006e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:29.244511 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31929138-37e8-4050-8c32-e4fc939c006e None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:29.245477 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31929138-37e8-4050-8c32-e4fc939c006e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:29.248001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31929138-37e8-4050-8c32-e4fc939c006e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:29.277456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 350/702] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 20 19:11:29 2022] POST /identity/v3/users => generated 254 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:11:29.305165 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37356e1-7839-4628-9395-847963ad8a3d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:29.354342 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa7e40-a9ed-4104-ac9d-972a635eb3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:29.355549 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa7e40-a9ed-4104-ac9d-972a635eb3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:29.356220 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa7e40-a9ed-4104-ac9d-972a635eb3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:29.356716 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa7e40-a9ed-4104-ac9d-972a635eb3f6 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:29.358173 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa7e40-a9ed-4104-ac9d-972a635eb3f6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:29.358880 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa7e40-a9ed-4104-ac9d-972a635eb3f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:29.360950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa7e40-a9ed-4104-ac9d-972a635eb3f6 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:29.387643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 353/703] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jul 20 19:11:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:29.393214 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31929138-37e8-4050-8c32-e4fc939c006e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:29.541856 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31929138-37e8-4050-8c32-e4fc939c006e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:29.582510 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ecbfb-ce4e-4d54-9d0c-b3fde1b08d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:29.583180 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ecbfb-ce4e-4d54-9d0c-b3fde1b08d33 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:29.583460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ecbfb-ce4e-4d54-9d0c-b3fde1b08d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:29.583731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ecbfb-ce4e-4d54-9d0c-b3fde1b08d33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:29.585997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1111f2-dd38-4918-b0a2-71f350a33294 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:29.586292 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1111f2-dd38-4918-b0a2-71f350a33294 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:29.586591 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1111f2-dd38-4918-b0a2-71f350a33294 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:29.589370 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 354/704] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:29.595061 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76a94c-ddd6-484a-be31-51c8c11242ce None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:29.595357 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76a94c-ddd6-484a-be31-51c8c11242ce None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:29.595617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76a94c-ddd6-484a-be31-51c8c11242ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:29.602620 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:29.616589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5b76a94c-ddd6-484a-be31-51c8c11242ce None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:29.618155 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5b76a94c-ddd6-484a-be31-51c8c11242ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:29.671335 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ecbfb-ce4e-4d54-9d0c-b3fde1b08d33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:29.672843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ecbfb-ce4e-4d54-9d0c-b3fde1b08d33 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:29.684731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:29.725552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 355/705] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:11:29.749809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76a94c-ddd6-484a-be31-51c8c11242ce None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:29.813210 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 351/706] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:29.823395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ecbfb-ce4e-4d54-9d0c-b3fde1b08d33 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:29.918964 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76a94c-ddd6-484a-be31-51c8c11242ce None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:29.922432 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:29.966027 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62a457-a6e6-491c-b454-e178300decd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:29.966876 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62a457-a6e6-491c-b454-e178300decd8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:29.967156 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62a457-a6e6-491c-b454-e178300decd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:29.967432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62a457-a6e6-491c-b454-e178300decd8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:29.968091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62a457-a6e6-491c-b454-e178300decd8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:29.969628 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62a457-a6e6-491c-b454-e178300decd8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:29.996403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-ea62a457-a6e6-491c-b454-e178300decd8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:11:29.996403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:29.996403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:11:29.996403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:11:29.996403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:11:29.996403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:11:29.996403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:11:29.996403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:29.996403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:11:29.996403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:29.996403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:11:29.996403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:29.996403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:29.996403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:29.996403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:29.996403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:29.997474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:29.997474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:29.997474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:29.997474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:29.997474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:29.997474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:29.997474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:29.997474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:11:29.997474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:11:29.997474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:11:29.997474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:11:29.997474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:29.997474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:29.997474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:29.997474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:29.997474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:29.998396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:29.998396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:29.998396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:29.998396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:29.998396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:29.998396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:29.998396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:29.998396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:29.998396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:29.998396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:29.998396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:29.998396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:11:29.998396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:29.998396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:11:29.998396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:29.998396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 356/707] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Jul 20 19:11:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:30.005622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62a457-a6e6-491c-b454-e178300decd8 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:30.048290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ecbfb-ce4e-4d54-9d0c-b3fde1b08d33 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:30.083591 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:30.129680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88947486-263c-4819-b93e-0a58fae195d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:30.130569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88947486-263c-4819-b93e-0a58fae195d0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:30.131491 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88947486-263c-4819-b93e-0a58fae195d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:30.131779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88947486-263c-4819-b93e-0a58fae195d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:30.145935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88947486-263c-4819-b93e-0a58fae195d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:30.147545 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88947486-263c-4819-b93e-0a58fae195d0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:30.168794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-88947486-263c-4819-b93e-0a58fae195d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:30.168794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:30.168794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:30.168794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:30.168794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:30.168794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:30.168794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:30.168794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:30.168794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:30.168794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:30.168794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:30.168794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:30.168794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:30.168794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:30.168794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:30.169864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:30.169864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:30.169864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:30.169864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:30.169864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:30.169864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:30.169864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:30.169864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:30.169864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:30.169864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:30.169864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:30.169864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:30.169864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:30.169864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:30.169864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:30.169864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:30.169864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:30.170925 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:30.170925 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:30.170925 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:30.170925 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:30.170925 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 352/708] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:30.176234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88947486-263c-4819-b93e-0a58fae195d0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:30.186129 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62a457-a6e6-491c-b454-e178300decd8 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:30.249927 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd130edb-1cb8-49c1-be05-93a4a9b9788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:30.250928 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd130edb-1cb8-49c1-be05-93a4a9b9788c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:30.251411 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd130edb-1cb8-49c1-be05-93a4a9b9788c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:30.251845 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd130edb-1cb8-49c1-be05-93a4a9b9788c None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:30.252723 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd130edb-1cb8-49c1-be05-93a4a9b9788c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:30.253185 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd130edb-1cb8-49c1-be05-93a4a9b9788c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:30.254824 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd130edb-1cb8-49c1-be05-93a4a9b9788c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:30.272562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 357/709] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jul 20 19:11:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:30.283284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd130edb-1cb8-49c1-be05-93a4a9b9788c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:30.287612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:30.292257 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88947486-263c-4819-b93e-0a58fae195d0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:30.328163 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b2418-a7a2-4cca-befe-7e15f530957b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:30.328838 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b2418-a7a2-4cca-befe-7e15f530957b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:30.329121 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b2418-a7a2-4cca-befe-7e15f530957b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:30.329407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b2418-a7a2-4cca-befe-7e15f530957b None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:30.330202 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b2418-a7a2-4cca-befe-7e15f530957b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:30.330652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b2418-a7a2-4cca-befe-7e15f530957b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:30.332040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b2418-a7a2-4cca-befe-7e15f530957b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:30.345095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 353/710] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:30.350907 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b2418-a7a2-4cca-befe-7e15f530957b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:30.457067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b2418-a7a2-4cca-befe-7e15f530957b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:30.493234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45d16f-5955-45b7-bd24-0cdf9d946b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:30.494029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45d16f-5955-45b7-bd24-0cdf9d946b63 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:30.494397 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45d16f-5955-45b7-bd24-0cdf9d946b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:30.494678 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45d16f-5955-45b7-bd24-0cdf9d946b63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:30.501998 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45d16f-5955-45b7-bd24-0cdf9d946b63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:30.503514 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45d16f-5955-45b7-bd24-0cdf9d946b63 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:30.521793 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-3b45d16f-5955-45b7-bd24-0cdf9d946b63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:30.521793 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:30.521793 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:30.521793 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:30.521793 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:30.521793 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:30.521793 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:30.521793 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:30.521793 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:30.521793 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:30.521793 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:30.521793 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:30.521793 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:30.521793 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:30.521793 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:30.522825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:30.522825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:30.522825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:30.522825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:30.522825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:30.522825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:30.522825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:30.522825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:30.522825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:30.522825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:30.522825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:30.522825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:30.522825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:30.522825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:30.522825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:30.522825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:30.522825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:30.523760 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:30.523760 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:30.523760 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:30.523760 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:30.523760 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:30.523760 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:30.523760 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:30.523760 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:30.524205 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 354/711] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:30.525500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcc113-13df-4777-b848-6afde919226c None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:30.525838 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcc113-13df-4777-b848-6afde919226c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:30.526122 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcc113-13df-4777-b848-6afde919226c None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:30.531876 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 355/712] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:30.532971 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcc113-13df-4777-b848-6afde919226c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:30.557429 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:30.572429 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd130edb-1cb8-49c1-be05-93a4a9b9788c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:30.586650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:30.612757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c254b9-5e46-4e91-98b7-7002155b44c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:30.613825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c254b9-5e46-4e91-98b7-7002155b44c9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:30.614163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c254b9-5e46-4e91-98b7-7002155b44c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:30.614539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c254b9-5e46-4e91-98b7-7002155b44c9 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:30.616181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c254b9-5e46-4e91-98b7-7002155b44c9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:30.616577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c254b9-5e46-4e91-98b7-7002155b44c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:30.619404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c254b9-5e46-4e91-98b7-7002155b44c9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:30.634330 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 358/713] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jul 20 19:11:30 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:30.634330 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963a77f-2eff-4bc8-bc8d-0b5e7c7e8727 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:30.634330 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963a77f-2eff-4bc8-bc8d-0b5e7c7e8727 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:30.634330 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963a77f-2eff-4bc8-bc8d-0b5e7c7e8727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:30.663771 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4963a77f-2eff-4bc8-bc8d-0b5e7c7e8727 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:30.665039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4963a77f-2eff-4bc8-bc8d-0b5e7c7e8727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:30.679882 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcc113-13df-4777-b848-6afde919226c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:30.719800 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc53b8e-8934-4c23-8479-ae5cd2f45b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:30.720533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc53b8e-8934-4c23-8479-ae5cd2f45b42 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:30.720816 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc53b8e-8934-4c23-8479-ae5cd2f45b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:30.721088 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc53b8e-8934-4c23-8479-ae5cd2f45b42 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:30.721893 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc53b8e-8934-4c23-8479-ae5cd2f45b42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:30.722248 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc53b8e-8934-4c23-8479-ae5cd2f45b42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:30.723796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc53b8e-8934-4c23-8479-ae5cd2f45b42 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:30.742718 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 356/714] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:30.744788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc53b8e-8934-4c23-8479-ae5cd2f45b42 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:30.845787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:30.858179 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 359/715] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:30.883085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc53b8e-8934-4c23-8479-ae5cd2f45b42 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:30.889565 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963a77f-2eff-4bc8-bc8d-0b5e7c7e8727 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:30.941895 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f4c28-8438-4857-a923-59725502080e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:30.942706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f4c28-8438-4857-a923-59725502080e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:30.942998 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f4c28-8438-4857-a923-59725502080e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:30.943963 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f4c28-8438-4857-a923-59725502080e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:30.944849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f4c28-8438-4857-a923-59725502080e None admin] RBAC: Adding query filter params (role.id=6322f657162c45ca85f019a408655ff3, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=a1f0f6bc94de4645a8c82038ff2bd34a) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:30.948121 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f4c28-8438-4857-a923-59725502080e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:30.952271 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f4c28-8438-4857-a923-59725502080e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:30.965622 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 357/716] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:30 2022] GET /identity/v3/role_assignments?user.id=a1f0f6bc94de4645a8c82038ff2bd34a&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=6322f657162c45ca85f019a408655ff3 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:31.052093 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963a77f-2eff-4bc8-bc8d-0b5e7c7e8727 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:31.054335 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:31.104475 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2902f-3873-4dd9-ad3f-40c5f62dac31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:31.105311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2902f-3873-4dd9-ad3f-40c5f62dac31 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:31.105604 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2902f-3873-4dd9-ad3f-40c5f62dac31 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:31.105884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2902f-3873-4dd9-ad3f-40c5f62dac31 None admin] PATH_INFO: `/v3/services/network` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:31.106631 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2902f-3873-4dd9-ad3f-40c5f62dac31 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:31.108069 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2902f-3873-4dd9-ad3f-40c5f62dac31 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:31.130416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-77f2902f-3873-4dd9-ad3f-40c5f62dac31 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:11:31.130416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:31.130416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:11:31.130416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:11:31.130416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:11:31.130416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:11:31.130416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:11:31.130416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:31.130416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:11:31.130416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:31.130416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:11:31.130416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:31.130416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:31.130416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:31.130416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:31.130416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:31.130416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:31.131543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:31.131543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:31.131543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:31.131543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:31.131543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:31.131543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:31.131543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:11:31.131543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:11:31.131543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:11:31.131543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:11:31.131543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:31.131543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:31.131543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:31.131543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:31.131543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:31.131543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:31.132387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:31.132387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:31.132387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:31.132387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:31.132387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:31.132387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:31.132387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:31.132387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:31.132387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:31.132387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:31.132387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:11:31.132387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:31.132387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:11:31.132387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:31.132387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 360/717] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:30 2022] GET /identity/v3/services/network => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:31.139779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f4c28-8438-4857-a923-59725502080e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:31.294861 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f4c28-8438-4857-a923-59725502080e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:31.333902 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abea0cc-df26-4cbb-93ff-0a1254110f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:31.334612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abea0cc-df26-4cbb-93ff-0a1254110f9e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:31.334949 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abea0cc-df26-4cbb-93ff-0a1254110f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:31.335233 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abea0cc-df26-4cbb-93ff-0a1254110f9e None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:31.335949 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abea0cc-df26-4cbb-93ff-0a1254110f9e None admin] RBAC: Adding query filter params (name=network) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:31.336254 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abea0cc-df26-4cbb-93ff-0a1254110f9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:31.337638 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abea0cc-df26-4cbb-93ff-0a1254110f9e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:31.343136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 358/718] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 20 19:11:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:31.348554 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2902f-3873-4dd9-ad3f-40c5f62dac31 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:31.516767 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2902f-3873-4dd9-ad3f-40c5f62dac31 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:31.565424 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c8ec2-0fab-4ab2-b21d-269a120f0d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:31.566089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c8ec2-0fab-4ab2-b21d-269a120f0d98 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:31.566427 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c8ec2-0fab-4ab2-b21d-269a120f0d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:31.566709 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c8ec2-0fab-4ab2-b21d-269a120f0d98 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:31.567413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c8ec2-0fab-4ab2-b21d-269a120f0d98 None admin] RBAC: Adding query filter params (type=network) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:31.567715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c8ec2-0fab-4ab2-b21d-269a120f0d98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:31.569790 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c8ec2-0fab-4ab2-b21d-269a120f0d98 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:31.575891 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 361/719] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 20 19:11:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:32.056184 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f986a15-baad-482b-8e01-fd27ca52be75 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:32.057231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f986a15-baad-482b-8e01-fd27ca52be75 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:32.057746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f986a15-baad-482b-8e01-fd27ca52be75 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:32.059600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 359/720] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:32.064778 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6482fb-c841-430c-ab85-f42a1848d47b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:32.065372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6482fb-c841-430c-ab85-f42a1848d47b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:32.065848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6482fb-c841-430c-ab85-f42a1848d47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:32.088246 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2f6482fb-c841-430c-ab85-f42a1848d47b None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:32.089791 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2f6482fb-c841-430c-ab85-f42a1848d47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:32.100908 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946680c2-141e-4bff-a72b-5da744ea9be1 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:32.101231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946680c2-141e-4bff-a72b-5da744ea9be1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:32.101463 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946680c2-141e-4bff-a72b-5da744ea9be1 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:32.103131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 360/721] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:11:32.108572 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd5618-8977-49fc-b770-d99d05e216ba None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:32.108858 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd5618-8977-49fc-b770-d99d05e216ba None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:32.109138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd5618-8977-49fc-b770-d99d05e216ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:32.130457 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:32.142652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f8cd5618-8977-49fc-b770-d99d05e216ba None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:32.143868 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f8cd5618-8977-49fc-b770-d99d05e216ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:32.154460 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:32.233085 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 362/722] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:32.262444 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 361/723] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 19:11:32.278824 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6482fb-c841-430c-ab85-f42a1848d47b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:32.305689 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd5618-8977-49fc-b770-d99d05e216ba None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:32.402959 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6482fb-c841-430c-ab85-f42a1848d47b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:32.425322 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd5618-8977-49fc-b770-d99d05e216ba None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:32.459409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92632951-49a4-44ce-b2dd-b35b8e924b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:32.460841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92632951-49a4-44ce-b2dd-b35b8e924b21 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:32.461309 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92632951-49a4-44ce-b2dd-b35b8e924b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:32.461761 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92632951-49a4-44ce-b2dd-b35b8e924b21 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:32.479206 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92632951-49a4-44ce-b2dd-b35b8e924b21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:32.483963 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed768e1-4cc3-4056-ae00-58425515c845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:32.484789 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed768e1-4cc3-4056-ae00-58425515c845 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:32.485078 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed768e1-4cc3-4056-ae00-58425515c845 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:32.485355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed768e1-4cc3-4056-ae00-58425515c845 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:32.487831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-92632951-49a4-44ce-b2dd-b35b8e924b21 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:32.487831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:32.487831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:32.487831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:32.487831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:32.487831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:32.487831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:32.487831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:32.487831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:32.487831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:32.487831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:32.487831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:32.487831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:32.487831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:32.487831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:32.487831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:32.488852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:32.488852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:32.488852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:32.488852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:32.488852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:32.488852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:32.488852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:32.488852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:32.488852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:32.488852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:32.488852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:32.488852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:32.488852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:32.488852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:32.488852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:32.488852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:32.490939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:32.490939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:32.490939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:32.490939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:32.490939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:32.490939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:32.490939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:32.490939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:32.490939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:32.490939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:32.490939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:32.490939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:32.490939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 363/724] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:32.493596 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:32.501761 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92632951-49a4-44ce-b2dd-b35b8e924b21 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:32.512643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed768e1-4cc3-4056-ae00-58425515c845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:32.526327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-5ed768e1-4cc3-4056-ae00-58425515c845 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:32.526327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:32.526327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:32.526327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:32.526327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:32.526327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:32.526327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:32.526327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:32.526327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:32.526327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:32.526327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:32.526327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:32.526327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:32.526327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:32.526327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:32.526327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:32.527403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:32.527403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:32.527403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:32.527403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:32.527403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:32.527403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:32.527403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:32.527403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:32.527403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:32.527403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:32.527403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:32.527403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:32.527403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:32.527403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:32.527403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:32.527403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:32.528355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:32.528355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:32.528355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:32.528355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:32.528355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:32.528355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:32.528355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:32.528355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:32.528355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:32.528355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:32.528355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:32.528355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:32.535239 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 362/725] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:11:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:32.535918 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:32.549954 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed768e1-4cc3-4056-ae00-58425515c845 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:32.621769 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92632951-49a4-44ce-b2dd-b35b8e924b21 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:32.700015 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd6586-5e9b-4b46-828d-8c040dda720a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:32.701129 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd6586-5e9b-4b46-828d-8c040dda720a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:32.702936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd6586-5e9b-4b46-828d-8c040dda720a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:32.704882 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd6586-5e9b-4b46-828d-8c040dda720a None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:32.705874 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd6586-5e9b-4b46-828d-8c040dda720a None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:32.707300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd6586-5e9b-4b46-828d-8c040dda720a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:32.708965 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd6586-5e9b-4b46-828d-8c040dda720a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:32.732959 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 364/726] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:32.738611 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd6586-5e9b-4b46-828d-8c040dda720a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:32.799583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed768e1-4cc3-4056-ae00-58425515c845 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:32.875327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae8e27-8511-4ef8-81c0-34e4c97ca175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:32.876530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae8e27-8511-4ef8-81c0-34e4c97ca175 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:32.877813 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae8e27-8511-4ef8-81c0-34e4c97ca175 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:32.878884 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae8e27-8511-4ef8-81c0-34e4c97ca175 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:32.880026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae8e27-8511-4ef8-81c0-34e4c97ca175 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:32.886323 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae8e27-8511-4ef8-81c0-34e4c97ca175 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:32.886323 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae8e27-8511-4ef8-81c0-34e4c97ca175 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:32.904043 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 363/727] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:32.906839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae8e27-8511-4ef8-81c0-34e4c97ca175 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:32.934331 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:32.977281 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd6586-5e9b-4b46-828d-8c040dda720a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:33.012132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:33.046481 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f89bd1-a407-4d0d-9fa2-db21893d2703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:33.047293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f89bd1-a407-4d0d-9fa2-db21893d2703 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:33.047574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f89bd1-a407-4d0d-9fa2-db21893d2703 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:33.047844 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f89bd1-a407-4d0d-9fa2-db21893d2703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:33.065319 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f89bd1-a407-4d0d-9fa2-db21893d2703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:33.066831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f89bd1-a407-4d0d-9fa2-db21893d2703 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:33.089627 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae8e27-8511-4ef8-81c0-34e4c97ca175 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:33.092582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-83f89bd1-a407-4d0d-9fa2-db21893d2703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:33.092582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:33.092582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:33.092582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:33.092582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:33.092582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:33.092582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:33.092582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:33.092582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:33.092582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:33.092582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:33.092582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:33.092582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:33.092582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:33.092582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:33.093516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:33.093516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:33.093516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:33.093516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:33.093516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:33.093516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:33.093516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:33.093516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:33.093516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:33.093516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:33.093516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:33.093516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:33.093516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:33.093516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:33.093516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:33.093516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:33.093516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:33.094479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:33.094479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:33.094479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:33.094479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:33.094479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 365/728] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:33.100839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f89bd1-a407-4d0d-9fa2-db21893d2703 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:33.142894 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f7c4a-fc1e-4a8c-8a91-338f7297f010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:33.144048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f7c4a-fc1e-4a8c-8a91-338f7297f010 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:33.144486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f7c4a-fc1e-4a8c-8a91-338f7297f010 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:33.144972 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f7c4a-fc1e-4a8c-8a91-338f7297f010 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:33.172064 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f7c4a-fc1e-4a8c-8a91-338f7297f010 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:33.173789 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f7c4a-fc1e-4a8c-8a91-338f7297f010 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:33.210006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8f2f7c4a-fc1e-4a8c-8a91-338f7297f010 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:33.210006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:33.210006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:33.210006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:33.210006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:33.210006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:33.210006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:33.210006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:33.210006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:33.210006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:33.210006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:33.210006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:33.210006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:33.210006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:33.210006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:33.211231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:33.211231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:33.211231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:33.211231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:33.211231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:33.211231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:33.211231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:33.211231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:33.211231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:33.211231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:33.211231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:33.211231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:33.211231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:33.211231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:33.211231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:33.211231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:33.211231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:33.212373 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:33.212373 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:33.212373 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:33.212373 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:33.214784 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 364/729] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:33.220974 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f7c4a-fc1e-4a8c-8a91-338f7297f010 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:33.317053 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f89bd1-a407-4d0d-9fa2-db21893d2703 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:33.355194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a17bb2-ef2b-44e8-9359-759112053a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:33.355881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a17bb2-ef2b-44e8-9359-759112053a7f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:33.356169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a17bb2-ef2b-44e8-9359-759112053a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:33.356448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a17bb2-ef2b-44e8-9359-759112053a7f None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:33.357191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a17bb2-ef2b-44e8-9359-759112053a7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:33.357504 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a17bb2-ef2b-44e8-9359-759112053a7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:33.359008 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a17bb2-ef2b-44e8-9359-759112053a7f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:33.360748 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:33.373489 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 366/730] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:33.375026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cfafe-7b0e-489b-9b43-e9f2050a2968 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:33.375324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cfafe-7b0e-489b-9b43-e9f2050a2968 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:33.375601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cfafe-7b0e-489b-9b43-e9f2050a2968 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:33.381749 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 367/731] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:33.382844 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cfafe-7b0e-489b-9b43-e9f2050a2968 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:33.497214 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f7c4a-fc1e-4a8c-8a91-338f7297f010 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:33.503562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cfafe-7b0e-489b-9b43-e9f2050a2968 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:33.510219 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:33.539439 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9e3b7-d5c4-4ddb-b4ab-98a1f1dd2cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:33.540308 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9e3b7-d5c4-4ddb-b4ab-98a1f1dd2cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:33.540667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9e3b7-d5c4-4ddb-b4ab-98a1f1dd2cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:33.541011 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9e3b7-d5c4-4ddb-b4ab-98a1f1dd2cd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:33.541972 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9e3b7-d5c4-4ddb-b4ab-98a1f1dd2cd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:33.542380 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9e3b7-d5c4-4ddb-b4ab-98a1f1dd2cd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:33.543812 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9e3b7-d5c4-4ddb-b4ab-98a1f1dd2cd4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:33.550225 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01419c1e-41b3-45d6-8dd9-aa19bc1cd7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:33.551460 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01419c1e-41b3-45d6-8dd9-aa19bc1cd7d0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:33.551952 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01419c1e-41b3-45d6-8dd9-aa19bc1cd7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:33.552478 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01419c1e-41b3-45d6-8dd9-aa19bc1cd7d0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:33.559809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 365/732] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:33.561232 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d4c98-376e-496d-afe5-cb9f71dca34a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:33.561522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d4c98-376e-496d-afe5-cb9f71dca34a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:33.561802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d4c98-376e-496d-afe5-cb9f71dca34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:33.562689 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01419c1e-41b3-45d6-8dd9-aa19bc1cd7d0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:33.564947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01419c1e-41b3-45d6-8dd9-aa19bc1cd7d0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:33.580567 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a52d4c98-376e-496d-afe5-cb9f71dca34a None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:33.581689 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a52d4c98-376e-496d-afe5-cb9f71dca34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:33.590103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-01419c1e-41b3-45d6-8dd9-aa19bc1cd7d0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:11:33.590103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:33.590103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:33.590103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:33.590103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:33.590103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:33.590103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:33.590103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:33.590103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:33.590103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:33.590103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:33.590103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:33.590103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:33.590103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:33.590103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:33.590103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:33.591172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:33.591172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:33.591172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:33.591172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:33.591172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:33.591172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:33.591172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:33.591172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:33.591172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:33.591172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:33.591172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:33.591172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:33.591172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:33.591172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:33.591172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:33.591172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:33.591172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:33.591172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:33.592180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:33.592180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:33.592180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:33.592180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:33.592180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:33.592180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:33.592180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:33.592180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:33.592180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:11:33.592180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:33.595080 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 368/733] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jul 20 19:11:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:33.596110 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01419c1e-41b3-45d6-8dd9-aa19bc1cd7d0 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:33.656620 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 366/734] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:33.657481 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d4c98-376e-496d-afe5-cb9f71dca34a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:33.660484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:33.709422 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01419c1e-41b3-45d6-8dd9-aa19bc1cd7d0 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:33.744298 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc625d-39e9-4fda-8157-8f2e014671dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:33.745100 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc625d-39e9-4fda-8157-8f2e014671dd None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:33.745382 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc625d-39e9-4fda-8157-8f2e014671dd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:33.745652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc625d-39e9-4fda-8157-8f2e014671dd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:33.753114 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc625d-39e9-4fda-8157-8f2e014671dd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:33.754617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc625d-39e9-4fda-8157-8f2e014671dd None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:33.767343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:33.770182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-7bbc625d-39e9-4fda-8157-8f2e014671dd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:11:33.770182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:33.770182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:33.770182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:33.770182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:33.770182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:33.770182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:33.770182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:33.770182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:33.770182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:33.770182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:33.770182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:33.770182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:33.770182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:33.770182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:33.770182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:33.771316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:33.771316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:33.771316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:33.771316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:33.771316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:33.771316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:33.771316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:33.771316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:33.771316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:33.771316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:33.771316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:33.771316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:33.771316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:33.771316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:33.771316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:33.771316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:33.771316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:33.771316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:33.772281 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:33.772281 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:33.772281 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:33.772281 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:33.772281 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:33.772281 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:33.772281 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:33.772281 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:33.772281 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:11:33.772281 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:33.772827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d4c98-376e-496d-afe5-cb9f71dca34a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:33.776185 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 369/735] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:11:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:33.777425 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b64ef9-89d2-4472-ba5e-7ecad342098f None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:33.777712 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b64ef9-89d2-4472-ba5e-7ecad342098f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:33.777989 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b64ef9-89d2-4472-ba5e-7ecad342098f None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:33.779507 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 370/736] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:33.784092 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b64ef9-89d2-4472-ba5e-7ecad342098f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:33.812407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ff1eb-e85b-4df4-90bd-ad1981309b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:33.813185 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ff1eb-e85b-4df4-90bd-ad1981309b68 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:33.813467 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ff1eb-e85b-4df4-90bd-ad1981309b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:33.813854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ff1eb-e85b-4df4-90bd-ad1981309b68 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:33.814739 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ff1eb-e85b-4df4-90bd-ad1981309b68 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:33.815054 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ff1eb-e85b-4df4-90bd-ad1981309b68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:33.816593 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ff1eb-e85b-4df4-90bd-ad1981309b68 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:33.840501 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 367/737] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jul 20 19:11:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:33.840501 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ff1eb-e85b-4df4-90bd-ad1981309b68 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:33.904534 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b64ef9-89d2-4472-ba5e-7ecad342098f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:33.921115 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:33.947424 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b8d74-80a9-46ed-9153-a13127bcabf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:33.948152 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b8d74-80a9-46ed-9153-a13127bcabf9 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:33.948492 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b8d74-80a9-46ed-9153-a13127bcabf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:33.948814 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b8d74-80a9-46ed-9153-a13127bcabf9 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:33.949780 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b8d74-80a9-46ed-9153-a13127bcabf9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:33.951921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b8d74-80a9-46ed-9153-a13127bcabf9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:33.956942 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ff1eb-e85b-4df4-90bd-ad1981309b68 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:33.971595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 371/738] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 20 19:11:33 2022] POST /identity/v3/services => generated 251 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:11:33.973250 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1a9ef-241e-4687-99d7-b5d58191b6f0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:33.973544 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1a9ef-241e-4687-99d7-b5d58191b6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:33.973826 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1a9ef-241e-4687-99d7-b5d58191b6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:33.995094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-76e1a9ef-241e-4687-99d7-b5d58191b6f0 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:33.996447 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-76e1a9ef-241e-4687-99d7-b5d58191b6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:34.037785 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e7507-6331-4d8a-9eed-4786c69c56a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:34.039181 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e7507-6331-4d8a-9eed-4786c69c56a2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:34.039763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e7507-6331-4d8a-9eed-4786c69c56a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:34.040309 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e7507-6331-4d8a-9eed-4786c69c56a2 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:34.041713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e7507-6331-4d8a-9eed-4786c69c56a2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:34.042213 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e7507-6331-4d8a-9eed-4786c69c56a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:34.044488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e7507-6331-4d8a-9eed-4786c69c56a2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:34.071677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 368/739] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jul 20 19:11:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:34.072551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e7507-6331-4d8a-9eed-4786c69c56a2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:34.095590 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 372/740] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:34.096578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1a9ef-241e-4687-99d7-b5d58191b6f0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:34.097413 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:34.224728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e7507-6331-4d8a-9eed-4786c69c56a2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:34.242724 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1a9ef-241e-4687-99d7-b5d58191b6f0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:34.246709 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:34.261301 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61dbc5-e2a1-413b-9815-21f16246472e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:34.261909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61dbc5-e2a1-413b-9815-21f16246472e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:34.262186 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61dbc5-e2a1-413b-9815-21f16246472e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:34.262489 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61dbc5-e2a1-413b-9815-21f16246472e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:34.288610 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf2b98-deac-47d9-bc33-af9e5b3533fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:34.289351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf2b98-deac-47d9-bc33-af9e5b3533fc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:34.289699 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf2b98-deac-47d9-bc33-af9e5b3533fc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:34.289979 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf2b98-deac-47d9-bc33-af9e5b3533fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:34.337388 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61dbc5-e2a1-413b-9815-21f16246472e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:34.338903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61dbc5-e2a1-413b-9815-21f16246472e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:34.354616 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:34.367669 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf2b98-deac-47d9-bc33-af9e5b3533fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:34.369265 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf2b98-deac-47d9-bc33-af9e5b3533fc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:34.474610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 369/741] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:34 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:34.474610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec5276-272f-4cd2-93d6-4c780fe082cc None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:34.474610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec5276-272f-4cd2-93d6-4c780fe082cc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:34.474610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec5276-272f-4cd2-93d6-4c780fe082cc None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:34.474610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 370/742] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:34.474610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec5276-272f-4cd2-93d6-4c780fe082cc None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:34.486265 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 373/743] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:34 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 19:11:34.488067 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95c5a8-be59-456c-9392-6fc18b0e48e5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:34.488579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95c5a8-be59-456c-9392-6fc18b0e48e5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:34.489070 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95c5a8-be59-456c-9392-6fc18b0e48e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:34.496686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:34.508934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4b95c5a8-be59-456c-9392-6fc18b0e48e5 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:34.510174 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4b95c5a8-be59-456c-9392-6fc18b0e48e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:34.610408 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 374/744] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 19:11:34.610408 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95c5a8-be59-456c-9392-6fc18b0e48e5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:34.627443 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec5276-272f-4cd2-93d6-4c780fe082cc None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:34.643747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:34.672192 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d007f2a-3968-442f-8c32-941772e1c2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:34.673238 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d007f2a-3968-442f-8c32-941772e1c2dc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:34.673525 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d007f2a-3968-442f-8c32-941772e1c2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:34.673803 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d007f2a-3968-442f-8c32-941772e1c2dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:34.691057 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d007f2a-3968-442f-8c32-941772e1c2dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:34.705497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-8d007f2a-3968-442f-8c32-941772e1c2dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:34.705497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:34.705497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:34.705497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:34.705497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:34.705497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:34.705497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:34.705497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:34.705497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:34.705497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:34.705497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:34.705497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:34.705497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:34.705497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:34.705497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:34.705497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:34.706721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:34.706721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:34.706721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:34.706721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:34.706721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:34.706721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:34.706721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:34.706721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:34.706721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:34.706721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:34.706721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:34.706721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:34.706721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:34.706721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:34.706721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:34.706721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:34.707589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:34.707589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:34.707589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:34.707589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:34.707589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:34.707589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:34.707589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:34.707589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:34.707589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:34.707589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:34.707589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:34.707589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:34.714769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 371/745] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:11:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:34.715744 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d007f2a-3968-442f-8c32-941772e1c2dc None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:34.732371 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95c5a8-be59-456c-9392-6fc18b0e48e5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:34.780485 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795cd26-d437-4553-94be-7be78297860c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:34.781398 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795cd26-d437-4553-94be-7be78297860c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:34.781677 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795cd26-d437-4553-94be-7be78297860c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:34.781953 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795cd26-d437-4553-94be-7be78297860c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:34.784609 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:34.798265 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795cd26-d437-4553-94be-7be78297860c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:34.799768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795cd26-d437-4553-94be-7be78297860c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:34.820026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-9795cd26-d437-4553-94be-7be78297860c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:34.820026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:34.820026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:34.820026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:34.820026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:34.820026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:34.820026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:34.820026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:34.820026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:34.820026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:34.820026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:34.820026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:34.820026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:34.820026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:34.820026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:34.821090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:34.821090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:34.821090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:34.821090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:34.821090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:34.821090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:34.821090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:34.821090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:34.821090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:34.821090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:34.821090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:34.821090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:34.821090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:34.821090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:34.821090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:34.821090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:34.821090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:34.822016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:34.822016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:34.822016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:34.822016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:34.822016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 375/746] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:34.822016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795cd26-d437-4553-94be-7be78297860c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:34.844421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d007f2a-3968-442f-8c32-941772e1c2dc None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:34.896647 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f457eb-3035-4b4a-a5b8-6f07d991f874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:34.897460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f457eb-3035-4b4a-a5b8-6f07d991f874 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:34.897746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f457eb-3035-4b4a-a5b8-6f07d991f874 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:34.898059 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f457eb-3035-4b4a-a5b8-6f07d991f874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:34.912546 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f457eb-3035-4b4a-a5b8-6f07d991f874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:34.914153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f457eb-3035-4b4a-a5b8-6f07d991f874 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:34.932608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-40f457eb-3035-4b4a-a5b8-6f07d991f874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:34.932608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:34.932608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:34.932608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:34.932608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:34.932608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:34.932608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:34.932608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:34.932608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:34.932608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:34.932608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:34.932608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:34.932608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:34.932608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:34.932608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:34.933730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:34.933730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:34.933730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:34.933730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:34.933730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:34.933730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:34.933730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:34.933730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:34.933730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:34.933730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:34.933730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:34.933730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:34.933730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:34.933730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:34.933730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:34.933730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:34.933730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:34.934679 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:34.934679 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:34.934679 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:34.934679 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:34.934679 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 372/747] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:34.935635 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f457eb-3035-4b4a-a5b8-6f07d991f874 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:34.960753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795cd26-d437-4553-94be-7be78297860c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:34.968981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:35.006876 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7875c1-0702-4eef-a0e6-6e1ed72d6cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:35.007684 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7875c1-0702-4eef-a0e6-6e1ed72d6cfb None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:35.007993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7875c1-0702-4eef-a0e6-6e1ed72d6cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:35.008272 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7875c1-0702-4eef-a0e6-6e1ed72d6cfb None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:35.009009 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7875c1-0702-4eef-a0e6-6e1ed72d6cfb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:35.010419 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7875c1-0702-4eef-a0e6-6e1ed72d6cfb None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:35.035381 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 376/748] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 20 19:11:34 2022] POST /identity/v3/services => generated 240 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:11:35.036036 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7875c1-0702-4eef-a0e6-6e1ed72d6cfb None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:35.076742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f457eb-3035-4b4a-a5b8-6f07d991f874 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:35.130770 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111b1e8-e2dd-4d9a-b84e-d055fc19e2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:35.131630 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111b1e8-e2dd-4d9a-b84e-d055fc19e2eb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:35.132014 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111b1e8-e2dd-4d9a-b84e-d055fc19e2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:35.132368 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111b1e8-e2dd-4d9a-b84e-d055fc19e2eb None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:35.133252 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111b1e8-e2dd-4d9a-b84e-d055fc19e2eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:35.133660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111b1e8-e2dd-4d9a-b84e-d055fc19e2eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:35.135290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111b1e8-e2dd-4d9a-b84e-d055fc19e2eb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:35.135868 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:35.158509 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 373/749] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:35.158509 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111b1e8-e2dd-4d9a-b84e-d055fc19e2eb None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:35.223000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7875c1-0702-4eef-a0e6-6e1ed72d6cfb None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:35.267880 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d404f1-b463-4007-9208-3bc8644d1d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:35.267880 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d404f1-b463-4007-9208-3bc8644d1d14 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:35.267880 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d404f1-b463-4007-9208-3bc8644d1d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:35.267880 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d404f1-b463-4007-9208-3bc8644d1d14 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:35.269151 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d404f1-b463-4007-9208-3bc8644d1d14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:35.269151 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d404f1-b463-4007-9208-3bc8644d1d14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:35.272092 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d404f1-b463-4007-9208-3bc8644d1d14 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:35.278602 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:35.288826 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 377/750] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:35.289565 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d404f1-b463-4007-9208-3bc8644d1d14 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:35.311160 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111b1e8-e2dd-4d9a-b84e-d055fc19e2eb None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:35.358694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae87a4f-8e49-4655-8ea2-5539d5b50760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:35.359452 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae87a4f-8e49-4655-8ea2-5539d5b50760 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:35.359743 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae87a4f-8e49-4655-8ea2-5539d5b50760 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:35.360061 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae87a4f-8e49-4655-8ea2-5539d5b50760 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:35.361111 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae87a4f-8e49-4655-8ea2-5539d5b50760 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:35.361499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae87a4f-8e49-4655-8ea2-5539d5b50760 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:35.363073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae87a4f-8e49-4655-8ea2-5539d5b50760 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:35.377668 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 374/751] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:35.378852 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae87a4f-8e49-4655-8ea2-5539d5b50760 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:35.427141 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d404f1-b463-4007-9208-3bc8644d1d14 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:35.437804 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:35.475743 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a2717-01dd-48be-aeb0-c4bbea535e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:35.476946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a2717-01dd-48be-aeb0-c4bbea535e07 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:35.477913 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a2717-01dd-48be-aeb0-c4bbea535e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:35.478409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a2717-01dd-48be-aeb0-c4bbea535e07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:35.494053 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a2717-01dd-48be-aeb0-c4bbea535e07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:35.496427 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a2717-01dd-48be-aeb0-c4bbea535e07 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:35.504751 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae87a4f-8e49-4655-8ea2-5539d5b50760 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:35.523473 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-129a2717-01dd-48be-aeb0-c4bbea535e07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:35.523473 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:35.523473 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:35.523473 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:35.523473 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:35.523473 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:35.523473 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:35.523473 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:35.523473 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:35.523473 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:35.523473 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:35.523473 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:35.523473 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:35.523473 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:35.523473 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:35.524729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:35.524729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:35.524729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:35.524729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:35.524729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:35.524729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:35.524729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:35.524729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:35.524729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:35.524729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:35.524729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:35.524729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:35.524729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:35.524729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:35.524729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:35.524729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:35.524729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:35.525641 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:35.525641 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:35.525641 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:35.525641 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:35.528089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 378/752] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:35.529445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a2717-01dd-48be-aeb0-c4bbea535e07 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:35.563997 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e804813-130b-41a5-8f08-2cd8217bcc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:35.565032 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e804813-130b-41a5-8f08-2cd8217bcc9c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:35.565536 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e804813-130b-41a5-8f08-2cd8217bcc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:35.565914 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e804813-130b-41a5-8f08-2cd8217bcc9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:35.575982 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e804813-130b-41a5-8f08-2cd8217bcc9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:35.583510 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e804813-130b-41a5-8f08-2cd8217bcc9c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:35.601106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-6e804813-130b-41a5-8f08-2cd8217bcc9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:35.601106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:35.601106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:35.601106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:35.601106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:35.601106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:35.601106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:35.601106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:35.601106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:35.601106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:35.601106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:35.601106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:35.601106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:35.601106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:35.601106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:35.602290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:35.602290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:35.602290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:35.602290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:35.602290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:35.602290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:35.602290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:35.602290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:35.602290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:35.602290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:35.602290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:35.602290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:35.602290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:35.602290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:35.602290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:35.602290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:35.602290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:35.603461 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:35.603461 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:35.603461 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:35.603461 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:35.603461 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:35.603461 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:35.603461 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:35.603461 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:35.605277 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 375/753] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:35.606821 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e804813-130b-41a5-8f08-2cd8217bcc9c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:35.609834 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:35.679046 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a2717-01dd-48be-aeb0-c4bbea535e07 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:35.729388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3d94f-0ffb-42db-ad23-fec999ad8383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:35.729999 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e804813-130b-41a5-8f08-2cd8217bcc9c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:35.730832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3d94f-0ffb-42db-ad23-fec999ad8383 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:35.731321 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3d94f-0ffb-42db-ad23-fec999ad8383 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:35.732146 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3d94f-0ffb-42db-ad23-fec999ad8383 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:35.742367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3d94f-0ffb-42db-ad23-fec999ad8383 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:35.745107 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3d94f-0ffb-42db-ad23-fec999ad8383 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:35.765799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-45a3d94f-0ffb-42db-ad23-fec999ad8383 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:35.765799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:35.765799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:35.765799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:35.765799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:35.765799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:35.765799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:35.765799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:35.765799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:35.765799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:35.765799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:35.765799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:35.765799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:35.765799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:35.765799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:35.766841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:35.766841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:35.766841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:35.766841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:35.766841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:35.766841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:35.766841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:35.766841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:35.766841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:35.766841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:35.766841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:35.766841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:35.766841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:35.766841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:35.766841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:35.766841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:35.766841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:35.767827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:35.767827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:35.767827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:35.767827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:35.767827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:35.767827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:35.767827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:35.767827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:35.769503 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5619a-bd7b-435e-b8f1-864a93f8ecf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:35.770173 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 379/754] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:35.770438 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5619a-bd7b-435e-b8f1-864a93f8ecf1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:35.770825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5619a-bd7b-435e-b8f1-864a93f8ecf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:35.771846 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5619a-bd7b-435e-b8f1-864a93f8ecf1 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:35.772355 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3d94f-0ffb-42db-ad23-fec999ad8383 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:35.772785 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5619a-bd7b-435e-b8f1-864a93f8ecf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:35.773194 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5619a-bd7b-435e-b8f1-864a93f8ecf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:35.774826 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5619a-bd7b-435e-b8f1-864a93f8ecf1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:35.788945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 376/755] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:35.790035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5619a-bd7b-435e-b8f1-864a93f8ecf1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:35.803646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:35.859071 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:35.905125 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5619a-bd7b-435e-b8f1-864a93f8ecf1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:35.929174 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3d94f-0ffb-42db-ad23-fec999ad8383 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:35.949452 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d46e9-1ebf-46fb-8962-bbd5246f77a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:35.950321 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d46e9-1ebf-46fb-8962-bbd5246f77a3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:35.950732 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d46e9-1ebf-46fb-8962-bbd5246f77a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:35.951110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d46e9-1ebf-46fb-8962-bbd5246f77a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:35.952014 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d46e9-1ebf-46fb-8962-bbd5246f77a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:35.952492 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d46e9-1ebf-46fb-8962-bbd5246f77a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:35.953959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d46e9-1ebf-46fb-8962-bbd5246f77a3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:35.967601 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 377/756] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:35.968695 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d46e9-1ebf-46fb-8962-bbd5246f77a3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:35.980516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e116bd-e92b-4ca6-8119-1442bd21c03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:35.981952 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e116bd-e92b-4ca6-8119-1442bd21c03d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:35.982497 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e116bd-e92b-4ca6-8119-1442bd21c03d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:35.982944 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e116bd-e92b-4ca6-8119-1442bd21c03d None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:35.984310 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e116bd-e92b-4ca6-8119-1442bd21c03d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:35.985068 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e116bd-e92b-4ca6-8119-1442bd21c03d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:35.987021 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e116bd-e92b-4ca6-8119-1442bd21c03d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:36.004172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 380/757] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:36.006002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e116bd-e92b-4ca6-8119-1442bd21c03d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:36.088799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:36.107181 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d46e9-1ebf-46fb-8962-bbd5246f77a3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:36.112486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e116bd-e92b-4ca6-8119-1442bd21c03d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:36.147600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:36.150359 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493ab71-019c-4b24-924a-31f5220e4e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:36.151332 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493ab71-019c-4b24-924a-31f5220e4e63 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:36.151821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493ab71-019c-4b24-924a-31f5220e4e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:36.152301 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493ab71-019c-4b24-924a-31f5220e4e63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:36.153336 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493ab71-019c-4b24-924a-31f5220e4e63 None admin] RBAC: Adding query filter params (role.id=6322f657162c45ca85f019a408655ff3, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=0ebd7c59f0014a3886fa75fb35a40e64) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:36.153893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493ab71-019c-4b24-924a-31f5220e4e63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:36.155591 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493ab71-019c-4b24-924a-31f5220e4e63 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:36.162214 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffc122-a2ae-4bf7-8f21-76d858796bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:36.163148 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffc122-a2ae-4bf7-8f21-76d858796bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:36.163355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffc122-a2ae-4bf7-8f21-76d858796bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:36.163578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 381/758] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:36 2022] GET /identity/v3/role_assignments?user.id=0ebd7c59f0014a3886fa75fb35a40e64&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=6322f657162c45ca85f019a408655ff3 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:36.163683 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffc122-a2ae-4bf7-8f21-76d858796bb5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:36.164967 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493ab71-019c-4b24-924a-31f5220e4e63 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:36.173933 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffc122-a2ae-4bf7-8f21-76d858796bb5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:36.175661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffc122-a2ae-4bf7-8f21-76d858796bb5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:36.193458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a0ffc122-a2ae-4bf7-8f21-76d858796bb5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:11:36.193458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:36.193458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:36.193458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:36.193458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:36.193458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:36.193458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:36.193458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:36.193458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:36.193458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:36.193458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:36.193458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:36.193458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:36.193458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:36.193458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:36.193458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:36.194505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:36.194505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:36.194505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:36.194505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:36.194505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:36.194505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:36.194505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:36.194505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:36.194505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:36.194505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:36.194505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:36.194505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:36.194505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:36.194505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:36.194505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:36.194505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:36.194505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:36.194505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:36.200499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:36.200499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:36.200499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:36.200499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:36.200499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:36.200499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:36.200499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:36.200499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:36.200499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:11:36.200499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:36.200499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 378/759] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jul 20 19:11:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:36.204298 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffc122-a2ae-4bf7-8f21-76d858796bb5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:36.319151 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493ab71-019c-4b24-924a-31f5220e4e63 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:36.345076 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffc122-a2ae-4bf7-8f21-76d858796bb5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:36.368474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d98bf-0ee6-49a2-b15a-c9252555f717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:36.369421 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d98bf-0ee6-49a2-b15a-c9252555f717 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:36.369704 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d98bf-0ee6-49a2-b15a-c9252555f717 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:36.370093 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d98bf-0ee6-49a2-b15a-c9252555f717 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:36.371163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d98bf-0ee6-49a2-b15a-c9252555f717 None admin] RBAC: Adding query filter params (role.id=3e2d1ff906b74bec9c7410e3a3ec9448, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=e78792e617d84a7cbb384ed764c391fb) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:36.371821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d98bf-0ee6-49a2-b15a-c9252555f717 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:36.373417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d98bf-0ee6-49a2-b15a-c9252555f717 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:36.382445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 382/760] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:36 2022] GET /identity/v3/role_assignments?user.id=e78792e617d84a7cbb384ed764c391fb&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=3e2d1ff906b74bec9c7410e3a3ec9448 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:36.383849 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f570b-6688-4617-94f4-ac6228ad14fd None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:36.384142 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f570b-6688-4617-94f4-ac6228ad14fd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:36.384424 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f570b-6688-4617-94f4-ac6228ad14fd None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:36.386116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 383/761] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:36.395388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938ada5-ed1b-4c9d-8060-4d0a265edbbc None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:36.395742 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938ada5-ed1b-4c9d-8060-4d0a265edbbc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:36.395999 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938ada5-ed1b-4c9d-8060-4d0a265edbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:36.405644 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819e198-2623-4ed2-b1b7-be2742ca7f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:36.406800 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819e198-2623-4ed2-b1b7-be2742ca7f29 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:36.414454 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819e198-2623-4ed2-b1b7-be2742ca7f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:36.414929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:36.415098 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819e198-2623-4ed2-b1b7-be2742ca7f29 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:36.416110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819e198-2623-4ed2-b1b7-be2742ca7f29 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:36.416328 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819e198-2623-4ed2-b1b7-be2742ca7f29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:36.422331 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819e198-2623-4ed2-b1b7-be2742ca7f29 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:36.435959 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1938ada5-ed1b-4c9d-8060-4d0a265edbbc None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:36.437216 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1938ada5-ed1b-4c9d-8060-4d0a265edbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:36.454213 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 379/762] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jul 20 19:11:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:36.459754 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819e198-2623-4ed2-b1b7-be2742ca7f29 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:36.540641 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 384/763] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:11:36.553185 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:36.573196 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938ada5-ed1b-4c9d-8060-4d0a265edbbc None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:36.656589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819e198-2623-4ed2-b1b7-be2742ca7f29 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:36.731328 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb7c39-db4e-4fc8-bbd5-b67a19abb53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:36.732150 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb7c39-db4e-4fc8-bbd5-b67a19abb53b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:36.732427 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb7c39-db4e-4fc8-bbd5-b67a19abb53b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:36.732695 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb7c39-db4e-4fc8-bbd5-b67a19abb53b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:36.736790 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938ada5-ed1b-4c9d-8060-4d0a265edbbc None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:36.763211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb7c39-db4e-4fc8-bbd5-b67a19abb53b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:36.764662 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb7c39-db4e-4fc8-bbd5-b67a19abb53b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:36.776007 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fbc2d-15a6-47eb-8b1a-3748c054bf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:36.777505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fbc2d-15a6-47eb-8b1a-3748c054bf9e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:36.777860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fbc2d-15a6-47eb-8b1a-3748c054bf9e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:36.778141 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fbc2d-15a6-47eb-8b1a-3748c054bf9e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:36.778835 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fbc2d-15a6-47eb-8b1a-3748c054bf9e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:36.780782 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fbc2d-15a6-47eb-8b1a-3748c054bf9e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:36.784656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:36.792881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-0cfb7c39-db4e-4fc8-bbd5-b67a19abb53b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:36.792881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:36.792881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:36.792881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:36.792881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:36.792881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:36.792881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:36.792881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:36.792881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:36.792881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:36.792881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:36.792881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:36.792881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:36.792881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:36.792881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:36.794039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:36.794039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:36.794039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:36.794039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:36.794039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:36.794039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:36.794039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:36.794039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:36.794039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:36.794039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:36.794039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:36.794039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:36.794039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:36.794039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:36.794039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:36.794039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:36.794039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:36.795015 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:36.795015 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:36.795015 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:36.795015 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:36.795015 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 380/764] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:36.800140 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb7c39-db4e-4fc8-bbd5-b67a19abb53b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:36.819781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-9f4fbc2d-15a6-47eb-8b1a-3748c054bf9e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:11:36.819781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:36.819781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:11:36.819781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:11:36.819781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:11:36.819781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:11:36.819781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:11:36.819781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:36.819781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:11:36.819781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:36.819781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:11:36.819781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:36.819781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:36.819781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:36.819781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:36.819781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:36.822050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:36.822050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:36.822050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:36.822050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:36.822050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:36.822050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:36.822050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:36.822050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:11:36.822050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:11:36.822050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:11:36.822050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:11:36.822050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:36.822050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:36.822050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:36.822050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:36.822050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:36.824102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:36.824102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:36.824102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:36.824102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:36.824102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:36.824102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:36.824102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:36.824102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:36.824102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:36.824102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:36.824102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:36.824102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:11:36.824102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:36.824102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:11:36.824102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:36.824102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 385/765] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Jul 20 19:11:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:36.828911 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fbc2d-15a6-47eb-8b1a-3748c054bf9e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:36.962090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb7c39-db4e-4fc8-bbd5-b67a19abb53b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:36.970545 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:37.000236 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30065b83-5260-42c9-8fa3-4622dd157880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:37.000916 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30065b83-5260-42c9-8fa3-4622dd157880 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.001270 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30065b83-5260-42c9-8fa3-4622dd157880 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.001620 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30065b83-5260-42c9-8fa3-4622dd157880 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.002458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30065b83-5260-42c9-8fa3-4622dd157880 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:37.002867 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30065b83-5260-42c9-8fa3-4622dd157880 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:37.004399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30065b83-5260-42c9-8fa3-4622dd157880 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:37.017340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 381/766] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:37.023623 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30065b83-5260-42c9-8fa3-4622dd157880 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:37.046067 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fbc2d-15a6-47eb-8b1a-3748c054bf9e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:37.119043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5a132-345a-4fab-a036-022fa069b5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:37.119721 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5a132-345a-4fab-a036-022fa069b5dd None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.120012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5a132-345a-4fab-a036-022fa069b5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.120297 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5a132-345a-4fab-a036-022fa069b5dd None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.121074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5a132-345a-4fab-a036-022fa069b5dd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:37.121412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5a132-345a-4fab-a036-022fa069b5dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:37.123032 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5a132-345a-4fab-a036-022fa069b5dd None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:37.131291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30065b83-5260-42c9-8fa3-4622dd157880 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:37.144400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 386/767] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jul 20 19:11:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:37.155381 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5a132-345a-4fab-a036-022fa069b5dd None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:37.173138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed82578-2f2e-473f-9b56-0f808b51d44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:37.174062 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed82578-2f2e-473f-9b56-0f808b51d44b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.174438 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed82578-2f2e-473f-9b56-0f808b51d44b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.174788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed82578-2f2e-473f-9b56-0f808b51d44b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.182807 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed82578-2f2e-473f-9b56-0f808b51d44b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:37.184795 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed82578-2f2e-473f-9b56-0f808b51d44b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:37.201618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-9ed82578-2f2e-473f-9b56-0f808b51d44b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:37.201618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:37.201618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:37.201618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:37.201618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:37.201618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:37.201618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:37.201618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:37.201618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:37.201618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:37.201618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:37.201618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:37.201618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:37.201618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:37.201618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:37.202631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:37.202631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:37.202631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:37.202631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:37.202631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:37.202631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:37.202631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:37.202631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:37.202631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:37.202631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:37.202631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:37.202631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:37.202631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:37.202631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:37.202631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:37.202631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:37.202631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:37.203842 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:37.203842 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:37.203842 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:37.203842 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:37.203842 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:37.203842 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:37.203842 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:37.203842 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:37.203842 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 382/768] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:37.209725 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed82578-2f2e-473f-9b56-0f808b51d44b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:37.254754 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:37.290670 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:37.363070 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5a132-345a-4fab-a036-022fa069b5dd None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:37.409055 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed82578-2f2e-473f-9b56-0f808b51d44b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:37.431923 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ca3d2-70ed-4928-a309-fc54769fa394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:37.432610 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ca3d2-70ed-4928-a309-fc54769fa394 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.432895 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ca3d2-70ed-4928-a309-fc54769fa394 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.433173 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ca3d2-70ed-4928-a309-fc54769fa394 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.433892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ca3d2-70ed-4928-a309-fc54769fa394 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:37.434202 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ca3d2-70ed-4928-a309-fc54769fa394 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:37.436764 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ca3d2-70ed-4928-a309-fc54769fa394 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:37.442538 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 387/769] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jul 20 19:11:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:37.444400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fb1fe-2e26-46e2-93ab-34fecde692e1 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.444691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fb1fe-2e26-46e2-93ab-34fecde692e1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.444968 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fb1fe-2e26-46e2-93ab-34fecde692e1 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.450123 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 388/770] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:37.450123 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fb1fe-2e26-46e2-93ab-34fecde692e1 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:37.464254 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60eba33-e804-43ec-8ccd-35d89af9ccd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:37.465549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60eba33-e804-43ec-8ccd-35d89af9ccd3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.466095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60eba33-e804-43ec-8ccd-35d89af9ccd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.466611 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60eba33-e804-43ec-8ccd-35d89af9ccd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.467585 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60eba33-e804-43ec-8ccd-35d89af9ccd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:37.468209 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60eba33-e804-43ec-8ccd-35d89af9ccd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:37.470097 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60eba33-e804-43ec-8ccd-35d89af9ccd3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:37.484759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 383/771] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:37.486179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef31178-c234-4833-958e-292059213006 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.486496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef31178-c234-4833-958e-292059213006 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.486776 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef31178-c234-4833-958e-292059213006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.510839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0ef31178-c234-4833-958e-292059213006 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:37.511972 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0ef31178-c234-4833-958e-292059213006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:37.583887 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fb1fe-2e26-46e2-93ab-34fecde692e1 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:37.614191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 384/772] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:11:37.615906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef31178-c234-4833-958e-292059213006 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:37.618702 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:37.628446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:37.640640 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa0ebf-5d58-47bc-9bb9-a8064d1c03e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:37.641737 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa0ebf-5d58-47bc-9bb9-a8064d1c03e3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.642211 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa0ebf-5d58-47bc-9bb9-a8064d1c03e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.642657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa0ebf-5d58-47bc-9bb9-a8064d1c03e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.643778 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa0ebf-5d58-47bc-9bb9-a8064d1c03e3 None admin] RBAC: Adding query filter params (interface=public, service_id=d54b35a0e07b4c5b9668f54e90436715, region_id=RegionOne) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:37.644263 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa0ebf-5d58-47bc-9bb9-a8064d1c03e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:37.646622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa0ebf-5d58-47bc-9bb9-a8064d1c03e3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:37.656877 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 389/773] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jul 20 19:11:37 2022] GET /identity/v3/endpoints?service_id=d54b35a0e07b4c5b9668f54e90436715&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:37.662465 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa0ebf-5d58-47bc-9bb9-a8064d1c03e3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:37.757100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef31178-c234-4833-958e-292059213006 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:37.797221 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa0ebf-5d58-47bc-9bb9-a8064d1c03e3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:37.804764 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce641e3e-95a1-41b4-bdd8-7e6852c8e268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:37.806071 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641e3e-95a1-41b4-bdd8-7e6852c8e268 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.806921 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641e3e-95a1-41b4-bdd8-7e6852c8e268 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.807357 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641e3e-95a1-41b4-bdd8-7e6852c8e268 None admin] PATH_INFO: `/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/a1f0f6bc94de4645a8c82038ff2bd34a/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.810418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce641e3e-95a1-41b4-bdd8-7e6852c8e268 None admin] RBAC: Authorizing `identity:create_grant(project_id=416a38494ed54934ba8ab0d8e18afb35, user_id=a1f0f6bc94de4645a8c82038ff2bd34a, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:37.812387 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce641e3e-95a1-41b4-bdd8-7e6852c8e268 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:37.834161 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 385/774] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:11:37 2022] PUT /identity/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/a1f0f6bc94de4645a8c82038ff2bd34a/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:11:37.835236 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce641e3e-95a1-41b4-bdd8-7e6852c8e268 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:37.845271 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad507f5-5186-44c5-bfd3-7510c597d94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:37.846230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad507f5-5186-44c5-bfd3-7510c597d94d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:37.846697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad507f5-5186-44c5-bfd3-7510c597d94d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:37.847069 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad507f5-5186-44c5-bfd3-7510c597d94d None admin] PATH_INFO: `/v3/services/network` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:37.847823 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad507f5-5186-44c5-bfd3-7510c597d94d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:37.849904 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad507f5-5186-44c5-bfd3-7510c597d94d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:37.879218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-cad507f5-5186-44c5-bfd3-7510c597d94d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:11:37.879218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:37.879218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:11:37.879218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:11:37.879218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:11:37.879218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:11:37.879218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:11:37.879218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:37.879218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:11:37.879218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:37.879218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:11:37.879218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:37.879218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:37.879218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:37.879218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:37.879218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:37.879218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:37.880413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:37.880413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:37.880413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:37.880413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:37.880413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:37.880413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:37.880413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:11:37.880413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:11:37.880413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:11:37.880413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:11:37.880413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:37.880413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:37.880413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:37.880413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:37.880413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:37.880413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:37.881282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:37.881282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:37.881282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:37.881282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:37.881282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:37.881282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:37.881282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:37.881282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:37.881282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:37.881282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:37.881282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:11:37.881282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:37.881282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:11:37.881282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:37.881282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 390/775] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:37 2022] GET /identity/v3/services/network => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:37.887227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad507f5-5186-44c5-bfd3-7510c597d94d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:37.919251 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:37.975445 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce641e3e-95a1-41b4-bdd8-7e6852c8e268 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:38.020264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:38.021889 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7263e-98b0-4fec-8896-299bb2c704f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:38.023638 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7263e-98b0-4fec-8896-299bb2c704f4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:38.024224 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7263e-98b0-4fec-8896-299bb2c704f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:38.024708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7263e-98b0-4fec-8896-299bb2c704f4 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:38.025769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b7263e-98b0-4fec-8896-299bb2c704f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:38.028954 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b7263e-98b0-4fec-8896-299bb2c704f4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:38.038344 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 386/776] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jul 20 19:11:37 2022] GET /identity/v3/services => generated 772 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:38.124838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad507f5-5186-44c5-bfd3-7510c597d94d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:38.174955 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622c400-7620-4a82-ae03-7d8fcc481eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:38.176409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622c400-7620-4a82-ae03-7d8fcc481eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:38.177078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622c400-7620-4a82-ae03-7d8fcc481eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:38.177666 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622c400-7620-4a82-ae03-7d8fcc481eb6 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:38.179003 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622c400-7620-4a82-ae03-7d8fcc481eb6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:38.179633 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622c400-7620-4a82-ae03-7d8fcc481eb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:38.181890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c622c400-7620-4a82-ae03-7d8fcc481eb6 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:38.189715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 391/777] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 20 19:11:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:38.195229 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7263e-98b0-4fec-8896-299bb2c704f4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:38.341833 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7263e-98b0-4fec-8896-299bb2c704f4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:38.374010 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:38.395106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879283df-1a0b-4432-a159-f7708cbc3f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:38.396608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879283df-1a0b-4432-a159-f7708cbc3f9a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:38.397080 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879283df-1a0b-4432-a159-f7708cbc3f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:38.397541 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879283df-1a0b-4432-a159-f7708cbc3f9a None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:38.398490 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879283df-1a0b-4432-a159-f7708cbc3f9a None admin] RBAC: Adding query filter params (type=network) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:38.398979 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879283df-1a0b-4432-a159-f7708cbc3f9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:38.400521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879283df-1a0b-4432-a159-f7708cbc3f9a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:38.408674 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 387/778] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 20 19:11:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:38.415312 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622c400-7620-4a82-ae03-7d8fcc481eb6 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:38.591026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622c400-7620-4a82-ae03-7d8fcc481eb6 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:38.620885 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:38.631592 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fccd14-ff01-46ed-88b4-45f5bd3ef982 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:38.631900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fccd14-ff01-46ed-88b4-45f5bd3ef982 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:38.632152 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fccd14-ff01-46ed-88b4-45f5bd3ef982 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:38.633795 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 388/779] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:38.639563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5915f1-cd70-4ebb-bc0a-f054baeec95f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:38.639850 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5915f1-cd70-4ebb-bc0a-f054baeec95f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:38.640128 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5915f1-cd70-4ebb-bc0a-f054baeec95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:38.641613 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af7856-a01f-4035-b6e5-71d1c2374f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:38.642631 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af7856-a01f-4035-b6e5-71d1c2374f96 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:38.643142 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af7856-a01f-4035-b6e5-71d1c2374f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:38.643620 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af7856-a01f-4035-b6e5-71d1c2374f96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:38.644571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af7856-a01f-4035-b6e5-71d1c2374f96 None admin] RBAC: Adding query filter params (interface=public, service_id=7e14bda625aa41aa9970e6a996dcacd4, region_id=RegionOne) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:38.645036 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af7856-a01f-4035-b6e5-71d1c2374f96 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:38.647242 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af7856-a01f-4035-b6e5-71d1c2374f96 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:38.653325 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 392/780] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jul 20 19:11:38 2022] GET /identity/v3/endpoints?service_id=7e14bda625aa41aa9970e6a996dcacd4&interface=public®ion_id=RegionOne => generated 194 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:38.660440 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af7856-a01f-4035-b6e5-71d1c2374f96 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:38.663683 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8f5915f1-cd70-4ebb-bc0a-f054baeec95f None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:38.665131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8f5915f1-cd70-4ebb-bc0a-f054baeec95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:38.744524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 389/781] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:11:38.771587 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5915f1-cd70-4ebb-bc0a-f054baeec95f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:38.828853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af7856-a01f-4035-b6e5-71d1c2374f96 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:38.866158 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebd9d4-bc79-4f4c-a874-300f098876b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:38.866880 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebd9d4-bc79-4f4c-a874-300f098876b2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:38.867225 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebd9d4-bc79-4f4c-a874-300f098876b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:38.867512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebd9d4-bc79-4f4c-a874-300f098876b2 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:38.868210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebd9d4-bc79-4f4c-a874-300f098876b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:38.869619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebd9d4-bc79-4f4c-a874-300f098876b2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:38.882361 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 393/782] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jul 20 19:11:38 2022] GET /identity/v3/services => generated 772 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:38.882361 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff092072-bb95-4157-9079-91ecb5b5195f None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:38.882361 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff092072-bb95-4157-9079-91ecb5b5195f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:38.882361 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff092072-bb95-4157-9079-91ecb5b5195f None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:38.882361 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 394/783] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:38.895312 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a8b6c-0076-4c28-8990-a7de2536e076 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:38.897813 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a8b6c-0076-4c28-8990-a7de2536e076 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:38.899165 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a8b6c-0076-4c28-8990-a7de2536e076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:38.925724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5915f1-cd70-4ebb-bc0a-f054baeec95f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:38.939996 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2a9a8b6c-0076-4c28-8990-a7de2536e076 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:38.941185 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2a9a8b6c-0076-4c28-8990-a7de2536e076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:38.952839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:38.981043 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9517cb-a3bf-40b8-8b74-87ec20cdacd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:38.983782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9517cb-a3bf-40b8-8b74-87ec20cdacd8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:38.987558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9517cb-a3bf-40b8-8b74-87ec20cdacd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:38.988204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9517cb-a3bf-40b8-8b74-87ec20cdacd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:39.016026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9517cb-a3bf-40b8-8b74-87ec20cdacd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:39.031493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-6c9517cb-a3bf-40b8-8b74-87ec20cdacd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:39.031493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:39.031493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:39.031493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:39.031493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:39.031493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:39.031493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:39.031493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:39.031493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:39.031493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:39.031493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:39.031493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:39.031493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:39.031493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:39.031493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:39.031493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:39.032569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:39.032569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:39.032569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:39.032569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:39.032569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:39.032569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:39.032569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:39.032569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:39.032569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:39.032569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:39.032569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:39.032569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:39.032569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:39.032569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:39.032569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:39.032569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:39.033747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:39.033747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:39.033747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:39.033747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:39.033747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:39.033747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:39.033747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:39.033747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:39.033747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:39.033747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:39.033747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:39.033747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:39.043686 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 390/784] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:11:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:39.048808 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9517cb-a3bf-40b8-8b74-87ec20cdacd8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:39.049503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:39.095121 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 395/785] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:11:39.122030 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a8b6c-0076-4c28-8990-a7de2536e076 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:39.207195 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9517cb-a3bf-40b8-8b74-87ec20cdacd8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:39.251206 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90665288-3979-48b0-82a7-5279092b3c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:39.252567 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90665288-3979-48b0-82a7-5279092b3c72 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:39.253330 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90665288-3979-48b0-82a7-5279092b3c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:39.253776 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90665288-3979-48b0-82a7-5279092b3c72 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:39.254918 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90665288-3979-48b0-82a7-5279092b3c72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:39.255443 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90665288-3979-48b0-82a7-5279092b3c72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:39.257044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90665288-3979-48b0-82a7-5279092b3c72 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:39.262236 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a8b6c-0076-4c28-8990-a7de2536e076 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:39.267899 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 391/786] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:39.275294 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90665288-3979-48b0-82a7-5279092b3c72 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:39.324577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:39.326278 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d17d3-aa79-4746-8f47-8f5d845e1437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:39.327316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d17d3-aa79-4746-8f47-8f5d845e1437 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:39.327481 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d17d3-aa79-4746-8f47-8f5d845e1437 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:39.327882 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d17d3-aa79-4746-8f47-8f5d845e1437 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:39.343579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d17d3-aa79-4746-8f47-8f5d845e1437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:39.362843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-037d17d3-aa79-4746-8f47-8f5d845e1437 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:39.362843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:39.362843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:39.362843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:39.362843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:39.362843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:39.362843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:39.362843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:39.362843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:39.362843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:39.362843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:39.362843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:39.362843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:39.362843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:39.362843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:39.362843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:39.363873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:39.363873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:39.363873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:39.363873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:39.363873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:39.363873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:39.363873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:39.363873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:39.363873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:39.363873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:39.363873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:39.363873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:39.363873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:39.363873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:39.363873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:39.363873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:39.365445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:39.365445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:39.365445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:39.365445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:39.365445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:39.365445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:39.365445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:39.365445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:39.365445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:39.365445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:39.365445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:39.365445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:39.370817 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 396/787] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:39.377259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d17d3-aa79-4746-8f47-8f5d845e1437 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:39.390182 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90665288-3979-48b0-82a7-5279092b3c72 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:39.428498 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6344ff9-c8dc-4874-9e7a-6e2a55bbfb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:39.429393 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6344ff9-c8dc-4874-9e7a-6e2a55bbfb2f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:39.429685 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6344ff9-c8dc-4874-9e7a-6e2a55bbfb2f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:39.429976 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6344ff9-c8dc-4874-9e7a-6e2a55bbfb2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:39.444221 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6344ff9-c8dc-4874-9e7a-6e2a55bbfb2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:39.445617 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6344ff9-c8dc-4874-9e7a-6e2a55bbfb2f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:39.456964 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:39.466395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b6344ff9-c8dc-4874-9e7a-6e2a55bbfb2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:39.466395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:39.466395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:39.466395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:39.466395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:39.466395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:39.466395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:39.466395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:39.466395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:39.466395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:39.466395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:39.466395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:39.466395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:39.466395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:39.466395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:39.467425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:39.467425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:39.467425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:39.467425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:39.467425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:39.467425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:39.467425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:39.467425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:39.467425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:39.467425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:39.467425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:39.467425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:39.467425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:39.467425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:39.467425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:39.467425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:39.467425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:39.468550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:39.468550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:39.468550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:39.468550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:39.468550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 392/788] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:39.474847 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6344ff9-c8dc-4874-9e7a-6e2a55bbfb2f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:39.583591 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d17d3-aa79-4746-8f47-8f5d845e1437 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:39.638785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558aefa-99ec-4d84-9c9a-cf8d5e8e4876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:39.639484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558aefa-99ec-4d84-9c9a-cf8d5e8e4876 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:39.639770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558aefa-99ec-4d84-9c9a-cf8d5e8e4876 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:39.640055 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558aefa-99ec-4d84-9c9a-cf8d5e8e4876 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:39.640825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558aefa-99ec-4d84-9c9a-cf8d5e8e4876 None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:39.641133 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558aefa-99ec-4d84-9c9a-cf8d5e8e4876 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:39.642663 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558aefa-99ec-4d84-9c9a-cf8d5e8e4876 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:39.668609 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 397/789] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:39.672535 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:39.673770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558aefa-99ec-4d84-9c9a-cf8d5e8e4876 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:39.696654 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6344ff9-c8dc-4874-9e7a-6e2a55bbfb2f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:39.790696 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acc8c9-92b5-4e96-abad-00a7412a8f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:39.791384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acc8c9-92b5-4e96-abad-00a7412a8f93 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:39.791664 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acc8c9-92b5-4e96-abad-00a7412a8f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:39.791947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acc8c9-92b5-4e96-abad-00a7412a8f93 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:39.792687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acc8c9-92b5-4e96-abad-00a7412a8f93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:39.792996 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acc8c9-92b5-4e96-abad-00a7412a8f93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:39.794415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acc8c9-92b5-4e96-abad-00a7412a8f93 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:39.817315 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 393/790] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:39.823001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acc8c9-92b5-4e96-abad-00a7412a8f93 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:39.839700 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:39.852283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558aefa-99ec-4d84-9c9a-cf8d5e8e4876 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:39.910123 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78ec76-68e0-442a-b31f-8ef7d9ed8dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:39.910945 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78ec76-68e0-442a-b31f-8ef7d9ed8dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:39.911228 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78ec76-68e0-442a-b31f-8ef7d9ed8dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:39.912141 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78ec76-68e0-442a-b31f-8ef7d9ed8dc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:39.937258 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78ec76-68e0-442a-b31f-8ef7d9ed8dc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:39.938853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78ec76-68e0-442a-b31f-8ef7d9ed8dc2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:39.976569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-af78ec76-68e0-442a-b31f-8ef7d9ed8dc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:39.976569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:39.976569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:39.976569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:39.976569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:39.976569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:39.976569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:39.976569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:39.976569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:39.976569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:39.976569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:39.976569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:39.976569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:39.976569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:39.976569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:39.977558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:39.977558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:39.977558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:39.977558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:39.977558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:39.977558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:39.977558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:39.977558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:39.977558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:39.977558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:39.977558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:39.977558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:39.977558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:39.977558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:39.977558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:39.977558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:39.977558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:39.978502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:39.978502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:39.978502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:39.978502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:39.983710 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 398/791] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:39.984606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78ec76-68e0-442a-b31f-8ef7d9ed8dc2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:40.027340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acc8c9-92b5-4e96-abad-00a7412a8f93 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:40.104111 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308072b-cd8e-4860-b15e-791e8be14d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:40.104834 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308072b-cd8e-4860-b15e-791e8be14d8f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:40.105116 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308072b-cd8e-4860-b15e-791e8be14d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:40.105233 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78ec76-68e0-442a-b31f-8ef7d9ed8dc2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:40.105434 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308072b-cd8e-4860-b15e-791e8be14d8f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:40.118204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308072b-cd8e-4860-b15e-791e8be14d8f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:40.119677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6308072b-cd8e-4860-b15e-791e8be14d8f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:40.147325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-6308072b-cd8e-4860-b15e-791e8be14d8f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:11:40.147325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:40.147325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:40.147325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:40.147325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:40.147325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:40.147325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:40.147325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:40.147325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:40.147325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:40.147325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:40.147325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:40.147325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:40.147325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:40.147325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:40.147325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:40.148610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:40.148610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:40.148610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:40.148610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:40.148610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:40.148610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:40.148610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:40.148610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:40.148610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:40.148610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:40.148610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:40.148610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:40.148610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:40.148610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:40.148610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:40.148610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:40.148610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:40.148610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:40.149576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:40.149576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:40.149576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:40.149576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:40.149576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:40.149576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:40.149576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:40.149576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:40.149576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:11:40.149576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:40.149576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 394/792] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:11:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:40.154137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd126b4e-553c-4b2d-a678-a6379e101564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:40.154617 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308072b-cd8e-4860-b15e-791e8be14d8f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:40.154852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd126b4e-553c-4b2d-a678-a6379e101564 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:40.155137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd126b4e-553c-4b2d-a678-a6379e101564 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:40.155418 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd126b4e-553c-4b2d-a678-a6379e101564 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:40.156151 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd126b4e-553c-4b2d-a678-a6379e101564 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:40.156457 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd126b4e-553c-4b2d-a678-a6379e101564 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:40.157927 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd126b4e-553c-4b2d-a678-a6379e101564 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:40.186507 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 399/793] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:40.193885 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd126b4e-553c-4b2d-a678-a6379e101564 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:40.202719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:40.223639 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:40.267768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308072b-cd8e-4860-b15e-791e8be14d8f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:40.303879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a669c-5da8-4a74-a0bf-34c513c290e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:40.304556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a669c-5da8-4a74-a0bf-34c513c290e6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:40.304883 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a669c-5da8-4a74-a0bf-34c513c290e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:40.305138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a669c-5da8-4a74-a0bf-34c513c290e6 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:40.305985 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a669c-5da8-4a74-a0bf-34c513c290e6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:40.306376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a669c-5da8-4a74-a0bf-34c513c290e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:40.307820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a669c-5da8-4a74-a0bf-34c513c290e6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:40.327144 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 395/794] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jul 20 19:11:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:40.332743 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a669c-5da8-4a74-a0bf-34c513c290e6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:40.413915 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd126b4e-553c-4b2d-a678-a6379e101564 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:40.426680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:40.459592 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a669c-5da8-4a74-a0bf-34c513c290e6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:40.485951 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19112aac-6266-4d07-b6c6-f51856daf80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:40.486847 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19112aac-6266-4d07-b6c6-f51856daf80c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:40.487132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19112aac-6266-4d07-b6c6-f51856daf80c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:40.487475 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19112aac-6266-4d07-b6c6-f51856daf80c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:40.497357 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec6413-84e1-40da-ba67-f9610be865d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:40.498310 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec6413-84e1-40da-ba67-f9610be865d1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:40.498609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec6413-84e1-40da-ba67-f9610be865d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:40.498886 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec6413-84e1-40da-ba67-f9610be865d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:40.500838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19112aac-6266-4d07-b6c6-f51856daf80c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:40.502317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19112aac-6266-4d07-b6c6-f51856daf80c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:40.510914 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec6413-84e1-40da-ba67-f9610be865d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:40.512378 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcec6413-84e1-40da-ba67-f9610be865d1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:40.531477 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-bcec6413-84e1-40da-ba67-f9610be865d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:40.531477 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:40.531477 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:40.531477 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:40.531477 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:40.531477 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:40.531477 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:40.531477 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:40.531477 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:40.531477 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:40.531477 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:40.531477 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:40.531477 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:40.531477 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:40.531477 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:40.532469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:40.532469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:40.532469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:40.532469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:40.532469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:40.532469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:40.532469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:40.532469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:40.532469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:40.532469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:40.532469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:40.532469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:40.532469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:40.532469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:40.532469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:40.532469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:40.532469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:40.533682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:40.533682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:40.533682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:40.533682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:40.533682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 396/795] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:40.539183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec6413-84e1-40da-ba67-f9610be865d1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:40.544317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-19112aac-6266-4d07-b6c6-f51856daf80c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:11:40.544317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:40.544317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:40.544317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:40.544317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:40.544317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:40.544317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:40.544317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:40.544317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:40.544317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:40.544317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:40.544317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:40.544317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:40.544317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:40.544317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:40.544317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:40.545300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:40.545300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:40.545300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:40.545300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:40.545300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:40.545300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:40.545300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:40.545300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:40.545300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:40.545300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:40.545300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:40.545300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:40.545300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:40.545300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:40.545300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:40.545300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:40.545300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:40.545300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:40.546462 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:40.546462 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:40.546462 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:40.546462 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:40.546462 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:40.546462 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:40.546462 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:40.546462 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:40.546462 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:11:40.546462 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:40.546462 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 400/796] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jul 20 19:11:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:40.558325 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19112aac-6266-4d07-b6c6-f51856daf80c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:40.641295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:40.652531 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec6413-84e1-40da-ba67-f9610be865d1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:40.676105 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19112aac-6266-4d07-b6c6-f51856daf80c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:40.678317 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:40.694981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee3203e-2648-4a22-986d-516b8491e1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:40.696010 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3203e-2648-4a22-986d-516b8491e1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:40.696407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3203e-2648-4a22-986d-516b8491e1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:40.696841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee3203e-2648-4a22-986d-516b8491e1b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:40.698033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3203e-2648-4a22-986d-516b8491e1b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:40.698482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3203e-2648-4a22-986d-516b8491e1b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:40.700120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee3203e-2648-4a22-986d-516b8491e1b9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:40.714212 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 397/797] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:40.715784 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1c860-32a4-45bc-a816-bc265e131925 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:40.716195 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1c860-32a4-45bc-a816-bc265e131925 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:40.716545 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1c860-32a4-45bc-a816-bc265e131925 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:40.722442 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 398/798] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:40.722442 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1c860-32a4-45bc-a816-bc265e131925 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:40.733052 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc590f28-071b-4b4f-aa78-7593846d3dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:40.733731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc590f28-071b-4b4f-aa78-7593846d3dbd None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:40.734015 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc590f28-071b-4b4f-aa78-7593846d3dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:40.734322 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc590f28-071b-4b4f-aa78-7593846d3dbd None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:40.735179 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc590f28-071b-4b4f-aa78-7593846d3dbd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:40.735489 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc590f28-071b-4b4f-aa78-7593846d3dbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:40.737042 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc590f28-071b-4b4f-aa78-7593846d3dbd None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:40.759196 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 401/799] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jul 20 19:11:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:40.760469 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3540aec-e6ba-4d68-8a0d-94d6adc095ff None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:40.760758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3540aec-e6ba-4d68-8a0d-94d6adc095ff None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:40.761038 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3540aec-e6ba-4d68-8a0d-94d6adc095ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:40.789706 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e3540aec-e6ba-4d68-8a0d-94d6adc095ff None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:40.791032 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e3540aec-e6ba-4d68-8a0d-94d6adc095ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:40.860450 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1c860-32a4-45bc-a816-bc265e131925 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:40.876209 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 402/800] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:11:40.877728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3540aec-e6ba-4d68-8a0d-94d6adc095ff None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:40.931217 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c75c90-17ab-4dd1-b6b8-674af9a9cb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:40.933189 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c75c90-17ab-4dd1-b6b8-674af9a9cb58 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:40.934130 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c75c90-17ab-4dd1-b6b8-674af9a9cb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:40.935191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c75c90-17ab-4dd1-b6b8-674af9a9cb58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:40.948541 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c75c90-17ab-4dd1-b6b8-674af9a9cb58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:40.952215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c75c90-17ab-4dd1-b6b8-674af9a9cb58 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:40.969603 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:40.970278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-61c75c90-17ab-4dd1-b6b8-674af9a9cb58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:40.970278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:40.970278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:40.970278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:40.970278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:40.970278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:40.970278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:40.970278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:40.970278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:40.970278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:40.970278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:40.970278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:40.970278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:40.970278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:40.970278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:40.971433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:40.971433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:40.971433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:40.971433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:40.971433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:40.971433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:40.971433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:40.971433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:40.971433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:40.971433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:40.971433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:40.971433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:40.971433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:40.971433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:40.971433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:40.971433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:40.971433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:40.972521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:40.972521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:40.972521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:40.972521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:40.972521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:40.972521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:40.972521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:40.972521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:40.972521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 399/801] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:40.973289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c75c90-17ab-4dd1-b6b8-674af9a9cb58 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:41.025979 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:41.028026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3540aec-e6ba-4d68-8a0d-94d6adc095ff None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:41.075493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1287f-7217-4fd4-a4f4-d103e9cf0ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:41.076385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1287f-7217-4fd4-a4f4-d103e9cf0ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:41.076580 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1287f-7217-4fd4-a4f4-d103e9cf0ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:41.076854 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1287f-7217-4fd4-a4f4-d103e9cf0ce0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:41.087846 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1287f-7217-4fd4-a4f4-d103e9cf0ce0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:41.089316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1287f-7217-4fd4-a4f4-d103e9cf0ce0 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:41.101621 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c75c90-17ab-4dd1-b6b8-674af9a9cb58 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:41.109920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-d1b1287f-7217-4fd4-a4f4-d103e9cf0ce0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:41.109920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:41.109920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:41.109920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:41.109920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:41.109920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:41.109920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:41.109920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:41.109920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:41.109920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:41.109920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:41.109920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:41.109920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:41.109920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:41.109920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:41.111159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:41.111159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:41.111159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:41.111159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:41.111159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:41.111159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:41.111159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:41.111159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:41.111159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:41.111159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:41.111159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:41.111159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:41.111159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:41.111159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:41.111159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:41.111159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:41.111159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:41.113124 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:41.113124 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:41.113124 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:41.113124 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:41.116393 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 403/802] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:41.117769 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f1982-269b-48c2-9338-58b8afc61524 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:41.118069 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f1982-269b-48c2-9338-58b8afc61524 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:41.118370 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f1982-269b-48c2-9338-58b8afc61524 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:41.119978 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 404/803] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:41.120538 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f1982-269b-48c2-9338-58b8afc61524 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:41.149927 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d9eef-1721-467e-a531-edefdae1bd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:41.150742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d9eef-1721-467e-a531-edefdae1bd60 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:41.151028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d9eef-1721-467e-a531-edefdae1bd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:41.151309 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d9eef-1721-467e-a531-edefdae1bd60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:41.162999 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d9eef-1721-467e-a531-edefdae1bd60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:41.171035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-224d9eef-1721-467e-a531-edefdae1bd60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:41.171035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:41.171035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:41.171035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:41.171035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:41.171035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:41.171035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:41.171035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:41.171035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:41.171035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:41.171035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:41.171035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:41.171035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:41.171035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:41.171035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:41.171035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:41.172067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:41.172067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:41.172067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:41.172067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:41.172067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:41.172067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:41.172067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:41.172067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:41.172067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:41.172067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:41.172067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:41.172067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:41.172067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:41.172067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:41.172067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:41.172067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:41.172948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:41.172948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:41.172948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:41.172948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:41.172948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:41.172948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:41.172948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:41.172948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:41.172948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:41.172948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:41.172948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:41.172948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:41.172948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 400/804] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:11:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:41.173668 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d9eef-1721-467e-a531-edefdae1bd60 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:41.239883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f1982-269b-48c2-9338-58b8afc61524 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:41.255630 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:41.282992 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641313e-974b-4f07-8986-5a84bf21c050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:41.284091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641313e-974b-4f07-8986-5a84bf21c050 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:41.284378 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641313e-974b-4f07-8986-5a84bf21c050 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:41.284650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641313e-974b-4f07-8986-5a84bf21c050 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:41.284836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d9eef-1721-467e-a531-edefdae1bd60 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:41.285442 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641313e-974b-4f07-8986-5a84bf21c050 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:41.285749 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641313e-974b-4f07-8986-5a84bf21c050 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:41.287674 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:41.288677 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641313e-974b-4f07-8986-5a84bf21c050 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:41.309798 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 405/805] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:41.309798 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52407854-5ebb-483c-8a34-4ccf6f25bd06 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:41.309798 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52407854-5ebb-483c-8a34-4ccf6f25bd06 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:41.309798 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52407854-5ebb-483c-8a34-4ccf6f25bd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:41.329409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-52407854-5ebb-483c-8a34-4ccf6f25bd06 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:41.330860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-52407854-5ebb-483c-8a34-4ccf6f25bd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:41.336055 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b656cf-6fb5-4c37-9c19-2369ce763e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:41.336845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b656cf-6fb5-4c37-9c19-2369ce763e8c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:41.337145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b656cf-6fb5-4c37-9c19-2369ce763e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:41.337405 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b656cf-6fb5-4c37-9c19-2369ce763e8c None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:41.338273 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b656cf-6fb5-4c37-9c19-2369ce763e8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:41.338653 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b656cf-6fb5-4c37-9c19-2369ce763e8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:41.340232 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b656cf-6fb5-4c37-9c19-2369ce763e8c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:41.363046 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 401/806] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:41.363046 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b656cf-6fb5-4c37-9c19-2369ce763e8c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:41.414511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 406/807] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:11:41.414511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52407854-5ebb-483c-8a34-4ccf6f25bd06 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:41.483413 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b656cf-6fb5-4c37-9c19-2369ce763e8c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:41.527737 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98515cd-be40-484b-adb3-18fb74fe86ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:41.528478 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98515cd-be40-484b-adb3-18fb74fe86ca None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:41.528768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98515cd-be40-484b-adb3-18fb74fe86ca None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:41.532364 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98515cd-be40-484b-adb3-18fb74fe86ca None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:41.532364 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98515cd-be40-484b-adb3-18fb74fe86ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:41.532364 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98515cd-be40-484b-adb3-18fb74fe86ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:41.532709 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98515cd-be40-484b-adb3-18fb74fe86ca None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:41.542668 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52407854-5ebb-483c-8a34-4ccf6f25bd06 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:41.544327 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:41.546275 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 402/808] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:41.547497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98515cd-be40-484b-adb3-18fb74fe86ca None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:41.584446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4ac36-8555-454f-a956-0d8a3655beff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:41.585294 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4ac36-8555-454f-a956-0d8a3655beff None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:41.585572 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4ac36-8555-454f-a956-0d8a3655beff None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:41.585840 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4ac36-8555-454f-a956-0d8a3655beff None admin] PATH_INFO: `/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/0ebd7c59f0014a3886fa75fb35a40e64/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:41.587871 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4ac36-8555-454f-a956-0d8a3655beff None admin] RBAC: Authorizing `identity:create_grant(project_id=416a38494ed54934ba8ab0d8e18afb35, user_id=0ebd7c59f0014a3886fa75fb35a40e64, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:41.589362 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4ac36-8555-454f-a956-0d8a3655beff None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:41.592963 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:41.603891 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 407/809] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:11:41 2022] PUT /identity/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/0ebd7c59f0014a3886fa75fb35a40e64/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:11:41.604731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4ac36-8555-454f-a956-0d8a3655beff None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:41.695314 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98515cd-be40-484b-adb3-18fb74fe86ca None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:41.741788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4ac36-8555-454f-a956-0d8a3655beff None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:41.742040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d0157-e51e-42cd-91eb-06ef007dc4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:41.742775 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d0157-e51e-42cd-91eb-06ef007dc4cd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:41.743057 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d0157-e51e-42cd-91eb-06ef007dc4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:41.743326 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d0157-e51e-42cd-91eb-06ef007dc4cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:41.751368 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d0157-e51e-42cd-91eb-06ef007dc4cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:41.752850 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d0157-e51e-42cd-91eb-06ef007dc4cd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:41.774475 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-9f7d0157-e51e-42cd-91eb-06ef007dc4cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:41.774475 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:41.774475 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:41.774475 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:41.774475 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:41.774475 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:41.774475 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:41.774475 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:41.774475 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:41.774475 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:41.774475 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:41.774475 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:41.774475 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:41.774475 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:41.774475 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:41.775508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:41.775508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:41.775508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:41.775508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:41.775508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:41.775508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:41.775508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:41.775508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:41.775508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:41.775508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:41.775508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:41.775508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:41.775508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:41.775508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:41.775508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:41.775508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:41.775508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:41.776439 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:41.776439 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:41.776439 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:41.776439 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:41.776439 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:41.776439 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:41.776439 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:41.776439 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:41.776439 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 403/810] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:41.777954 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a149e-de2f-4539-b3d6-7a1e9fddd1f3 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:41.777954 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a149e-de2f-4539-b3d6-7a1e9fddd1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:41.778161 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a149e-de2f-4539-b3d6-7a1e9fddd1f3 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:41.780481 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 404/811] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:41.781361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a149e-de2f-4539-b3d6-7a1e9fddd1f3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:41.801947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62524a-c5e1-4df4-9078-aa6f57f1b087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:41.803088 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62524a-c5e1-4df4-9078-aa6f57f1b087 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:41.803489 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62524a-c5e1-4df4-9078-aa6f57f1b087 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:41.803882 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62524a-c5e1-4df4-9078-aa6f57f1b087 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:41.804691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62524a-c5e1-4df4-9078-aa6f57f1b087 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:41.806363 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62524a-c5e1-4df4-9078-aa6f57f1b087 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:41.820324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-3d62524a-c5e1-4df4-9078-aa6f57f1b087 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:11:41.820324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:41.820324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:11:41.820324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:11:41.820324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:11:41.820324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:11:41.820324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:11:41.820324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:41.820324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:11:41.820324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:41.820324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:11:41.820324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:41.820324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:41.820324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:41.820324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:41.820324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:41.821372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:41.821372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:41.821372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:41.821372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:41.821372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:41.821372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:41.821372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:41.821372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:11:41.821372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:11:41.821372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:11:41.821372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:11:41.821372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:41.821372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:41.821372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:41.821372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:41.821372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:41.823622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:41.823622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:41.823622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:41.823622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:41.823622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:41.823622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:41.823622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:41.823622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:41.823622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:41.823622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:41.823622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:41.823622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:11:41.823622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:41.823622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 19:11:41.823622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:41.823622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 408/812] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Jul 20 19:11:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:41.824481 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62524a-c5e1-4df4-9078-aa6f57f1b087 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:41.871023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:41.919504 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:41.941767 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a149e-de2f-4539-b3d6-7a1e9fddd1f3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:41.979776 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62524a-c5e1-4df4-9078-aa6f57f1b087 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:42.004130 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac8b52-2ce6-4388-9e26-0575379e5217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:42.005523 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac8b52-2ce6-4388-9e26-0575379e5217 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:42.005818 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac8b52-2ce6-4388-9e26-0575379e5217 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:42.006101 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac8b52-2ce6-4388-9e26-0575379e5217 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:42.022015 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac8b52-2ce6-4388-9e26-0575379e5217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:42.023638 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac8b52-2ce6-4388-9e26-0575379e5217 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:42.034033 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644807d0-ee0d-4478-9ca9-4e7dc34614f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:42.035041 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644807d0-ee0d-4478-9ca9-4e7dc34614f1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:42.035495 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644807d0-ee0d-4478-9ca9-4e7dc34614f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:42.035918 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644807d0-ee0d-4478-9ca9-4e7dc34614f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:42.036907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644807d0-ee0d-4478-9ca9-4e7dc34614f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:42.037354 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644807d0-ee0d-4478-9ca9-4e7dc34614f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:42.039091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644807d0-ee0d-4478-9ca9-4e7dc34614f1 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:42.043578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-c4ac8b52-2ce6-4388-9e26-0575379e5217 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:42.043578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:42.043578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:42.043578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:42.043578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:42.043578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:42.043578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:42.043578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:42.043578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:42.043578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:42.043578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:42.043578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:42.043578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:42.043578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:42.043578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:42.045336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:42.045336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:42.045336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:42.045336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:42.045336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:42.045336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:42.045336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:42.045336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:42.045336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:42.045336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:42.045336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:42.045336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:42.045336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:42.045336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:42.045336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:42.045336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:42.045336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:42.047213 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:42.047213 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:42.047213 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:42.047213 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:42.049598 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 405/813] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:42.051074 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c88959-804c-4982-8317-128f89edeaab None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:42.051364 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c88959-804c-4982-8317-128f89edeaab None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:42.051634 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c88959-804c-4982-8317-128f89edeaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:42.064360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 409/814] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:42.064360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644807d0-ee0d-4478-9ca9-4e7dc34614f1 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:42.081758 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a0c88959-804c-4982-8317-128f89edeaab None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:42.083013 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a0c88959-804c-4982-8317-128f89edeaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:42.197903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:42.204142 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 406/815] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:11:42.205346 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c88959-804c-4982-8317-128f89edeaab None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:42.233853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644807d0-ee0d-4478-9ca9-4e7dc34614f1 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:42.276163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a52ff-a519-4845-a38c-5342c90fa050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:42.276995 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a52ff-a519-4845-a38c-5342c90fa050 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:42.277374 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a52ff-a519-4845-a38c-5342c90fa050 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:42.277787 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a52ff-a519-4845-a38c-5342c90fa050 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:42.278666 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a52ff-a519-4845-a38c-5342c90fa050 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:42.279077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a52ff-a519-4845-a38c-5342c90fa050 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:42.280737 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a52ff-a519-4845-a38c-5342c90fa050 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:42.286417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 410/816] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jul 20 19:11:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:42.291806 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a52ff-a519-4845-a38c-5342c90fa050 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:42.306191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:42.352854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c88959-804c-4982-8317-128f89edeaab None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:42.398260 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f658d40-75f9-47fc-aed9-5c21ac3c298c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:42.399310 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f658d40-75f9-47fc-aed9-5c21ac3c298c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:42.400493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f658d40-75f9-47fc-aed9-5c21ac3c298c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:42.400861 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f658d40-75f9-47fc-aed9-5c21ac3c298c None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:42.401686 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f658d40-75f9-47fc-aed9-5c21ac3c298c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:42.402086 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f658d40-75f9-47fc-aed9-5c21ac3c298c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:42.403586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f658d40-75f9-47fc-aed9-5c21ac3c298c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:42.422474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 407/817] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:42.423656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f658d40-75f9-47fc-aed9-5c21ac3c298c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:42.434590 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a52ff-a519-4845-a38c-5342c90fa050 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:42.486623 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4dafb-b61b-413b-ab38-0fab583928a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:42.487534 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4dafb-b61b-413b-ab38-0fab583928a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:42.487822 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4dafb-b61b-413b-ab38-0fab583928a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:42.488292 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4dafb-b61b-413b-ab38-0fab583928a3 None admin] PATH_INFO: `/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/e78792e617d84a7cbb384ed764c391fb/roles/3e2d1ff906b74bec9c7410e3a3ec9448` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:42.512914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4dafb-b61b-413b-ab38-0fab583928a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=416a38494ed54934ba8ab0d8e18afb35, user_id=e78792e617d84a7cbb384ed764c391fb, role_id=3e2d1ff906b74bec9c7410e3a3ec9448)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:42.514644 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4dafb-b61b-413b-ab38-0fab583928a3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:42.530630 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:42.558826 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 411/818] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:11:42 2022] PUT /identity/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/e78792e617d84a7cbb384ed764c391fb/roles/3e2d1ff906b74bec9c7410e3a3ec9448 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:11:42.560584 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4dafb-b61b-413b-ab38-0fab583928a3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:42.562430 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f658d40-75f9-47fc-aed9-5c21ac3c298c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:42.600540 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:42.612788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ca1e7-2657-4524-ae9d-1ab29113aa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:42.614507 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ca1e7-2657-4524-ae9d-1ab29113aa16 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:42.615112 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ca1e7-2657-4524-ae9d-1ab29113aa16 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:42.615686 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ca1e7-2657-4524-ae9d-1ab29113aa16 None admin] PATH_INFO: `/v3/services/network` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:42.616659 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ca1e7-2657-4524-ae9d-1ab29113aa16 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:42.618508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ca1e7-2657-4524-ae9d-1ab29113aa16 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:42.634990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-dd7ca1e7-2657-4524-ae9d-1ab29113aa16 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:11:42.634990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:42.634990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:11:42.634990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:11:42.634990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:11:42.634990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:11:42.634990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:11:42.634990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:42.634990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:11:42.634990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:42.634990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:11:42.634990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:42.634990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:42.634990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:42.634990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:42.634990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:42.634990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:42.636361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:42.636361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:42.636361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:42.636361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:42.636361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:42.636361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:42.636361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:11:42.636361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:11:42.636361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:11:42.636361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:11:42.636361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:42.636361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:42.636361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:42.636361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:42.636361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:42.636361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:42.637558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:42.637558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:42.637558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:42.637558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:42.637558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:42.637558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:42.637558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:42.637558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:42.637558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:42.637558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:42.637558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:11:42.637558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:42.637558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 19:11:42.637558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:42.646796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 408/819] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:42 2022] GET /identity/v3/services/network => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:42.648216 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ca1e7-2657-4524-ae9d-1ab29113aa16 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:42.708019 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4dafb-b61b-413b-ab38-0fab583928a3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:42.764465 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea979f2e-6d8e-4635-9923-7991a243a444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:42.765304 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea979f2e-6d8e-4635-9923-7991a243a444 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:42.765688 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea979f2e-6d8e-4635-9923-7991a243a444 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:42.766094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea979f2e-6d8e-4635-9923-7991a243a444 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:42.766951 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea979f2e-6d8e-4635-9923-7991a243a444 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:42.767364 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea979f2e-6d8e-4635-9923-7991a243a444 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:42.768885 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea979f2e-6d8e-4635-9923-7991a243a444 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:42.774516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ca1e7-2657-4524-ae9d-1ab29113aa16 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:42.777711 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 412/820] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Jul 20 19:11:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:42.779156 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea979f2e-6d8e-4635-9923-7991a243a444 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:42.817417 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5b10e-d6d0-4629-86f4-c04ef7869272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:42.819496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5b10e-d6d0-4629-86f4-c04ef7869272 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:42.819496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5b10e-d6d0-4629-86f4-c04ef7869272 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:42.819496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5b10e-d6d0-4629-86f4-c04ef7869272 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:42.829146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5b10e-d6d0-4629-86f4-c04ef7869272 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:42.830849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5b10e-d6d0-4629-86f4-c04ef7869272 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:42.848484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b7a5b10e-d6d0-4629-86f4-c04ef7869272 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:11:42.848484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:42.848484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:42.848484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:42.848484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:42.848484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:42.848484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:42.848484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:42.848484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:42.848484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:42.848484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:42.848484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:42.848484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:42.848484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:42.848484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:42.848484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:42.849731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:42.849731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:42.849731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:42.849731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:42.849731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:42.849731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:42.849731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:42.849731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:42.849731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:42.849731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:42.849731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:42.849731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:42.849731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:42.849731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:42.849731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:42.849731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:42.849731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:42.849731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:42.850966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:42.850966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:42.850966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:42.850966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:42.850966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:42.850966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:42.850966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:42.850966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:42.850966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:11:42.850966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:42.856839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 409/821] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jul 20 19:11:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:42.856839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5b10e-d6d0-4629-86f4-c04ef7869272 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:42.886881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:42.947280 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea979f2e-6d8e-4635-9923-7991a243a444 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:42.948186 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:42.991143 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6e094-a06f-42f6-a778-a44f17f27b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:42.991962 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6e094-a06f-42f6-a778-a44f17f27b66 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:42.992348 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6e094-a06f-42f6-a778-a44f17f27b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:42.992744 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6e094-a06f-42f6-a778-a44f17f27b66 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:42.993550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6e094-a06f-42f6-a778-a44f17f27b66 None admin] RBAC: Adding query filter params (name=network) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:42.993959 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6e094-a06f-42f6-a778-a44f17f27b66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:42.995521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6e094-a06f-42f6-a778-a44f17f27b66 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:43.001582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 413/822] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 20 19:11:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:43.002593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6e094-a06f-42f6-a778-a44f17f27b66 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:43.020097 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5b10e-d6d0-4629-86f4-c04ef7869272 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:43.064585 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51eb30-8752-4bc4-84eb-9a0cb51188d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:43.065517 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51eb30-8752-4bc4-84eb-9a0cb51188d9 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:43.065900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51eb30-8752-4bc4-84eb-9a0cb51188d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:43.066270 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51eb30-8752-4bc4-84eb-9a0cb51188d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:43.067144 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51eb30-8752-4bc4-84eb-9a0cb51188d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:43.069002 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51eb30-8752-4bc4-84eb-9a0cb51188d9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:43.098469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 410/823] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 20 19:11:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:11:43.099946 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51eb30-8752-4bc4-84eb-9a0cb51188d9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:43.179115 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6e094-a06f-42f6-a778-a44f17f27b66 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:43.259494 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:43.285749 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51eb30-8752-4bc4-84eb-9a0cb51188d9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:43.294963 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:43.302762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c292050-c9b2-4ab5-9029-b8a3d2c4fbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:43.303455 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c292050-c9b2-4ab5-9029-b8a3d2c4fbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:43.303734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c292050-c9b2-4ab5-9029-b8a3d2c4fbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:43.304006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c292050-c9b2-4ab5-9029-b8a3d2c4fbb9 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:43.304852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c292050-c9b2-4ab5-9029-b8a3d2c4fbb9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:43.305160 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c292050-c9b2-4ab5-9029-b8a3d2c4fbb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:43.306632 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c292050-c9b2-4ab5-9029-b8a3d2c4fbb9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:43.327762 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb2d6d-fe38-45fb-b410-9226de1ae936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:43.328431 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb2d6d-fe38-45fb-b410-9226de1ae936 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:43.328636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb2d6d-fe38-45fb-b410-9226de1ae936 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:43.329021 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb2d6d-fe38-45fb-b410-9226de1ae936 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:43.330224 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb2d6d-fe38-45fb-b410-9226de1ae936 None admin] RBAC: Adding query filter params (type=network) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:43.330643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb2d6d-fe38-45fb-b410-9226de1ae936 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:43.332035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb2d6d-fe38-45fb-b410-9226de1ae936 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:43.336735 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 414/824] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jul 20 19:11:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:43.337906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 411/825] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 20 19:11:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:43.342820 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c292050-c9b2-4ab5-9029-b8a3d2c4fbb9 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:43.343694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb2d6d-fe38-45fb-b410-9226de1ae936 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:43.475468 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb2d6d-fe38-45fb-b410-9226de1ae936 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:43.497023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c292050-c9b2-4ab5-9029-b8a3d2c4fbb9 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:43.528704 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac511e1-085d-4f2f-9253-8854f0038c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:43.529664 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac511e1-085d-4f2f-9253-8854f0038c93 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:43.530025 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac511e1-085d-4f2f-9253-8854f0038c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:43.530416 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac511e1-085d-4f2f-9253-8854f0038c93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:43.531276 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac511e1-085d-4f2f-9253-8854f0038c93 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:43.532742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac511e1-085d-4f2f-9253-8854f0038c93 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:43.549667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad8353-1f16-48d8-8ac7-9224080cc47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:43.549900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad8353-1f16-48d8-8ac7-9224080cc47c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:43.552694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad8353-1f16-48d8-8ac7-9224080cc47c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:43.552694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad8353-1f16-48d8-8ac7-9224080cc47c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:43.572259 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 412/826] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 20 19:11:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:11:43.646040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:43.674094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad8353-1f16-48d8-8ac7-9224080cc47c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:43.675646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad8353-1f16-48d8-8ac7-9224080cc47c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:43.807419 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 415/827] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 19:11:43.814418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac511e1-085d-4f2f-9253-8854f0038c93 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:43.849570 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:43.890182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504e467-08f5-4c4a-a8fb-eabfc7cf9545 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:43.890504 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504e467-08f5-4c4a-a8fb-eabfc7cf9545 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:43.890785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504e467-08f5-4c4a-a8fb-eabfc7cf9545 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:43.892290 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 416/828] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:11:43.898517 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfd32e-1ffb-47ca-8fab-a86ee9ec0344 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:43.898808 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfd32e-1ffb-47ca-8fab-a86ee9ec0344 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:43.899090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfd32e-1ffb-47ca-8fab-a86ee9ec0344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:43.931454 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b0bfd32e-1ffb-47ca-8fab-a86ee9ec0344 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:43.932669 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b0bfd32e-1ffb-47ca-8fab-a86ee9ec0344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:43.960476 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac511e1-085d-4f2f-9253-8854f0038c93 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:44.013236 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581db877-d194-40be-a8f1-e1c00d9646fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:44.014929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581db877-d194-40be-a8f1-e1c00d9646fa None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:44.015525 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581db877-d194-40be-a8f1-e1c00d9646fa None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:44.015830 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581db877-d194-40be-a8f1-e1c00d9646fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:44.031573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581db877-d194-40be-a8f1-e1c00d9646fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:44.033958 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581db877-d194-40be-a8f1-e1c00d9646fa None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:44.037272 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 417/829] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:11:44.054158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-581db877-d194-40be-a8f1-e1c00d9646fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:44.054158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:44.054158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:44.054158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:44.054158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:44.054158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:44.054158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:44.054158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:44.054158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:44.054158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:44.054158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:44.054158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:44.054158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:44.054158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:44.054158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:44.056179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:44.056179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:44.056179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:44.056179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:44.056179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:44.056179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:44.056179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:44.056179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:44.056179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:44.056179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:44.056179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:44.056179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:44.056179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:44.056179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:44.056179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:44.056179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:44.056179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:44.057358 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:44.057358 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:44.057358 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:44.057358 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:44.057358 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 413/830] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:44.062906 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfd32e-1ffb-47ca-8fab-a86ee9ec0344 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:44.063260 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581db877-d194-40be-a8f1-e1c00d9646fa None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:44.080359 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:44.155784 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:44.190016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581db877-d194-40be-a8f1-e1c00d9646fa None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:44.196995 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfd32e-1ffb-47ca-8fab-a86ee9ec0344 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:44.230291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440ab2b-6d34-48ab-ac58-1edb1b742d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:44.231086 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440ab2b-6d34-48ab-ac58-1edb1b742d91 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:44.231442 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440ab2b-6d34-48ab-ac58-1edb1b742d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:44.231808 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440ab2b-6d34-48ab-ac58-1edb1b742d91 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:44.232716 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440ab2b-6d34-48ab-ac58-1edb1b742d91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:44.233183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440ab2b-6d34-48ab-ac58-1edb1b742d91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:44.234991 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440ab2b-6d34-48ab-ac58-1edb1b742d91 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:44.236429 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2a610-62cd-467d-91b0-ac2adf923492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:44.237566 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2a610-62cd-467d-91b0-ac2adf923492 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:44.238025 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2a610-62cd-467d-91b0-ac2adf923492 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:44.238542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2a610-62cd-467d-91b0-ac2adf923492 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:44.249688 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2a610-62cd-467d-91b0-ac2adf923492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:44.253943 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 414/831] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:44.254915 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440ab2b-6d34-48ab-ac58-1edb1b742d91 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:44.258731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-e6c2a610-62cd-467d-91b0-ac2adf923492 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:44.258731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:44.258731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:44.258731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:44.258731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:44.258731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:44.258731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:44.258731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:44.258731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:44.258731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:44.258731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:44.258731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:44.258731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:44.258731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:44.258731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:44.258731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:44.259788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:44.259788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:44.259788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:44.259788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:44.259788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:44.259788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:44.259788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:44.259788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:44.259788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:44.259788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:44.259788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:44.259788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:44.259788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:44.259788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:44.259788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:44.259788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:44.260667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:44.260667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:44.260667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:44.260667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:44.260667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:44.260667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:44.260667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:44.260667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:44.260667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:44.260667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:44.260667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:11:44.260667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:44.263609 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 418/832] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:11:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:44.272503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2a610-62cd-467d-91b0-ac2adf923492 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:44.347728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:44.358026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440ab2b-6d34-48ab-ac58-1edb1b742d91 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:44.384178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2a610-62cd-467d-91b0-ac2adf923492 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:44.388344 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:44.393612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae7163-0343-40fd-a180-08294fd680b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:44.394441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae7163-0343-40fd-a180-08294fd680b2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:44.394728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae7163-0343-40fd-a180-08294fd680b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:44.395008 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae7163-0343-40fd-a180-08294fd680b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:44.402880 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae7163-0343-40fd-a180-08294fd680b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:44.404403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae7163-0343-40fd-a180-08294fd680b2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:44.419708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-53ae7163-0343-40fd-a180-08294fd680b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:44.419708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:44.419708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:44.419708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:44.419708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:44.419708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:44.419708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:44.419708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:44.419708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:44.419708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:44.419708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:44.419708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:44.419708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:44.419708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:44.419708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:44.420661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:44.420661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:44.420661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:44.420661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:44.420661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:44.420661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:44.420661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:44.420661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:44.420661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:44.420661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:44.420661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:44.420661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:44.420661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:44.420661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:44.420661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:44.420661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:44.420661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:44.421595 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:44.421595 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:44.421595 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:44.421595 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:44.421595 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:44.421595 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:44.421595 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:44.421595 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:44.425784 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 415/833] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:44.426841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae7163-0343-40fd-a180-08294fd680b2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:44.430460 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7c93f-5c94-43ce-b5da-33868d15afb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:44.431426 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7c93f-5c94-43ce-b5da-33868d15afb5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:44.431947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7c93f-5c94-43ce-b5da-33868d15afb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:44.432431 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7c93f-5c94-43ce-b5da-33868d15afb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:44.433368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7c93f-5c94-43ce-b5da-33868d15afb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:44.433859 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7c93f-5c94-43ce-b5da-33868d15afb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:44.435502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7c93f-5c94-43ce-b5da-33868d15afb5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:44.450070 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 419/834] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:11:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:44.451372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7c93f-5c94-43ce-b5da-33868d15afb5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:44.534875 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae7163-0343-40fd-a180-08294fd680b2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:44.564391 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7c93f-5c94-43ce-b5da-33868d15afb5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:44.574518 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a14624-4423-451f-a695-11d77198767e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:44.575205 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a14624-4423-451f-a695-11d77198767e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:44.575491 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a14624-4423-451f-a695-11d77198767e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:44.575773 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a14624-4423-451f-a695-11d77198767e None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:44.576603 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a14624-4423-451f-a695-11d77198767e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:44.576915 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a14624-4423-451f-a695-11d77198767e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:44.578435 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a14624-4423-451f-a695-11d77198767e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:44.601483 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 416/835] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:44.602525 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a14624-4423-451f-a695-11d77198767e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:44.615613 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe038b-2bae-4b92-b03e-a6474bacbb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:44.617153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe038b-2bae-4b92-b03e-a6474bacbb36 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:44.617750 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe038b-2bae-4b92-b03e-a6474bacbb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:44.618223 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe038b-2bae-4b92-b03e-a6474bacbb36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:44.620880 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:44.635463 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe038b-2bae-4b92-b03e-a6474bacbb36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:44.638472 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe038b-2bae-4b92-b03e-a6474bacbb36 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:44.661116 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:44.663830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-fabe038b-2bae-4b92-b03e-a6474bacbb36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:44.663830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:44.663830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:44.663830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:44.663830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:44.663830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:44.663830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:44.663830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:44.663830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:44.663830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:44.663830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:44.663830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:44.663830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:44.663830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:44.663830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:44.664757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:44.664757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:44.664757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:44.664757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:44.664757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:44.664757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:44.664757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:44.664757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:44.664757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:44.664757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:44.664757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:44.664757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:44.664757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:44.664757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:44.664757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:44.664757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:44.664757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:44.665923 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:44.665923 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:44.665923 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:44.665923 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:44.673625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 420/836] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:44.674921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe038b-2bae-4b92-b03e-a6474bacbb36 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:44.712813 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a14624-4423-451f-a695-11d77198767e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:44.748104 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392ea12-7249-4c48-8f5d-48a12a97d424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:44.748767 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392ea12-7249-4c48-8f5d-48a12a97d424 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:44.749054 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392ea12-7249-4c48-8f5d-48a12a97d424 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:44.749333 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5392ea12-7249-4c48-8f5d-48a12a97d424 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:44.750178 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392ea12-7249-4c48-8f5d-48a12a97d424 None admin] RBAC: Adding query filter params (role.id=6322f657162c45ca85f019a408655ff3, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=a1f0f6bc94de4645a8c82038ff2bd34a) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:44.750514 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392ea12-7249-4c48-8f5d-48a12a97d424 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:44.751949 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5392ea12-7249-4c48-8f5d-48a12a97d424 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:44.762465 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 417/837] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:44 2022] GET /identity/v3/role_assignments?user.id=a1f0f6bc94de4645a8c82038ff2bd34a&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=6322f657162c45ca85f019a408655ff3 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:44.792820 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe038b-2bae-4b92-b03e-a6474bacbb36 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:44.833573 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764401e6-8225-4449-87cc-ac1ed494ecae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:44.834657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764401e6-8225-4449-87cc-ac1ed494ecae None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:44.835161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764401e6-8225-4449-87cc-ac1ed494ecae None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:44.835625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764401e6-8225-4449-87cc-ac1ed494ecae None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:44.836551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764401e6-8225-4449-87cc-ac1ed494ecae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:44.837050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764401e6-8225-4449-87cc-ac1ed494ecae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:44.838659 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764401e6-8225-4449-87cc-ac1ed494ecae None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:44.853630 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 421/838] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:44.859765 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392ea12-7249-4c48-8f5d-48a12a97d424 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:45.032790 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5392ea12-7249-4c48-8f5d-48a12a97d424 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:45.056211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:45.071049 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416733a1-b73f-4833-8f54-121ba4d3d329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:45.072363 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416733a1-b73f-4833-8f54-121ba4d3d329 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:45.072644 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416733a1-b73f-4833-8f54-121ba4d3d329 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:45.072919 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416733a1-b73f-4833-8f54-121ba4d3d329 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:45.081450 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416733a1-b73f-4833-8f54-121ba4d3d329 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:45.083033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416733a1-b73f-4833-8f54-121ba4d3d329 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:45.097783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-416733a1-b73f-4833-8f54-121ba4d3d329 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:11:45.097783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:45.097783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:45.097783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:45.097783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:45.097783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:45.097783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:45.097783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:45.097783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:45.097783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:45.097783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:45.097783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:45.097783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:45.097783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:45.097783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:45.097783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:45.098929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:45.098929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:45.098929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:45.098929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:45.098929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:45.098929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:45.098929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:45.098929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:45.098929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:45.098929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:45.098929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:45.098929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:45.098929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:45.098929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:45.098929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:45.098929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:45.098929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:45.098929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:45.099901 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:45.099901 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:45.099901 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:45.099901 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:45.099901 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:45.099901 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:45.099901 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:45.099901 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:45.099901 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 19:11:45.099901 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:45.099901 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 418/839] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:11:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:45.108436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764401e6-8225-4449-87cc-ac1ed494ecae None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:45.136450 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24186ebd-9037-4e83-8c4a-0b443edc463b None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:45.136809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24186ebd-9037-4e83-8c4a-0b443edc463b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:45.137032 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24186ebd-9037-4e83-8c4a-0b443edc463b None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:45.139735 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 419/840] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:45.143835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86156f-ef9d-41cd-8f98-ad4120056047 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:45.144163 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86156f-ef9d-41cd-8f98-ad4120056047 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:45.144484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86156f-ef9d-41cd-8f98-ad4120056047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:45.162391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-df86156f-ef9d-41cd-8f98-ad4120056047 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:45.163725 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-df86156f-ef9d-41cd-8f98-ad4120056047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:45.164608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:45.231065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764401e6-8225-4449-87cc-ac1ed494ecae None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:45.250511 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 420/841] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:11:45.268212 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaeb23-8739-430c-9fbd-e41484c5317e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:45.269055 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaeb23-8739-430c-9fbd-e41484c5317e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:45.269442 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaeb23-8739-430c-9fbd-e41484c5317e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:45.269820 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aaeb23-8739-430c-9fbd-e41484c5317e None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:45.271414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aaeb23-8739-430c-9fbd-e41484c5317e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:45.271834 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aaeb23-8739-430c-9fbd-e41484c5317e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:45.274344 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aaeb23-8739-430c-9fbd-e41484c5317e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:45.280296 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86156f-ef9d-41cd-8f98-ad4120056047 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:45.294009 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 422/842] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Jul 20 19:11:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:45.299562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaeb23-8739-430c-9fbd-e41484c5317e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:45.420095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86156f-ef9d-41cd-8f98-ad4120056047 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:45.430818 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:45.466292 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e5574-52fb-425c-84ed-bd839d0a1097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:45.467122 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e5574-52fb-425c-84ed-bd839d0a1097 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:45.467407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e5574-52fb-425c-84ed-bd839d0a1097 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:45.467683 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e5574-52fb-425c-84ed-bd839d0a1097 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:45.473661 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aaeb23-8739-430c-9fbd-e41484c5317e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:45.478805 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:45.483467 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e5574-52fb-425c-84ed-bd839d0a1097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:45.496576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-6f9e5574-52fb-425c-84ed-bd839d0a1097 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:45.496576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:45.496576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:45.496576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:45.496576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:45.496576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:45.496576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:45.496576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:45.496576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:45.496576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:45.496576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:45.496576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:45.496576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:45.496576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:45.496576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:45.496576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:45.497652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:45.497652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:45.497652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:45.497652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:45.497652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:45.497652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:45.497652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:45.497652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:45.497652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:45.497652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:45.497652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:45.497652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:45.497652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:45.497652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:45.497652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:45.497652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:45.498926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:45.498926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:45.498926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:45.498926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:45.498926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:45.498926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:45.498926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:45.498926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:45.498926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:45.498926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:45.498926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:11:45.498926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:45.498926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 421/843] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:11:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:45.511263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e5574-52fb-425c-84ed-bd839d0a1097 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:45.525327 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550a000-2da7-473d-b69a-4134aaeece0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:45.526607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550a000-2da7-473d-b69a-4134aaeece0f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:45.526918 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550a000-2da7-473d-b69a-4134aaeece0f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:45.527200 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550a000-2da7-473d-b69a-4134aaeece0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:45.614775 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550a000-2da7-473d-b69a-4134aaeece0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:45.616667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550a000-2da7-473d-b69a-4134aaeece0f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:45.653871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e5574-52fb-425c-84ed-bd839d0a1097 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:45.689858 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52f7d4-59b0-41ac-bfb1-bcef630c99fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:45.690581 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52f7d4-59b0-41ac-bfb1-bcef630c99fb None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:45.691166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52f7d4-59b0-41ac-bfb1-bcef630c99fb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:45.691528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52f7d4-59b0-41ac-bfb1-bcef630c99fb None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:45.692834 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52f7d4-59b0-41ac-bfb1-bcef630c99fb None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:45.693151 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52f7d4-59b0-41ac-bfb1-bcef630c99fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:45.694546 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52f7d4-59b0-41ac-bfb1-bcef630c99fb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:45.703036 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 422/844] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 20 19:11:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:45.704258 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421f915-8677-4afe-83fc-7378b848e56f None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:45.704630 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421f915-8677-4afe-83fc-7378b848e56f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:45.704811 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421f915-8677-4afe-83fc-7378b848e56f None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:45.706332 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 423/845] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:45.711399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a26b46-600a-48bb-9420-867d36b448a0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:45.711687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a26b46-600a-48bb-9420-867d36b448a0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:45.711965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a26b46-600a-48bb-9420-867d36b448a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:45.729244 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-45a26b46-600a-48bb-9420-867d36b448a0 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:45.730480 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-45a26b46-600a-48bb-9420-867d36b448a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:45.740361 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 423/846] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:45 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 19:11:45.742016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550a000-2da7-473d-b69a-4134aaeece0f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:45.746801 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:45.757954 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:45.809662 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 424/847] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:11:45.810635 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a26b46-600a-48bb-9420-867d36b448a0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:45.881495 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550a000-2da7-473d-b69a-4134aaeece0f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:45.922111 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a26b46-600a-48bb-9420-867d36b448a0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:45.923986 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de3a73-7f40-4b7e-aba0-35cacb8b2ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:45.924839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de3a73-7f40-4b7e-aba0-35cacb8b2ffd None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:45.925121 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de3a73-7f40-4b7e-aba0-35cacb8b2ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:45.925446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de3a73-7f40-4b7e-aba0-35cacb8b2ffd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:45.937264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de3a73-7f40-4b7e-aba0-35cacb8b2ffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:45.938785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de3a73-7f40-4b7e-aba0-35cacb8b2ffd None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:45.958328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-a1de3a73-7f40-4b7e-aba0-35cacb8b2ffd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:45.958328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:45.958328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:45.958328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:45.958328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:45.958328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:45.958328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:45.958328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:45.958328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:45.958328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:45.958328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:45.958328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:45.958328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:45.958328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:45.958328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:45.959739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:45.959739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:45.959739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:45.959739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:45.959739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:45.959739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:45.959739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:45.959739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:45.959739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:45.959739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:45.959739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:45.959739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:45.959739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:45.959739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:45.959739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:45.959739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:45.959739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:45.961332 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:45.961332 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:45.961332 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:45.961332 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:45.961332 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 424/848] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:45.961332 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de3a73-7f40-4b7e-aba0-35cacb8b2ffd None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:45.970315 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b702b-f0ad-4d71-83ef-de76829cdf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:45.971290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b702b-f0ad-4d71-83ef-de76829cdf7b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:45.971681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b702b-f0ad-4d71-83ef-de76829cdf7b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:45.972036 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b702b-f0ad-4d71-83ef-de76829cdf7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:45.988239 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b702b-f0ad-4d71-83ef-de76829cdf7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:45.991763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b702b-f0ad-4d71-83ef-de76829cdf7b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:46.017656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ce1b702b-f0ad-4d71-83ef-de76829cdf7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:46.017656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:46.017656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:46.017656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:46.017656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:46.017656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:46.017656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:46.017656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:46.017656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:46.017656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:46.017656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:46.017656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:46.017656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:46.017656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:46.017656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:46.018665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:46.018665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:46.018665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:46.018665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:46.018665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:46.018665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:46.018665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:46.018665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:46.018665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:46.018665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:46.018665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:46.018665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:46.018665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:46.018665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:46.018665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:46.018665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:46.018665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:46.019596 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:46.019596 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:46.019596 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:46.019596 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:46.026873 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 425/849] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:46.029154 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b702b-f0ad-4d71-83ef-de76829cdf7b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:46.041636 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:46.043885 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:46.113029 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de3a73-7f40-4b7e-aba0-35cacb8b2ffd None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:46.155228 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b702b-f0ad-4d71-83ef-de76829cdf7b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:46.160138 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008cb25-f82b-473a-a874-7f184aee6341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:46.161508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008cb25-f82b-473a-a874-7f184aee6341 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:46.161804 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008cb25-f82b-473a-a874-7f184aee6341 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:46.162086 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008cb25-f82b-473a-a874-7f184aee6341 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:46.162804 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008cb25-f82b-473a-a874-7f184aee6341 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:46.164196 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008cb25-f82b-473a-a874-7f184aee6341 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:46.179161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-6008cb25-f82b-473a-a874-7f184aee6341 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:11:46.179161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:46.179161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:11:46.179161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:11:46.179161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:11:46.179161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:11:46.179161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:11:46.179161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:46.179161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:11:46.179161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:46.179161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:11:46.179161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:46.179161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:46.179161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:46.179161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:46.179161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:46.179161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:46.180293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:46.180293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:46.180293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:46.180293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:46.180293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:46.180293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:46.180293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:11:46.180293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:11:46.180293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:11:46.180293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:11:46.180293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:46.180293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:46.180293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:46.180293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:46.180293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:46.180293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:46.181172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:46.181172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:46.181172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:46.181172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:46.181172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:46.181172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:46.181172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:46.181172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:46.181172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:46.181172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:46.181172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:11:46.181172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:46.181172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:11:46.181172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:46.181172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 425/850] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 20 19:11:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:46.182077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008cb25-f82b-473a-a874-7f184aee6341 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:46.208758 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990e070-08c9-46ba-9d33-07e879a3f6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:46.209939 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990e070-08c9-46ba-9d33-07e879a3f6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:46.210411 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990e070-08c9-46ba-9d33-07e879a3f6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:46.210823 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990e070-08c9-46ba-9d33-07e879a3f6a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:46.211693 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990e070-08c9-46ba-9d33-07e879a3f6a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:46.212160 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990e070-08c9-46ba-9d33-07e879a3f6a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:46.213776 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990e070-08c9-46ba-9d33-07e879a3f6a7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:46.232193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 426/851] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:46.232193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990e070-08c9-46ba-9d33-07e879a3f6a7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:46.312858 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008cb25-f82b-473a-a874-7f184aee6341 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:46.317505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:46.335727 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:46.359850 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990e070-08c9-46ba-9d33-07e879a3f6a7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:46.360051 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59657a-cc3b-4b74-be0d-105a4ed2550e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:46.360652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59657a-cc3b-4b74-be0d-105a4ed2550e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:46.361010 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59657a-cc3b-4b74-be0d-105a4ed2550e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:46.361364 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59657a-cc3b-4b74-be0d-105a4ed2550e None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:46.362174 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59657a-cc3b-4b74-be0d-105a4ed2550e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:46.362581 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59657a-cc3b-4b74-be0d-105a4ed2550e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:46.364622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb59657a-cc3b-4b74-be0d-105a4ed2550e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:46.378685 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 426/852] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:46.379367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59657a-cc3b-4b74-be0d-105a4ed2550e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:46.413073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baaf2ef-4cd8-4f09-883e-b4f00f30a67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:46.413658 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaf2ef-4cd8-4f09-883e-b4f00f30a67c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:46.413942 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaf2ef-4cd8-4f09-883e-b4f00f30a67c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:46.414219 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baaf2ef-4cd8-4f09-883e-b4f00f30a67c None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:46.414965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baaf2ef-4cd8-4f09-883e-b4f00f30a67c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:46.415281 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baaf2ef-4cd8-4f09-883e-b4f00f30a67c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:46.416646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baaf2ef-4cd8-4f09-883e-b4f00f30a67c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:46.428118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 427/853] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 20 19:11:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:46.428118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baaf2ef-4cd8-4f09-883e-b4f00f30a67c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:46.564906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baaf2ef-4cd8-4f09-883e-b4f00f30a67c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:46.615311 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31a4b2-8673-4d3d-b0da-3611d81c5888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:46.615969 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31a4b2-8673-4d3d-b0da-3611d81c5888 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:46.616252 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31a4b2-8673-4d3d-b0da-3611d81c5888 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:46.616533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31a4b2-8673-4d3d-b0da-3611d81c5888 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:46.620018 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:46.624526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31a4b2-8673-4d3d-b0da-3611d81c5888 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:46.625941 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31a4b2-8673-4d3d-b0da-3611d81c5888 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:46.630529 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb59657a-cc3b-4b74-be0d-105a4ed2550e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:46.642029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-6f31a4b2-8673-4d3d-b0da-3611d81c5888 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:46.642029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:46.642029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:46.642029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:46.642029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:46.642029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:46.642029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:46.642029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:46.642029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:46.642029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:46.642029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:46.642029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:46.642029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:46.642029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:46.642029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:46.643204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:46.643204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:46.643204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:46.643204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:46.643204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:46.643204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:46.643204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:46.643204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:46.643204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:46.643204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:46.643204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:46.643204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:46.643204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:46.643204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:46.643204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:46.643204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:46.643204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:46.644135 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:46.644135 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:46.644135 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:46.644135 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:46.644135 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:46.644135 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:46.644135 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:46.644135 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:46.644135 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 428/854] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:46.644135 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31a4b2-8673-4d3d-b0da-3611d81c5888 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:46.688091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29799351-037d-4ea6-9249-42d889692e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:46.689150 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29799351-037d-4ea6-9249-42d889692e78 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:46.689574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29799351-037d-4ea6-9249-42d889692e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:46.689962 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29799351-037d-4ea6-9249-42d889692e78 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:46.698230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29799351-037d-4ea6-9249-42d889692e78 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:46.699777 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29799351-037d-4ea6-9249-42d889692e78 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:46.716770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-29799351-037d-4ea6-9249-42d889692e78 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:11:46.716770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:46.716770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:46.716770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:46.716770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:46.716770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:46.716770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:46.716770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:46.716770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:46.716770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:46.716770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:46.716770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:46.716770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:46.716770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:46.716770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:46.716770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:46.717907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:46.717907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:46.717907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:46.717907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:46.717907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:46.717907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:46.717907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:46.717907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:46.717907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:46.717907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:46.717907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:46.717907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:46.717907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:46.717907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:46.717907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:46.717907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:46.717907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:46.717907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:46.719694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:46.719694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:46.719694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:46.719694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:46.719694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:46.719694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:46.719694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:46.719694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:46.719694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:11:46.719694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:46.719694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 427/855] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jul 20 19:11:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:46.719694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29799351-037d-4ea6-9249-42d889692e78 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:46.766325 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:46.793941 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31a4b2-8673-4d3d-b0da-3611d81c5888 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:46.845776 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede58e33-a8d4-4a54-879b-aa5ea5a11fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:46.846566 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede58e33-a8d4-4a54-879b-aa5ea5a11fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:46.846917 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede58e33-a8d4-4a54-879b-aa5ea5a11fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:46.847263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede58e33-a8d4-4a54-879b-aa5ea5a11fd4 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:46.847504 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29799351-037d-4ea6-9249-42d889692e78 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:46.848096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede58e33-a8d4-4a54-879b-aa5ea5a11fd4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:46.848749 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede58e33-a8d4-4a54-879b-aa5ea5a11fd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:46.850666 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede58e33-a8d4-4a54-879b-aa5ea5a11fd4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:46.855443 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 429/856] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 20 19:11:46 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:46.864290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede58e33-a8d4-4a54-879b-aa5ea5a11fd4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:46.895026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0899943-8191-4d8e-844a-507dda5c102a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:46.896766 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0899943-8191-4d8e-844a-507dda5c102a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:46.897348 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0899943-8191-4d8e-844a-507dda5c102a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:46.897830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0899943-8191-4d8e-844a-507dda5c102a None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:46.899316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0899943-8191-4d8e-844a-507dda5c102a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:46.899482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0899943-8191-4d8e-844a-507dda5c102a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:46.901618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0899943-8191-4d8e-844a-507dda5c102a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:46.928203 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 428/857] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:46.929322 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0899943-8191-4d8e-844a-507dda5c102a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:46.951944 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:47.016278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede58e33-a8d4-4a54-879b-aa5ea5a11fd4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:47.056259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:47.059658 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0899943-8191-4d8e-844a-507dda5c102a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:47.064550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebd53b-9672-44db-9ea1-bb733d1436f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:47.065577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebd53b-9672-44db-9ea1-bb733d1436f5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:47.066092 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebd53b-9672-44db-9ea1-bb733d1436f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:47.066634 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebd53b-9672-44db-9ea1-bb733d1436f5 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:47.068795 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebd53b-9672-44db-9ea1-bb733d1436f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:47.069352 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebd53b-9672-44db-9ea1-bb733d1436f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:47.072117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebd53b-9672-44db-9ea1-bb733d1436f5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:47.096007 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 430/858] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jul 20 19:11:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:47.097445 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c3ea9-edea-4c0a-a1a4-3571d39ea471 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:47.097734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c3ea9-edea-4c0a-a1a4-3571d39ea471 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:47.098013 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c3ea9-edea-4c0a-a1a4-3571d39ea471 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:47.099498 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 431/859] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:47.104211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c3ea9-edea-4c0a-a1a4-3571d39ea471 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:47.116390 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3fcf7-b749-428c-a67c-d1668b904d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:47.118033 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3fcf7-b749-428c-a67c-d1668b904d14 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:47.118890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3fcf7-b749-428c-a67c-d1668b904d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:47.120247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3fcf7-b749-428c-a67c-d1668b904d14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:47.121896 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3fcf7-b749-428c-a67c-d1668b904d14 None admin] RBAC: Adding query filter params (role.id=6322f657162c45ca85f019a408655ff3, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=0ebd7c59f0014a3886fa75fb35a40e64) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:47.122821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3fcf7-b749-428c-a67c-d1668b904d14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:47.124779 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3fcf7-b749-428c-a67c-d1668b904d14 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:47.132990 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 429/860] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:46 2022] GET /identity/v3/role_assignments?user.id=0ebd7c59f0014a3886fa75fb35a40e64&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=6322f657162c45ca85f019a408655ff3 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:47.146402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e921cf-a639-4cd9-8165-429b0af623a3 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:47.146936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e921cf-a639-4cd9-8165-429b0af623a3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:47.147369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e921cf-a639-4cd9-8165-429b0af623a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:47.179199 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c3e921cf-a639-4cd9-8165-429b0af623a3 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:47.181009 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c3e921cf-a639-4cd9-8165-429b0af623a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:47.266334 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c3ea9-edea-4c0a-a1a4-3571d39ea471 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:47.275968 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:47.278141 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 430/861] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:11:47.297863 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e921cf-a639-4cd9-8165-429b0af623a3 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:47.305920 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ef58f-c301-42eb-b915-29254d1556dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:47.306647 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ef58f-c301-42eb-b915-29254d1556dd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:47.306934 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ef58f-c301-42eb-b915-29254d1556dd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:47.307269 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ef58f-c301-42eb-b915-29254d1556dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:47.418692 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ef58f-c301-42eb-b915-29254d1556dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:47.424333 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ef58f-c301-42eb-b915-29254d1556dd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:47.452483 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:47.459244 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e921cf-a639-4cd9-8165-429b0af623a3 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:47.508047 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b095e-d7fc-42cd-bcb1-5eb6e4b8c009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:47.509295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b095e-d7fc-42cd-bcb1-5eb6e4b8c009 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:47.509888 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b095e-d7fc-42cd-bcb1-5eb6e4b8c009 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:47.510409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b095e-d7fc-42cd-bcb1-5eb6e4b8c009 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:47.511340 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b095e-d7fc-42cd-bcb1-5eb6e4b8c009 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:47.513048 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b095e-d7fc-42cd-bcb1-5eb6e4b8c009 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:47.527921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-7e7b095e-d7fc-42cd-bcb1-5eb6e4b8c009 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:11:47.527921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:47.527921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:11:47.527921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:11:47.527921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:11:47.527921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:11:47.527921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:11:47.527921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:47.527921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:11:47.527921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:47.527921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:11:47.527921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:47.527921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:47.527921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:47.527921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:47.527921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:47.528936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:47.528936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:47.528936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:47.528936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:47.528936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:47.528936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:47.528936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:47.528936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:11:47.528936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:11:47.528936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:11:47.528936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:11:47.528936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:47.528936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:47.528936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:47.528936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:47.528936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:47.529809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:47.529809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:47.529809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:47.529809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:47.529809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:47.529809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:47.529809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:47.529809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:47.529809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:47.529809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:47.529809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:47.529809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:11:47.529809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:47.529809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:11:47.529809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:47.532764 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 431/862] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Jul 20 19:11:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:47.542287 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b095e-d7fc-42cd-bcb1-5eb6e4b8c009 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:47.560101 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 432/863] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:47 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:11:47.567960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ef58f-c301-42eb-b915-29254d1556dd None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:47.588843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:47.672885 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b095e-d7fc-42cd-bcb1-5eb6e4b8c009 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:47.680710 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ef58f-c301-42eb-b915-29254d1556dd None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:47.711997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c8a30-2bdc-49e6-a014-21d73e284830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:47.712675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c8a30-2bdc-49e6-a014-21d73e284830 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:47.712958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c8a30-2bdc-49e6-a014-21d73e284830 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:47.713348 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c8a30-2bdc-49e6-a014-21d73e284830 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:47.714156 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c8a30-2bdc-49e6-a014-21d73e284830 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:47.714493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c8a30-2bdc-49e6-a014-21d73e284830 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:47.716468 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c8a30-2bdc-49e6-a014-21d73e284830 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:47.726666 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 432/864] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jul 20 19:11:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:47.728224 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c8a30-2bdc-49e6-a014-21d73e284830 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:47.731362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031143d-fda2-4bc8-aa6f-e51aaf76f5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:47.732227 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031143d-fda2-4bc8-aa6f-e51aaf76f5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:47.732513 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031143d-fda2-4bc8-aa6f-e51aaf76f5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:47.732791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031143d-fda2-4bc8-aa6f-e51aaf76f5a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:47.744104 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031143d-fda2-4bc8-aa6f-e51aaf76f5a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:47.746109 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031143d-fda2-4bc8-aa6f-e51aaf76f5a6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:47.758720 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:47.765945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e031143d-fda2-4bc8-aa6f-e51aaf76f5a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:47.765945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:47.765945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:47.765945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:47.765945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:47.765945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:47.765945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:47.765945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:47.765945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:47.765945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:47.765945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:47.765945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:47.765945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:47.765945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:47.765945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:47.767095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:47.767095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:47.767095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:47.767095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:47.767095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:47.767095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:47.767095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:47.767095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:47.767095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:47.767095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:47.767095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:47.767095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:47.767095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:47.767095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:47.767095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:47.767095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:47.767095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:47.768231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:47.768231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:47.768231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:47.768231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:47.770121 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 433/865] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:47.776384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031143d-fda2-4bc8-aa6f-e51aaf76f5a6 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:47.847945 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c8a30-2bdc-49e6-a014-21d73e284830 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:47.853155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:47.888185 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc2b1c-902f-4c78-b163-e868354070fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:47.888663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031143d-fda2-4bc8-aa6f-e51aaf76f5a6 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:47.889460 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc2b1c-902f-4c78-b163-e868354070fe None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:47.890218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc2b1c-902f-4c78-b163-e868354070fe None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:47.890755 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc2b1c-902f-4c78-b163-e868354070fe None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:47.892574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc2b1c-902f-4c78-b163-e868354070fe None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:47.893125 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc2b1c-902f-4c78-b163-e868354070fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:47.894727 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc2b1c-902f-4c78-b163-e868354070fe None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:47.906788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 433/866] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jul 20 19:11:47 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:47.938934 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166136cc-7f81-4f38-b930-f0e32656fc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:47.939622 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166136cc-7f81-4f38-b930-f0e32656fc5d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:47.939909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166136cc-7f81-4f38-b930-f0e32656fc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:47.940189 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166136cc-7f81-4f38-b930-f0e32656fc5d None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:47.940997 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166136cc-7f81-4f38-b930-f0e32656fc5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:47.941315 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166136cc-7f81-4f38-b930-f0e32656fc5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:47.943376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166136cc-7f81-4f38-b930-f0e32656fc5d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:47.964309 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 434/867] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:47.971560 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc2b1c-902f-4c78-b163-e868354070fe None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:48.071628 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:48.089333 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc2b1c-902f-4c78-b163-e868354070fe None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:48.127923 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141f1f1-ea25-44d2-a3af-a02042101b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:48.130148 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141f1f1-ea25-44d2-a3af-a02042101b44 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:48.130664 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141f1f1-ea25-44d2-a3af-a02042101b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:48.131184 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141f1f1-ea25-44d2-a3af-a02042101b44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:48.138955 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141f1f1-ea25-44d2-a3af-a02042101b44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:48.140740 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141f1f1-ea25-44d2-a3af-a02042101b44 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:48.155674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-b141f1f1-ea25-44d2-a3af-a02042101b44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:48.155674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:48.155674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:48.155674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:48.155674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:48.155674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:48.155674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:48.155674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:48.155674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:48.155674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:48.155674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:48.155674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:48.155674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:48.155674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:48.155674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:48.156617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:48.156617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:48.156617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:48.156617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:48.156617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:48.156617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:48.156617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:48.156617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:48.156617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:48.156617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:48.156617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:48.156617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:48.156617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:48.156617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:48.156617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:48.156617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:48.156617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:48.157520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:48.157520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:48.157520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:48.157520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:48.157520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:48.157520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:48.157520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:48.157520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:48.160307 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 434/868] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:48.167389 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166136cc-7f81-4f38-b930-f0e32656fc5d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:48.278909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166136cc-7f81-4f38-b930-f0e32656fc5d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:48.308052 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:48.317398 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd6a9e-f44c-4070-9012-02217203e25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:48.318454 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd6a9e-f44c-4070-9012-02217203e25b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:48.318948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd6a9e-f44c-4070-9012-02217203e25b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:48.319426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd6a9e-f44c-4070-9012-02217203e25b None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:48.320443 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd6a9e-f44c-4070-9012-02217203e25b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:48.320971 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd6a9e-f44c-4070-9012-02217203e25b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:48.322625 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd6a9e-f44c-4070-9012-02217203e25b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:48.343631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 435/869] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:48.350721 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141f1f1-ea25-44d2-a3af-a02042101b44 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:48.456929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141f1f1-ea25-44d2-a3af-a02042101b44 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:48.505939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df30f7-6565-4a5a-92f6-c153099abe71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:48.507007 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df30f7-6565-4a5a-92f6-c153099abe71 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:48.507497 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df30f7-6565-4a5a-92f6-c153099abe71 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:48.507994 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df30f7-6565-4a5a-92f6-c153099abe71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:48.509179 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df30f7-6565-4a5a-92f6-c153099abe71 None admin] RBAC: Adding query filter params (role.id=3e2d1ff906b74bec9c7410e3a3ec9448, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=e78792e617d84a7cbb384ed764c391fb) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:48.509831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df30f7-6565-4a5a-92f6-c153099abe71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:48.511571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df30f7-6565-4a5a-92f6-c153099abe71 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:48.518898 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 435/870] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:48 2022] GET /identity/v3/role_assignments?user.id=e78792e617d84a7cbb384ed764c391fb&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=3e2d1ff906b74bec9c7410e3a3ec9448 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:49.372203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4f941-cbb6-4482-a65c-631b13515214 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:49.372869 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4f941-cbb6-4482-a65c-631b13515214 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:49.372869 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4f941-cbb6-4482-a65c-631b13515214 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:49.374402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 436/871] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:49.380309 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d4405-e93a-4a29-aa21-466c9b5f281e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:49.380768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d4405-e93a-4a29-aa21-466c9b5f281e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:49.380861 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d4405-e93a-4a29-aa21-466c9b5f281e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:49.397678 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f12d4405-e93a-4a29-aa21-466c9b5f281e None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:49.398915 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f12d4405-e93a-4a29-aa21-466c9b5f281e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:49.401910 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:49.468785 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199720fa-77e6-481c-afaa-046d54684ff5 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:49.469190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199720fa-77e6-481c-afaa-046d54684ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:49.469565 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199720fa-77e6-481c-afaa-046d54684ff5 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:49.471829 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 436/873] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:11:49.471997 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 437/873] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:49.479170 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9e5bb-e097-46b1-83cf-b581931d1bc0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:49.479455 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9e5bb-e097-46b1-83cf-b581931d1bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:49.479726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9e5bb-e097-46b1-83cf-b581931d1bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:49.498464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199720fa-77e6-481c-afaa-046d54684ff5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:49.500148 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-edf9e5bb-e097-46b1-83cf-b581931d1bc0 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:49.501330 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-edf9e5bb-e097-46b1-83cf-b581931d1bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:49.603994 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 437/874] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:11:49.630259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9e5bb-e097-46b1-83cf-b581931d1bc0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:49.651191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199720fa-77e6-481c-afaa-046d54684ff5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:49.691606 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ce894-c405-4c14-b71c-d08782b4d664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:49.693327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ce894-c405-4c14-b71c-d08782b4d664 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:49.693864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ce894-c405-4c14-b71c-d08782b4d664 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:49.694396 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ce894-c405-4c14-b71c-d08782b4d664 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:49.695329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ce894-c405-4c14-b71c-d08782b4d664 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:49.697157 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ce894-c405-4c14-b71c-d08782b4d664 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:49.718167 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 438/875] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 20 19:11:49 2022] POST /identity/v3/services => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:11:49.731234 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:49.773137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9e5bb-e097-46b1-83cf-b581931d1bc0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:49.824726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e6e24-3ad9-4ca3-b3d5-e610e6e4a76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:49.825952 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e6e24-3ad9-4ca3-b3d5-e610e6e4a76c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:49.826529 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e6e24-3ad9-4ca3-b3d5-e610e6e4a76c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:49.827022 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e6e24-3ad9-4ca3-b3d5-e610e6e4a76c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:49.827902 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e6e24-3ad9-4ca3-b3d5-e610e6e4a76c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:49.829604 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e6e24-3ad9-4ca3-b3d5-e610e6e4a76c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:49.843402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-f53e6e24-3ad9-4ca3-b3d5-e610e6e4a76c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:11:49.843402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:49.843402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:11:49.843402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:11:49.843402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:11:49.843402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:11:49.843402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:11:49.843402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:49.843402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:11:49.843402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:49.843402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:11:49.843402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:49.843402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:49.843402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:49.843402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:49.843402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:49.843402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:49.844597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:49.844597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:49.844597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:49.844597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:49.844597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:49.844597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:49.844597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:11:49.844597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:11:49.844597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:11:49.844597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:11:49.844597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:49.844597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:49.844597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:49.844597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:49.844597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:49.844597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:49.845531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:49.845531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:49.845531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:49.845531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:49.845531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:49.845531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:49.845531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:49.845531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:49.845531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:49.845531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:49.845531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:11:49.845531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:49.845531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:11:49.845531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:49.851252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 438/876] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jul 20 19:11:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:49.857767 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ce894-c405-4c14-b71c-d08782b4d664 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:49.921900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:49.992117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ce894-c405-4c14-b71c-d08782b4d664 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:50.027096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7b12a-17e8-479c-9048-32f0cd16ccd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:50.028118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7b12a-17e8-479c-9048-32f0cd16ccd8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:50.028630 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7b12a-17e8-479c-9048-32f0cd16ccd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:50.029110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7b12a-17e8-479c-9048-32f0cd16ccd8 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:50.030033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7b12a-17e8-479c-9048-32f0cd16ccd8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:50.030589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7b12a-17e8-479c-9048-32f0cd16ccd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:50.032186 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af7b12a-17e8-479c-9048-32f0cd16ccd8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:50.038413 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 439/877] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jul 20 19:11:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:50.044774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e6e24-3ad9-4ca3-b3d5-e610e6e4a76c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:50.123102 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba63212-8e3e-4589-ba3d-6f7ba9c07294 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:50.123454 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba63212-8e3e-4589-ba3d-6f7ba9c07294 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:50.123670 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba63212-8e3e-4589-ba3d-6f7ba9c07294 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:50.130005 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 440/878] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:11:50.131822 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4adf4d-b42a-4e1f-adab-45747cc4a317 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:50.132147 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4adf4d-b42a-4e1f-adab-45747cc4a317 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:50.132782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4adf4d-b42a-4e1f-adab-45747cc4a317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:50.155470 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9e4adf4d-b42a-4e1f-adab-45747cc4a317 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:50.157065 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9e4adf4d-b42a-4e1f-adab-45747cc4a317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:50.164613 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e6e24-3ad9-4ca3-b3d5-e610e6e4a76c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:50.202560 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:50.211531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a97f9b-e02a-44c0-8516-f1c18403d43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:50.212346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a97f9b-e02a-44c0-8516-f1c18403d43f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:50.212727 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a97f9b-e02a-44c0-8516-f1c18403d43f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:50.213102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a97f9b-e02a-44c0-8516-f1c18403d43f None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:50.213913 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a97f9b-e02a-44c0-8516-f1c18403d43f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:50.214362 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a97f9b-e02a-44c0-8516-f1c18403d43f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:50.215850 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a97f9b-e02a-44c0-8516-f1c18403d43f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:50.221335 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 439/879] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jul 20 19:11:50 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:50.258487 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 441/880] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:50 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:11:50.275610 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a97f9b-e02a-44c0-8516-f1c18403d43f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:50.404480 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a97f9b-e02a-44c0-8516-f1c18403d43f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:50.445739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3e913-9d3c-4b8a-991d-5906203154a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:50.446780 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3e913-9d3c-4b8a-991d-5906203154a9 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:50.447263 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3e913-9d3c-4b8a-991d-5906203154a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:50.447734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3e913-9d3c-4b8a-991d-5906203154a9 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:50.448656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3e913-9d3c-4b8a-991d-5906203154a9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:50.450737 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3e913-9d3c-4b8a-991d-5906203154a9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:50.473838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 440/881] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 20 19:11:50 2022] POST /identity/v3/services => generated 269 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:11:50.834604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622aeff0-72d0-4054-a063-d6665c665b9e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:50.835146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622aeff0-72d0-4054-a063-d6665c665b9e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:50.835146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622aeff0-72d0-4054-a063-d6665c665b9e None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:50.836663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 442/882] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:50.842381 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01d33f-30e5-47a0-8c8a-12ca8c97013b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:50.842701 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01d33f-30e5-47a0-8c8a-12ca8c97013b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:50.842985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01d33f-30e5-47a0-8c8a-12ca8c97013b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:50.861316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-cd01d33f-30e5-47a0-8c8a-12ca8c97013b None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:50.862563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cd01d33f-30e5-47a0-8c8a-12ca8c97013b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:50.926920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:50.965849 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 441/883] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:11:51.000730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622aeff0-72d0-4054-a063-d6665c665b9e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:51.074810 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:51.157473 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622aeff0-72d0-4054-a063-d6665c665b9e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:51.198832 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e025c9-3520-4fa4-8203-743be6a55cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:51.199981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e025c9-3520-4fa4-8203-743be6a55cca None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:51.200291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e025c9-3520-4fa4-8203-743be6a55cca None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:51.200575 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e025c9-3520-4fa4-8203-743be6a55cca None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:51.212228 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e025c9-3520-4fa4-8203-743be6a55cca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:51.220787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e6e025c9-3520-4fa4-8203-743be6a55cca None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:11:51.220787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:51.220787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:51.220787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:51.220787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:51.220787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:51.220787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:51.220787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:51.220787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:51.220787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:51.220787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:51.220787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:51.220787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:51.220787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:51.220787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:51.220787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:51.221844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:51.221844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:51.221844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:51.221844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:51.221844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:51.221844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:51.221844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:51.221844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:51.221844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:51.221844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:51.221844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:51.221844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:51.221844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:51.221844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:51.221844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:51.221844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:51.223215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:51.223215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:51.223215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:51.223215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:51.223215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:51.223215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:51.223215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:51.223215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:51.223215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:51.223215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:51.223215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:11:51.223215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:51.223215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 443/884] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jul 20 19:11:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:51.229203 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01d33f-30e5-47a0-8c8a-12ca8c97013b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:51.363769 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01d33f-30e5-47a0-8c8a-12ca8c97013b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:51.415687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e523f-04f0-4c44-84da-dab6d91c0fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:51.416525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e523f-04f0-4c44-84da-dab6d91c0fac None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:51.416784 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e523f-04f0-4c44-84da-dab6d91c0fac None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:51.417109 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e523f-04f0-4c44-84da-dab6d91c0fac None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:51.418000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e523f-04f0-4c44-84da-dab6d91c0fac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:51.418490 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e523f-04f0-4c44-84da-dab6d91c0fac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:51.420348 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880e523f-04f0-4c44-84da-dab6d91c0fac None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:51.438996 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 442/885] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jul 20 19:11:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:51.447538 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e025c9-3520-4fa4-8203-743be6a55cca None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:51.560046 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e025c9-3520-4fa4-8203-743be6a55cca None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:51.563687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:51.597061 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ded077-7496-4a5e-81fc-339b6098f700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:51.597863 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ded077-7496-4a5e-81fc-339b6098f700 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:51.598689 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ded077-7496-4a5e-81fc-339b6098f700 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:51.598967 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ded077-7496-4a5e-81fc-339b6098f700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:51.610101 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ded077-7496-4a5e-81fc-339b6098f700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:51.611710 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ded077-7496-4a5e-81fc-339b6098f700 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:51.631824 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-15ded077-7496-4a5e-81fc-339b6098f700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:51.631824 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:51.631824 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:51.631824 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:51.631824 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:51.631824 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:51.631824 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:51.631824 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:51.631824 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:51.631824 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:51.631824 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:51.631824 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:51.631824 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:51.631824 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:51.631824 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:51.632827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:51.632827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:51.632827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:51.632827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:51.632827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:51.632827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:51.632827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:51.632827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:51.632827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:51.632827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:51.632827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:51.632827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:51.632827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:51.632827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:51.632827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:51.632827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:51.632827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:51.633806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:51.633806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:51.633806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:51.633806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:51.633806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 444/886] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:51.641905 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e523f-04f0-4c44-84da-dab6d91c0fac None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:51.704869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:51.767583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e523f-04f0-4c44-84da-dab6d91c0fac None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:51.811026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215cf77-2039-436e-bbd6-b9e6e39cb10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:51.812018 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215cf77-2039-436e-bbd6-b9e6e39cb10d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:51.812499 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215cf77-2039-436e-bbd6-b9e6e39cb10d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:51.812924 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215cf77-2039-436e-bbd6-b9e6e39cb10d None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:51.813995 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215cf77-2039-436e-bbd6-b9e6e39cb10d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:51.814455 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215cf77-2039-436e-bbd6-b9e6e39cb10d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:51.816518 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215cf77-2039-436e-bbd6-b9e6e39cb10d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:51.833471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 443/887] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:51.840574 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ded077-7496-4a5e-81fc-339b6098f700 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:51.958006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ded077-7496-4a5e-81fc-339b6098f700 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:51.996140 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a411ec-61fb-46c4-8871-bf5c2c9cd1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:51.997053 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a411ec-61fb-46c4-8871-bf5c2c9cd1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:51.997343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a411ec-61fb-46c4-8871-bf5c2c9cd1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:51.997747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a411ec-61fb-46c4-8871-bf5c2c9cd1c6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:52.006462 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a411ec-61fb-46c4-8871-bf5c2c9cd1c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:52.007912 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a411ec-61fb-46c4-8871-bf5c2c9cd1c6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:52.024578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-b7a411ec-61fb-46c4-8871-bf5c2c9cd1c6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:11:52.024578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:52.024578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:52.024578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:52.024578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:52.024578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:52.024578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:52.024578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:52.024578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:52.024578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:52.024578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:52.024578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:52.024578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:52.024578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:52.024578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:52.024578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:52.026805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:52.026805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:52.026805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:52.026805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:52.026805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:52.026805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:52.026805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:52.026805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:52.026805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:52.026805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:52.026805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:52.026805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:52.026805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:52.026805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:52.026805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:52.026805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:52.026805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:52.026805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:52.029100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:52.029100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:52.029100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:52.029100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:52.029100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:52.029100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:52.029100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:52.029100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:52.029100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:11:52.029100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:52.030406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 445/888] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jul 20 19:11:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:52.034325 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215cf77-2039-436e-bbd6-b9e6e39cb10d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:52.130681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c067f70-7719-4c68-bfbc-a3ee4be14232 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:52.130681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c067f70-7719-4c68-bfbc-a3ee4be14232 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:52.130681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c067f70-7719-4c68-bfbc-a3ee4be14232 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:52.130681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 446/889] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:11:52.133150 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a673c6-9557-4c01-9573-98241360aba7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:52.133726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a673c6-9557-4c01-9573-98241360aba7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:52.134289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a673c6-9557-4c01-9573-98241360aba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:52.155965 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215cf77-2039-436e-bbd6-b9e6e39cb10d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:52.160176 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-22a673c6-9557-4c01-9573-98241360aba7 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:52.161012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:52.162404 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-22a673c6-9557-4c01-9573-98241360aba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:52.178204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:52.206762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2150b6-463b-401e-9ce1-e63794b54889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:52.207951 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2150b6-463b-401e-9ce1-e63794b54889 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:52.208679 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2150b6-463b-401e-9ce1-e63794b54889 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:52.209276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2150b6-463b-401e-9ce1-e63794b54889 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:52.210581 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2150b6-463b-401e-9ce1-e63794b54889 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:52.211245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2150b6-463b-401e-9ce1-e63794b54889 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:52.213205 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2150b6-463b-401e-9ce1-e63794b54889 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:52.238012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 444/890] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jul 20 19:11:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:52.245010 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2150b6-463b-401e-9ce1-e63794b54889 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:52.282328 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 447/891] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:11:52.304820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a673c6-9557-4c01-9573-98241360aba7 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:52.386956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2150b6-463b-401e-9ce1-e63794b54889 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:52.439091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd78d8-a34f-4350-b1ca-4458a80ebfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:52.440004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd78d8-a34f-4350-b1ca-4458a80ebfbb None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:52.440228 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd78d8-a34f-4350-b1ca-4458a80ebfbb None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:52.440606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd78d8-a34f-4350-b1ca-4458a80ebfbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:52.458896 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a673c6-9557-4c01-9573-98241360aba7 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:52.482105 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:52.510901 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27703224-df4d-47d0-8b5e-2746c18da7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:52.512182 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27703224-df4d-47d0-8b5e-2746c18da7aa None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:52.512479 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27703224-df4d-47d0-8b5e-2746c18da7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:52.512760 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27703224-df4d-47d0-8b5e-2746c18da7aa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:52.513644 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27703224-df4d-47d0-8b5e-2746c18da7aa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:52.515139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27703224-df4d-47d0-8b5e-2746c18da7aa None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:52.531769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-27703224-df4d-47d0-8b5e-2746c18da7aa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:11:52.531769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:52.531769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:11:52.531769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:11:52.531769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:11:52.531769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:11:52.531769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:11:52.531769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:52.531769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:11:52.531769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:52.531769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:11:52.531769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:52.531769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:52.531769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:52.531769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:52.531769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:52.531769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:52.533183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:52.533183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:52.533183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:52.533183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:52.533183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:52.533183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:52.533183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:11:52.533183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:11:52.533183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:11:52.533183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:11:52.533183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:52.533183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:52.533183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:52.533183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:52.533183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:52.533183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:52.534291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:52.534291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:52.534291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:52.534291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:52.534291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:52.534291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:52.534291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:52.534291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:52.534291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:52.534291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:52.534291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:11:52.534291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:52.534291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:11:52.534291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:52.538342 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 448/892] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 20 19:11:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:52.540091 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27703224-df4d-47d0-8b5e-2746c18da7aa None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:52.543588 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd78d8-a34f-4350-b1ca-4458a80ebfbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:52.545643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd78d8-a34f-4350-b1ca-4458a80ebfbb None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:52.561557 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:52.683391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27703224-df4d-47d0-8b5e-2746c18da7aa None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:52.690233 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 445/893] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:11:52 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:11:52.692545 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92f4ea-3689-4338-b996-4fec384e9087 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:52.693012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92f4ea-3689-4338-b996-4fec384e9087 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:52.693432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92f4ea-3689-4338-b996-4fec384e9087 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:52.698865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 446/894] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:52.698865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92f4ea-3689-4338-b996-4fec384e9087 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:52.724737 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396ba43-4399-484b-a6a8-10752b5e8a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:52.725396 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396ba43-4399-484b-a6a8-10752b5e8a53 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:52.725820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396ba43-4399-484b-a6a8-10752b5e8a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:52.726038 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396ba43-4399-484b-a6a8-10752b5e8a53 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:52.726694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396ba43-4399-484b-a6a8-10752b5e8a53 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:52.727008 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396ba43-4399-484b-a6a8-10752b5e8a53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:52.728383 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396ba43-4399-484b-a6a8-10752b5e8a53 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:52.738096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 449/895] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 20 19:11:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:52.738096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced26c48-7fa7-4c6a-894a-dde2c854ce9f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:52.738096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced26c48-7fa7-4c6a-894a-dde2c854ce9f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:52.738096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced26c48-7fa7-4c6a-894a-dde2c854ce9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:52.753038 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ced26c48-7fa7-4c6a-894a-dde2c854ce9f None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:52.754954 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ced26c48-7fa7-4c6a-894a-dde2c854ce9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:52.766922 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:52.828736 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 450/896] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:11:52.829385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced26c48-7fa7-4c6a-894a-dde2c854ce9f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:52.832981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:52.836640 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92f4ea-3689-4338-b996-4fec384e9087 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:52.887377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4426d5-ec46-4344-b45b-2b3e2c8c6d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:52.888760 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4426d5-ec46-4344-b45b-2b3e2c8c6d74 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:52.889259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4426d5-ec46-4344-b45b-2b3e2c8c6d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:52.889765 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4426d5-ec46-4344-b45b-2b3e2c8c6d74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:52.902620 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4426d5-ec46-4344-b45b-2b3e2c8c6d74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:52.904544 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4426d5-ec46-4344-b45b-2b3e2c8c6d74 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:52.923812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-4c4426d5-ec46-4344-b45b-2b3e2c8c6d74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:52.923812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:52.923812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:52.923812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:52.923812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:52.923812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:52.923812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:52.923812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:52.923812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:52.923812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:52.923812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:52.923812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:52.923812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:52.923812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:52.923812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:52.924975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:52.924975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:52.924975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:52.924975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:52.924975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:52.924975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:52.924975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:52.924975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:52.924975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:52.924975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:52.924975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:52.924975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:52.924975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:52.924975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:52.924975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:52.924975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:52.924975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:52.925916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:52.925916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:52.925916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:52.925916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:52.925916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 447/897] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:52.926803 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4426d5-ec46-4344-b45b-2b3e2c8c6d74 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:52.959835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced26c48-7fa7-4c6a-894a-dde2c854ce9f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:52.994597 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3efadf-104c-4e9a-bd69-58c1098bc5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:52.995190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3efadf-104c-4e9a-bd69-58c1098bc5ac None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:52.995474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3efadf-104c-4e9a-bd69-58c1098bc5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:52.995763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3efadf-104c-4e9a-bd69-58c1098bc5ac None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:52.996460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3efadf-104c-4e9a-bd69-58c1098bc5ac None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:52.996766 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3efadf-104c-4e9a-bd69-58c1098bc5ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:52.998119 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3efadf-104c-4e9a-bd69-58c1098bc5ac None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:53.002854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 451/898] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 20 19:11:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:53.003615 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3efadf-104c-4e9a-bd69-58c1098bc5ac None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:53.028023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4426d5-ec46-4344-b45b-2b3e2c8c6d74 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:53.041946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:53.070130 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9607ca-8031-4e5d-a21c-990b01a7db7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:53.070831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9607ca-8031-4e5d-a21c-990b01a7db7d None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:53.071118 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9607ca-8031-4e5d-a21c-990b01a7db7d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:53.071308 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:53.071412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9607ca-8031-4e5d-a21c-990b01a7db7d None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:53.072094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9607ca-8031-4e5d-a21c-990b01a7db7d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:53.073580 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9607ca-8031-4e5d-a21c-990b01a7db7d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:53.089165 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 448/899] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 20 19:11:52 2022] POST /identity/v3/services => generated 241 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:11:53.090946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e9c64-2592-42cc-b6f2-a58ec478f330 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:53.091393 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e9c64-2592-42cc-b6f2-a58ec478f330 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:53.091859 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e9c64-2592-42cc-b6f2-a58ec478f330 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:53.093710 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 449/900] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:53.094944 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e9c64-2592-42cc-b6f2-a58ec478f330 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:53.123873 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3efadf-104c-4e9a-bd69-58c1098bc5ac None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:53.169628 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fcb2e-bc03-4238-9980-e7e75806df4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:53.170444 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fcb2e-bc03-4238-9980-e7e75806df4a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:53.170796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fcb2e-bc03-4238-9980-e7e75806df4a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:53.171153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fcb2e-bc03-4238-9980-e7e75806df4a None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:53.171970 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94fcb2e-bc03-4238-9980-e7e75806df4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:53.172375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94fcb2e-bc03-4238-9980-e7e75806df4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:53.173800 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94fcb2e-bc03-4238-9980-e7e75806df4a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:53.186524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 452/901] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:53.187818 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97599294-633d-4a1e-875a-3894d336e597 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:53.188115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97599294-633d-4a1e-875a-3894d336e597 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:53.188460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97599294-633d-4a1e-875a-3894d336e597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:53.205577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-97599294-633d-4a1e-875a-3894d336e597 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:53.206848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-97599294-633d-4a1e-875a-3894d336e597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:53.235731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e9c64-2592-42cc-b6f2-a58ec478f330 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:53.278765 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c1a2c-6c34-4d2e-80ea-264ca933d2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:53.279428 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c1a2c-6c34-4d2e-80ea-264ca933d2df None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:53.279716 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c1a2c-6c34-4d2e-80ea-264ca933d2df None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:53.279985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c1a2c-6c34-4d2e-80ea-264ca933d2df None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:53.280783 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c1a2c-6c34-4d2e-80ea-264ca933d2df None admin] RBAC: Adding query filter params (interface=public, service_id=8fff04bfeb0342cb92a64337ae90b9cb, region_id=RegionOne) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:53.281092 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c1a2c-6c34-4d2e-80ea-264ca933d2df None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:53.283118 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c1a2c-6c34-4d2e-80ea-264ca933d2df None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:53.286609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 453/902] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:11:53.286609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97599294-633d-4a1e-875a-3894d336e597 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:53.294760 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 450/903] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jul 20 19:11:53 2022] GET /identity/v3/endpoints?service_id=8fff04bfeb0342cb92a64337ae90b9cb&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:53.296693 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c1a2c-6c34-4d2e-80ea-264ca933d2df None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:53.331802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:53.343965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:53.395252 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97599294-633d-4a1e-875a-3894d336e597 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:53.409364 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c1a2c-6c34-4d2e-80ea-264ca933d2df None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:53.434078 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c2de2-68c6-412c-b03c-daa5fb328c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:53.434913 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c2de2-68c6-412c-b03c-daa5fb328c87 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:53.435195 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c2de2-68c6-412c-b03c-daa5fb328c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:53.435616 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c2de2-68c6-412c-b03c-daa5fb328c87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:53.442921 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c2de2-68c6-412c-b03c-daa5fb328c87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:53.444437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c2de2-68c6-412c-b03c-daa5fb328c87 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:53.446749 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56ee97-4601-4c5f-8a2a-6b4d82f8cc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:53.447702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56ee97-4601-4c5f-8a2a-6b4d82f8cc51 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:53.447996 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56ee97-4601-4c5f-8a2a-6b4d82f8cc51 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:53.448274 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56ee97-4601-4c5f-8a2a-6b4d82f8cc51 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:53.448958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56ee97-4601-4c5f-8a2a-6b4d82f8cc51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:53.450364 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56ee97-4601-4c5f-8a2a-6b4d82f8cc51 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:53.465063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 451/904] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jul 20 19:11:53 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:11:53.465063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56ee97-4601-4c5f-8a2a-6b4d82f8cc51 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:53.465524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-cc1c2de2-68c6-412c-b03c-daa5fb328c87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:53.465524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:53.465524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:53.465524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:53.465524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:53.465524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:53.465524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:53.465524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:53.465524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:53.465524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:53.465524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:53.465524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:53.465524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:53.465524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:53.465524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:53.467203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:53.467203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:53.467203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:53.467203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:53.467203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:53.467203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:53.467203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:53.467203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:53.467203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:53.467203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:53.467203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:53.467203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:53.467203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:53.467203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:53.467203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:53.467203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:53.467203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:53.468962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:53.468962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:53.468962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:53.468962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:53.468962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:53.468962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:53.468962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:53.468962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:53.468962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 454/905] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:53.468962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c2de2-68c6-412c-b03c-daa5fb328c87 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:53.616001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c2de2-68c6-412c-b03c-daa5fb328c87 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:53.629900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:53.635601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56ee97-4601-4c5f-8a2a-6b4d82f8cc51 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:53.638968 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:53.672769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa383d7-71eb-4e89-9323-de24979cc8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:53.673887 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa383d7-71eb-4e89-9323-de24979cc8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:53.674241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa383d7-71eb-4e89-9323-de24979cc8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:53.674691 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa383d7-71eb-4e89-9323-de24979cc8f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:53.677002 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa383d7-71eb-4e89-9323-de24979cc8f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:53.677002 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa383d7-71eb-4e89-9323-de24979cc8f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:53.678016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa383d7-71eb-4e89-9323-de24979cc8f8 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:53.694231 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7f0c9-591d-4c62-8717-2e92ea9978c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:53.695119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7f0c9-591d-4c62-8717-2e92ea9978c7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:53.695393 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7f0c9-591d-4c62-8717-2e92ea9978c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:53.700580 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7f0c9-591d-4c62-8717-2e92ea9978c7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:53.700723 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 455/906] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:53.700814 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7f0c9-591d-4c62-8717-2e92ea9978c7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:53.700814 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7f0c9-591d-4c62-8717-2e92ea9978c7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:53.702943 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa383d7-71eb-4e89-9323-de24979cc8f8 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:53.724550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-8be7f0c9-591d-4c62-8717-2e92ea9978c7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:11:53.724550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:53.724550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:11:53.724550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:11:53.724550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:11:53.724550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:11:53.724550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:11:53.724550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:53.724550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:11:53.724550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:53.724550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:11:53.724550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:53.724550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:53.724550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:53.724550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:53.724550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:53.725830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:53.725830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:53.725830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:53.725830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:53.725830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:53.725830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:53.725830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:53.725830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:11:53.725830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:11:53.725830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:11:53.725830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:11:53.725830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:53.725830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:53.725830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:53.725830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:53.725830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:53.726838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:53.726838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:53.726838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:53.726838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:53.726838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:53.726838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:53.726838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:53.726838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:53.726838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:53.726838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:53.726838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:53.726838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:11:53.726838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:53.726838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:11:53.726838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:53.727657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 452/907] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Jul 20 19:11:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:53.733822 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7f0c9-591d-4c62-8717-2e92ea9978c7 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:53.823958 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa383d7-71eb-4e89-9323-de24979cc8f8 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:53.849077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7f0c9-591d-4c62-8717-2e92ea9978c7 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:53.860641 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aff718-4022-4fdf-8539-6aa46512e5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:53.861644 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aff718-4022-4fdf-8539-6aa46512e5ed None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:53.862133 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aff718-4022-4fdf-8539-6aa46512e5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:53.862637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aff718-4022-4fdf-8539-6aa46512e5ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:53.864267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aff718-4022-4fdf-8539-6aa46512e5ed None admin] RBAC: Adding query filter params (role.id=2c0eba8863f74445bb0726c9dc7510fb, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=e78792e617d84a7cbb384ed764c391fb) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:53.864811 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aff718-4022-4fdf-8539-6aa46512e5ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:53.866543 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aff718-4022-4fdf-8539-6aa46512e5ed None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:53.878589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 456/908] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:11:53 2022] GET /identity/v3/role_assignments?user.id=e78792e617d84a7cbb384ed764c391fb&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=2c0eba8863f74445bb0726c9dc7510fb => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:53.885365 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61217e50-bb20-4236-9fdf-790bcdd6f70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:53.886050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61217e50-bb20-4236-9fdf-790bcdd6f70c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:53.886353 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61217e50-bb20-4236-9fdf-790bcdd6f70c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:53.886633 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61217e50-bb20-4236-9fdf-790bcdd6f70c None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:53.887364 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61217e50-bb20-4236-9fdf-790bcdd6f70c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:53.887670 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61217e50-bb20-4236-9fdf-790bcdd6f70c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:53.889079 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61217e50-bb20-4236-9fdf-790bcdd6f70c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:53.895846 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 453/909] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jul 20 19:11:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:53.901942 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aff718-4022-4fdf-8539-6aa46512e5ed None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:53.943384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:54.025318 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aff718-4022-4fdf-8539-6aa46512e5ed None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:54.062681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c4e7d-7813-470f-8274-867fbc2cb5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:54.063362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c4e7d-7813-470f-8274-867fbc2cb5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:54.063644 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c4e7d-7813-470f-8274-867fbc2cb5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:54.063921 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c4e7d-7813-470f-8274-867fbc2cb5b5 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:54.064639 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c4e7d-7813-470f-8274-867fbc2cb5b5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:54.064950 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c4e7d-7813-470f-8274-867fbc2cb5b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:54.066402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c4e7d-7813-470f-8274-867fbc2cb5b5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:54.072201 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 457/910] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jul 20 19:11:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:54.078570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61217e50-bb20-4236-9fdf-790bcdd6f70c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:54.113704 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:54.191158 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61217e50-bb20-4236-9fdf-790bcdd6f70c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:54.230652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d67d2b-233a-48a2-bd46-c19b04e0d89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:54.232272 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d67d2b-233a-48a2-bd46-c19b04e0d89f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:54.233079 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d67d2b-233a-48a2-bd46-c19b04e0d89f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:54.233869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d67d2b-233a-48a2-bd46-c19b04e0d89f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:54.235707 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d67d2b-233a-48a2-bd46-c19b04e0d89f None admin] RBAC: Adding query filter params (interface=public, service_id=75cde4139e2f4b1cb7f24c45b4382549, region_id=RegionOne) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:54.236582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d67d2b-233a-48a2-bd46-c19b04e0d89f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:54.239541 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d67d2b-233a-48a2-bd46-c19b04e0d89f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:54.246816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 454/911] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jul 20 19:11:54 2022] GET /identity/v3/endpoints?service_id=75cde4139e2f4b1cb7f24c45b4382549&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:54.254553 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c4e7d-7813-470f-8274-867fbc2cb5b5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:54.360899 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:54.364167 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c4e7d-7813-470f-8274-867fbc2cb5b5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:54.402329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5375b-bffe-4e02-80e6-a9e20361922c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:54.403023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5375b-bffe-4e02-80e6-a9e20361922c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:54.403308 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5375b-bffe-4e02-80e6-a9e20361922c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:54.403586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5375b-bffe-4e02-80e6-a9e20361922c None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:54.404274 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5375b-bffe-4e02-80e6-a9e20361922c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:54.405664 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5375b-bffe-4e02-80e6-a9e20361922c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:54.412526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 458/912] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jul 20 19:11:54 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:11:55.295594 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d76c4d-87cb-41ba-8cf9-a23949c55a3c None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:55.296123 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d76c4d-87cb-41ba-8cf9-a23949c55a3c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:55.296241 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d76c4d-87cb-41ba-8cf9-a23949c55a3c None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:55.297826 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 455/913] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:55.304089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5194b8-eaf1-4e26-9631-f02e8b5fbe3a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:55.304538 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5194b8-eaf1-4e26-9631-f02e8b5fbe3a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:55.304762 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5194b8-eaf1-4e26-9631-f02e8b5fbe3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:55.322205 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6d5194b8-eaf1-4e26-9631-f02e8b5fbe3a None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:55.323437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6d5194b8-eaf1-4e26-9631-f02e8b5fbe3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:55.398162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 459/914] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:11:55.424880 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d76c4d-87cb-41ba-8cf9-a23949c55a3c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:55.536578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:55.556772 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d76c4d-87cb-41ba-8cf9-a23949c55a3c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:55.609658 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d456420-34ef-437b-ad90-3c8a39a08440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:55.610905 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d456420-34ef-437b-ad90-3c8a39a08440 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:55.611411 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d456420-34ef-437b-ad90-3c8a39a08440 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:55.611905 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d456420-34ef-437b-ad90-3c8a39a08440 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:55.612775 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d456420-34ef-437b-ad90-3c8a39a08440 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:55.614431 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d456420-34ef-437b-ad90-3c8a39a08440 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:55.627637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-4d456420-34ef-437b-ad90-3c8a39a08440 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:11:55.627637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:55.627637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:11:55.627637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:11:55.627637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:11:55.627637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:11:55.627637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:11:55.627637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:55.627637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:11:55.627637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:55.627637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:11:55.627637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:55.627637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:55.627637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:55.627637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:55.627637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:55.627637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:55.628702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:55.628702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:55.628702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:55.628702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:55.628702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:55.628702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:55.628702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:11:55.628702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:11:55.628702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:11:55.628702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:11:55.628702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:55.628702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:55.628702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:55.628702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:55.628702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:55.628702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:55.629652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:55.629652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:55.629652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:55.629652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:55.629652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:55.629652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:55.629652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:55.629652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:55.629652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:55.629652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:55.629652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:11:55.629652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:55.629652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:11:55.629652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:55.631866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 456/915] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jul 20 19:11:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:55.639002 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5194b8-eaf1-4e26-9631-f02e8b5fbe3a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:55.660267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f96a1-ff23-47f4-8961-2e706805af7f None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:55.661079 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f96a1-ff23-47f4-8961-2e706805af7f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:55.661308 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f96a1-ff23-47f4-8961-2e706805af7f None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:55.663751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 457/916] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:55.669843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a246686-bd5b-4c59-bdd3-a244409dd85d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:55.670144 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a246686-bd5b-4c59-bdd3-a244409dd85d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:55.670440 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a246686-bd5b-4c59-bdd3-a244409dd85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:55.690812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7a246686-bd5b-4c59-bdd3-a244409dd85d None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:55.692844 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7a246686-bd5b-4c59-bdd3-a244409dd85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:55.747540 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:55.755808 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5194b8-eaf1-4e26-9631-f02e8b5fbe3a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:55.795655 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975b3e5-fafb-45d2-8d7e-838596e9f44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:55.796335 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975b3e5-fafb-45d2-8d7e-838596e9f44a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:55.796614 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975b3e5-fafb-45d2-8d7e-838596e9f44a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:55.796892 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975b3e5-fafb-45d2-8d7e-838596e9f44a None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:55.797632 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975b3e5-fafb-45d2-8d7e-838596e9f44a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:55.797952 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975b3e5-fafb-45d2-8d7e-838596e9f44a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:55.798865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 458/917] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:11:55.808788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975b3e5-fafb-45d2-8d7e-838596e9f44a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:55.819538 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 460/918] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jul 20 19:11:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:55.826362 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a246686-bd5b-4c59-bdd3-a244409dd85d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:55.827543 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975b3e5-fafb-45d2-8d7e-838596e9f44a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:55.942548 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:55.968887 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975b3e5-fafb-45d2-8d7e-838596e9f44a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:55.969893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a246686-bd5b-4c59-bdd3-a244409dd85d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:56.012791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec285c0-d4f9-4359-8628-e7efdb383b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:56.013809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec285c0-d4f9-4359-8628-e7efdb383b77 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:56.014281 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec285c0-d4f9-4359-8628-e7efdb383b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:56.014770 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec285c0-d4f9-4359-8628-e7efdb383b77 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:56.015693 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec285c0-d4f9-4359-8628-e7efdb383b77 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:56.016184 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec285c0-d4f9-4359-8628-e7efdb383b77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:56.017733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec285c0-d4f9-4359-8628-e7efdb383b77 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:56.017917 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac73e4-6797-46bf-af40-8478bda83182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:56.020484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac73e4-6797-46bf-af40-8478bda83182 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:56.021530 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac73e4-6797-46bf-af40-8478bda83182 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:56.022059 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac73e4-6797-46bf-af40-8478bda83182 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:56.023737 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac73e4-6797-46bf-af40-8478bda83182 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:56.025398 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 461/919] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jul 20 19:11:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:56.026883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac73e4-6797-46bf-af40-8478bda83182 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:56.034629 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec285c0-d4f9-4359-8628-e7efdb383b77 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:56.057828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-44ac73e4-6797-46bf-af40-8478bda83182 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:11:56.057828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:56.057828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:11:56.057828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:11:56.057828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:11:56.057828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:11:56.057828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:11:56.057828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:56.057828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:11:56.057828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:56.057828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:11:56.057828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:56.057828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:56.057828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:56.057828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:56.057828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:56.057828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:56.067893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:56.067893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:56.067893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:56.067893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:56.067893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:56.067893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:56.067893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:11:56.067893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:11:56.067893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:11:56.067893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:11:56.067893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:56.067893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:56.067893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:56.067893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:56.067893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:56.067893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:56.069531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:56.069531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:56.069531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:56.069531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:56.069531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:56.069531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:56.069531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:56.069531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:56.069531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:56.069531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:56.069531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:11:56.069531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:56.069531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 19:11:56.069531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:56.069531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 459/920] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 20 19:11:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:56.071760 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:56.074321 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac73e4-6797-46bf-af40-8478bda83182 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:56.163212 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec285c0-d4f9-4359-8628-e7efdb383b77 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:56.201311 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a11ee0-979f-40c0-98d4-0ad16b84bf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:56.202445 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a11ee0-979f-40c0-98d4-0ad16b84bf81 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:56.202959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a11ee0-979f-40c0-98d4-0ad16b84bf81 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:56.203468 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a11ee0-979f-40c0-98d4-0ad16b84bf81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:56.204472 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a11ee0-979f-40c0-98d4-0ad16b84bf81 None admin] RBAC: Adding query filter params (interface=public, service_id=f42bcaf28ffa4a4a88280fa226fc853d, region_id=RegionOne) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:56.204994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a11ee0-979f-40c0-98d4-0ad16b84bf81 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:56.206747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a11ee0-979f-40c0-98d4-0ad16b84bf81 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:56.215305 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 462/921] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jul 20 19:11:56 2022] GET /identity/v3/endpoints?service_id=f42bcaf28ffa4a4a88280fa226fc853d&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:56.216660 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac73e4-6797-46bf-af40-8478bda83182 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:56.224935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a11ee0-979f-40c0-98d4-0ad16b84bf81 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:56.271766 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cc0ae-f803-4223-a0b6-de8a80ddd9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:56.272435 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cc0ae-f803-4223-a0b6-de8a80ddd9ec None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:56.272721 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cc0ae-f803-4223-a0b6-de8a80ddd9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:56.272990 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cc0ae-f803-4223-a0b6-de8a80ddd9ec None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:56.273695 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cc0ae-f803-4223-a0b6-de8a80ddd9ec None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:56.273995 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cc0ae-f803-4223-a0b6-de8a80ddd9ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:56.275415 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cc0ae-f803-4223-a0b6-de8a80ddd9ec None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:56.286053 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 460/922] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 20 19:11:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:11:56.287796 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e0242-d41b-4def-894f-91bc4822e73b None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:56.288090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e0242-d41b-4def-894f-91bc4822e73b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:56.288372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e0242-d41b-4def-894f-91bc4822e73b None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:56.289809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 461/923] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:56.295934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e0242-d41b-4def-894f-91bc4822e73b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:56.327656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:56.373341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:56.397058 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a11ee0-979f-40c0-98d4-0ad16b84bf81 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:56.436259 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cf5ef-bec4-49e5-aed6-2a3f27cb0521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:56.436938 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cf5ef-bec4-49e5-aed6-2a3f27cb0521 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:56.437222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cf5ef-bec4-49e5-aed6-2a3f27cb0521 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:56.437504 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cf5ef-bec4-49e5-aed6-2a3f27cb0521 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:56.438205 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cf5ef-bec4-49e5-aed6-2a3f27cb0521 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:56.439616 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cf5ef-bec4-49e5-aed6-2a3f27cb0521 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:56.448403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 463/924] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jul 20 19:11:56 2022] GET /identity/v3/services => generated 1497 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:11:56.449745 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfacf2-6ffe-4741-ae62-1e20fad0e162 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:56.450039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfacf2-6ffe-4741-ae62-1e20fad0e162 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:56.450336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfacf2-6ffe-4741-ae62-1e20fad0e162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:56.467803 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e0242-d41b-4def-894f-91bc4822e73b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:56.469082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-06dfacf2-6ffe-4741-ae62-1e20fad0e162 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:56.470441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-06dfacf2-6ffe-4741-ae62-1e20fad0e162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:56.522760 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf15d3-f187-4716-85c9-eec2b7fc10a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:56.524204 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf15d3-f187-4716-85c9-eec2b7fc10a6 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:56.524204 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf15d3-f187-4716-85c9-eec2b7fc10a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:56.524438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf15d3-f187-4716-85c9-eec2b7fc10a6 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:56.525299 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf15d3-f187-4716-85c9-eec2b7fc10a6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:56.525676 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf15d3-f187-4716-85c9-eec2b7fc10a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:56.527633 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf15d3-f187-4716-85c9-eec2b7fc10a6 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:56.538339 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 462/925] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Jul 20 19:11:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:56.543050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf15d3-f187-4716-85c9-eec2b7fc10a6 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:56.573309 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 464/926] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:11:56.603719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfacf2-6ffe-4741-ae62-1e20fad0e162 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:56.645945 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:56.701606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf15d3-f187-4716-85c9-eec2b7fc10a6 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:56.730139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:56.747059 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566872a-8be5-4fe0-9658-86894b3189b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:56.748289 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566872a-8be5-4fe0-9658-86894b3189b5 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:56.748746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566872a-8be5-4fe0-9658-86894b3189b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:56.749431 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566872a-8be5-4fe0-9658-86894b3189b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:56.750839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566872a-8be5-4fe0-9658-86894b3189b5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:56.752971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566872a-8be5-4fe0-9658-86894b3189b5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:56.756606 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfacf2-6ffe-4741-ae62-1e20fad0e162 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:56.783131 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 463/927] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 20 19:11:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:11:56.784801 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c1138-0845-46de-b133-1dc1dd2e26d4 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:56.785795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c1138-0845-46de-b133-1dc1dd2e26d4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:56.786246 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c1138-0845-46de-b133-1dc1dd2e26d4 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:56.788117 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 464/928] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:56.796955 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b3152-44b6-4e4b-81dd-108737d709de None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:56.797336 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b3152-44b6-4e4b-81dd-108737d709de None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:56.797755 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b3152-44b6-4e4b-81dd-108737d709de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:56.819382 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c68b3152-44b6-4e4b-81dd-108737d709de None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:56.820698 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c68b3152-44b6-4e4b-81dd-108737d709de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:56.835566 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcf246-efd2-4d53-a64a-7e6e9315ffac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:56.836328 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcf246-efd2-4d53-a64a-7e6e9315ffac None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:56.836613 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcf246-efd2-4d53-a64a-7e6e9315ffac None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:56.836892 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fcf246-efd2-4d53-a64a-7e6e9315ffac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:56.854801 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fcf246-efd2-4d53-a64a-7e6e9315ffac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:11:56.866796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-f2fcf246-efd2-4d53-a64a-7e6e9315ffac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:11:56.866796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:56.866796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:56.866796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:56.866796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:56.866796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:56.866796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:56.866796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:56.866796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:56.866796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:56.866796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:56.866796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:56.866796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:11:56.866796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:11:56.866796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:11:56.866796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:11:56.867843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:11:56.867843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:11:56.867843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:11:56.867843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:11:56.867843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:56.867843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:56.867843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:56.867843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:56.867843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:56.867843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:56.867843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:56.867843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:56.867843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:56.867843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:56.867843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:56.867843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:56.868700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:56.868700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:56.868700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:56.868700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:56.868700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:11:56.868700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:11:56.868700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:11:56.868700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:11:56.868700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:11:56.868700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:11:56.868700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:11:56.868700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:56.871753 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 465/929] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jul 20 19:11:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:56.878713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcf246-efd2-4d53-a64a-7e6e9315ffac None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:56.932728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 465/930] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:11:56.958492 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b3152-44b6-4e4b-81dd-108737d709de None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:57.028052 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fcf246-efd2-4d53-a64a-7e6e9315ffac None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:57.042618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:57.088610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bea24b-3ef6-418d-922b-b52867b8c230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:57.089210 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bea24b-3ef6-418d-922b-b52867b8c230 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:57.089497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bea24b-3ef6-418d-922b-b52867b8c230 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:57.089773 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bea24b-3ef6-418d-922b-b52867b8c230 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:57.090827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bea24b-3ef6-418d-922b-b52867b8c230 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:57.091165 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bea24b-3ef6-418d-922b-b52867b8c230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:57.093269 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bea24b-3ef6-418d-922b-b52867b8c230 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:57.096598 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:57.103407 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b3152-44b6-4e4b-81dd-108737d709de None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:57.104834 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 466/931] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jul 20 19:11:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:57.115584 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bea24b-3ef6-418d-922b-b52867b8c230 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:57.146968 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b7d02-7486-4e45-87de-15d89b9b6e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:57.148193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b7d02-7486-4e45-87de-15d89b9b6e92 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:57.148696 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b7d02-7486-4e45-87de-15d89b9b6e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:57.149173 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b7d02-7486-4e45-87de-15d89b9b6e92 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:57.150027 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b7d02-7486-4e45-87de-15d89b9b6e92 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:57.151650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b7d02-7486-4e45-87de-15d89b9b6e92 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:57.165532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-a18b7d02-7486-4e45-87de-15d89b9b6e92 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:11:57.165532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:57.165532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:11:57.165532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:11:57.165532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:11:57.165532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:11:57.165532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:11:57.165532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:57.165532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:11:57.165532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:57.165532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:11:57.165532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:57.165532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:57.165532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:57.165532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:57.165532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:57.166592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:57.166592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:57.166592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:57.166592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:57.166592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:57.166592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:57.166592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:57.166592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:11:57.166592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:11:57.166592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:11:57.166592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:11:57.166592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:57.166592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:57.166592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:57.166592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:57.166592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:57.167450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:57.167450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:57.167450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:57.167450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:57.167450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:57.167450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:57.167450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:57.167450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:57.167450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:57.167450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:57.167450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:57.167450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:11:57.167450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:57.167450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 19:11:57.167450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:57.170575 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 466/932] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Jul 20 19:11:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:57.176425 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b7d02-7486-4e45-87de-15d89b9b6e92 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:57.256832 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bea24b-3ef6-418d-922b-b52867b8c230 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:57.292897 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b7d02-7486-4e45-87de-15d89b9b6e92 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:57.307035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22d461-6948-4503-ac63-d00247500dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:57.309115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22d461-6948-4503-ac63-d00247500dfa None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:57.309600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22d461-6948-4503-ac63-d00247500dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:57.310346 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22d461-6948-4503-ac63-d00247500dfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:57.325701 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:57.330434 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22d461-6948-4503-ac63-d00247500dfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:57.334504 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22d461-6948-4503-ac63-d00247500dfa None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:57.336142 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928cfab-2e66-4064-8925-a62aa706b6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:57.336918 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928cfab-2e66-4064-8925-a62aa706b6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:57.337296 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928cfab-2e66-4064-8925-a62aa706b6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:57.337642 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928cfab-2e66-4064-8925-a62aa706b6c7 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:57.338703 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928cfab-2e66-4064-8925-a62aa706b6c7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:57.339036 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928cfab-2e66-4064-8925-a62aa706b6c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:57.340780 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928cfab-2e66-4064-8925-a62aa706b6c7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:57.351341 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 467/933] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jul 20 19:11:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:57.352877 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928cfab-2e66-4064-8925-a62aa706b6c7 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:57.373612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-5b22d461-6948-4503-ac63-d00247500dfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:57.373612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:57.373612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:57.373612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:57.373612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:57.373612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:57.373612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:57.373612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:57.373612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:57.373612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:57.373612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:57.373612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:57.373612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:57.373612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:57.373612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:57.376409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:57.376409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:57.376409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:57.376409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:57.376409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:57.376409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:57.376409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:57.376409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:57.376409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:57.376409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:57.376409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:57.376409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:57.376409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:57.376409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:57.376409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:57.376409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:57.376409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:57.377865 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:57.377865 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:57.377865 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:57.377865 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:57.377865 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 467/934] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:57.381063 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22d461-6948-4503-ac63-d00247500dfa None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:57.455909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:57.504818 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928cfab-2e66-4064-8925-a62aa706b6c7 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:57.529340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22d461-6948-4503-ac63-d00247500dfa None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:57.568985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478065f-176a-47bd-9a59-045964254e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:57.570598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478065f-176a-47bd-9a59-045964254e1a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:57.571391 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478065f-176a-47bd-9a59-045964254e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:57.572144 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478065f-176a-47bd-9a59-045964254e1a None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:57.573606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478065f-176a-47bd-9a59-045964254e1a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:57.574279 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478065f-176a-47bd-9a59-045964254e1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:57.576596 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0478065f-176a-47bd-9a59-045964254e1a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:57.587444 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 468/935] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jul 20 19:11:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:57.594187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478065f-176a-47bd-9a59-045964254e1a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:57.594775 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c3b23-981c-431a-973c-48652ece0d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:57.595976 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c3b23-981c-431a-973c-48652ece0d3c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:57.596567 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c3b23-981c-431a-973c-48652ece0d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:57.597149 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c3b23-981c-431a-973c-48652ece0d3c None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:57.598554 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c3b23-981c-431a-973c-48652ece0d3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:57.599195 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c3b23-981c-431a-973c-48652ece0d3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:57.604984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c3b23-981c-431a-973c-48652ece0d3c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:57.626939 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 468/936] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:57.632270 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c3b23-981c-431a-973c-48652ece0d3c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:57.668398 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:57.734162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478065f-176a-47bd-9a59-045964254e1a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:57.780360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e510a7-62ab-4b72-b58a-169b9ed9e76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:57.781349 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e510a7-62ab-4b72-b58a-169b9ed9e76a None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:57.781803 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e510a7-62ab-4b72-b58a-169b9ed9e76a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:57.782238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e510a7-62ab-4b72-b58a-169b9ed9e76a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:57.783458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e510a7-62ab-4b72-b58a-169b9ed9e76a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:57.785104 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e510a7-62ab-4b72-b58a-169b9ed9e76a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:57.791073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c3b23-981c-431a-973c-48652ece0d3c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:57.806725 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:57.834407 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 469/937] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 20 19:11:57 2022] POST /identity/v3/endpoints => generated 347 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:11:57.851653 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295128d-5dfd-4fbf-ab78-293774a2118e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:57.853124 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295128d-5dfd-4fbf-ab78-293774a2118e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:57.853635 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295128d-5dfd-4fbf-ab78-293774a2118e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:57.854180 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295128d-5dfd-4fbf-ab78-293774a2118e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:57.865143 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295128d-5dfd-4fbf-ab78-293774a2118e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:57.867194 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295128d-5dfd-4fbf-ab78-293774a2118e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:57.885960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-2295128d-5dfd-4fbf-ab78-293774a2118e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:11:57.885960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:57.885960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:57.885960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:57.885960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:57.885960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:57.885960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:57.885960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:57.885960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:57.885960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:57.885960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:57.885960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:57.885960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:11:57.885960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:11:57.885960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:11:57.885960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:11:57.887090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:57.887090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:57.887090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:11:57.887090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:57.887090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:11:57.887090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:11:57.887090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:57.887090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:57.887090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:57.887090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:57.887090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:57.887090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:57.887090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:57.887090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:57.887090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:57.887090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:57.887090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:57.887090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:57.888072 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:57.888072 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:57.888072 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:11:57.888072 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:11:57.888072 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:11:57.888072 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:11:57.888072 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:11:57.888072 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:11:57.888072 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:11:57.888072 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:57.891027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 469/938] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jul 20 19:11:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:57.897441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e510a7-62ab-4b72-b58a-169b9ed9e76a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:58.048555 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e510a7-62ab-4b72-b58a-169b9ed9e76a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:58.065380 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:58.105093 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06916c-12d4-4fe3-9ea0-10c7058818f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:58.106417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06916c-12d4-4fe3-9ea0-10c7058818f5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:58.107062 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06916c-12d4-4fe3-9ea0-10c7058818f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:58.107688 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06916c-12d4-4fe3-9ea0-10c7058818f5 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:58.109118 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06916c-12d4-4fe3-9ea0-10c7058818f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:58.109987 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06916c-12d4-4fe3-9ea0-10c7058818f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:58.112154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b06916c-12d4-4fe3-9ea0-10c7058818f5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:58.141121 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 470/939] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jul 20 19:11:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:58.149674 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295128d-5dfd-4fbf-ab78-293774a2118e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:58.295326 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295128d-5dfd-4fbf-ab78-293774a2118e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:58.332195 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85e8e0-582f-4b11-997d-5e9f05b8eb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:58.333003 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85e8e0-582f-4b11-997d-5e9f05b8eb26 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:58.333286 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85e8e0-582f-4b11-997d-5e9f05b8eb26 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:58.333563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85e8e0-582f-4b11-997d-5e9f05b8eb26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:58.351051 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85e8e0-582f-4b11-997d-5e9f05b8eb26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:58.352967 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f85e8e0-582f-4b11-997d-5e9f05b8eb26 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:58.381073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-0f85e8e0-582f-4b11-997d-5e9f05b8eb26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:58.381073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:58.381073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:58.381073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:58.381073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:58.381073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:58.381073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:58.381073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:58.381073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:58.381073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:58.381073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:58.381073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:58.381073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:11:58.381073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:11:58.381073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:11:58.382484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:11:58.382484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:58.382484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:58.382484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:58.382484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:58.382484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:58.382484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:58.382484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:58.382484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:58.382484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:58.382484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:58.382484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:58.382484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:58.382484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:58.382484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:58.382484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:58.382484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:58.383408 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:11:58.383408 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:11:58.383408 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:11:58.383408 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:58.385341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 470/940] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:58.390804 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06916c-12d4-4fe3-9ea0-10c7058818f5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:58.512457 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06916c-12d4-4fe3-9ea0-10c7058818f5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:58.553510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c72b6c-0872-425e-9977-90cabc885c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:58.554189 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c72b6c-0872-425e-9977-90cabc885c7a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:58.554501 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c72b6c-0872-425e-9977-90cabc885c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:58.554784 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c72b6c-0872-425e-9977-90cabc885c7a None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:58.555515 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c72b6c-0872-425e-9977-90cabc885c7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:58.555825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c72b6c-0872-425e-9977-90cabc885c7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:58.557203 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c72b6c-0872-425e-9977-90cabc885c7a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:58.569997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 471/941] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:58.575618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85e8e0-582f-4b11-997d-5e9f05b8eb26 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:58.604865 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:58.706140 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85e8e0-582f-4b11-997d-5e9f05b8eb26 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:58.742092 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f864f8-6428-4ac1-a100-5d8fc906972d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:58.742939 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f864f8-6428-4ac1-a100-5d8fc906972d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:58.743225 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f864f8-6428-4ac1-a100-5d8fc906972d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:58.743502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f864f8-6428-4ac1-a100-5d8fc906972d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:58.750766 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f864f8-6428-4ac1-a100-5d8fc906972d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:58.752216 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f864f8-6428-4ac1-a100-5d8fc906972d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:58.766903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-00f864f8-6428-4ac1-a100-5d8fc906972d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:58.766903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:58.766903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:58.766903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:58.766903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:58.766903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:58.766903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:58.766903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:58.766903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:58.766903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:58.766903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:58.766903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:58.766903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:58.766903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:58.766903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:58.767825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:58.767825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:58.767825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:58.767825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:58.767825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:58.767825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:58.767825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:58.767825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:58.767825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:58.767825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:58.767825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:58.767825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:58.767825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:58.767825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:58.767825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:58.767825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:58.767825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:58.768752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:58.768752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:58.768752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:58.768752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:58.768752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:58.768752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:58.768752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:58.768752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:58.768752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 471/942] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:58.774770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c72b6c-0872-425e-9977-90cabc885c7a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:58.807913 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:58.810726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba1b9c-28c6-4e60-ba7b-ed16b8f7addc None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:58.811325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba1b9c-28c6-4e60-ba7b-ed16b8f7addc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:58.811934 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba1b9c-28c6-4e60-ba7b-ed16b8f7addc None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:58.814072 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 472/943] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:11:58.820106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b6108-3dbf-496a-beff-862f0989f4e0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:58.820673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b6108-3dbf-496a-beff-862f0989f4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:58.821173 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b6108-3dbf-496a-beff-862f0989f4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:58.840272 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-989b6108-3dbf-496a-beff-862f0989f4e0 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:58.841826 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-989b6108-3dbf-496a-beff-862f0989f4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:58.886198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c72b6c-0872-425e-9977-90cabc885c7a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:58.918930 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 473/944] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:11:58.922050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8271c7-f8f8-49cb-a34f-029541ae3964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:58.922744 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8271c7-f8f8-49cb-a34f-029541ae3964 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:58.923033 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8271c7-f8f8-49cb-a34f-029541ae3964 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:58.923314 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8271c7-f8f8-49cb-a34f-029541ae3964 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:58.924101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8271c7-f8f8-49cb-a34f-029541ae3964 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:58.924413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8271c7-f8f8-49cb-a34f-029541ae3964 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:58.925880 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8271c7-f8f8-49cb-a34f-029541ae3964 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:58.938629 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 472/945] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:11:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:58.939589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b6108-3dbf-496a-beff-862f0989f4e0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:58.944896 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8271c7-f8f8-49cb-a34f-029541ae3964 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:58.951112 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:59.045976 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:59.050066 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b6108-3dbf-496a-beff-862f0989f4e0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:59.057023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8271c7-f8f8-49cb-a34f-029541ae3964 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:59.089535 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88a669-bf50-490b-8527-4d342046e072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:59.090807 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88a669-bf50-490b-8527-4d342046e072 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:59.091336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88a669-bf50-490b-8527-4d342046e072 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:59.091841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88a669-bf50-490b-8527-4d342046e072 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.092761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea88a669-bf50-490b-8527-4d342046e072 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:59.094455 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea88a669-bf50-490b-8527-4d342046e072 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:59.096019 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b62fc0-d3b5-4fbd-9979-bd4aba17ce37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:59.097379 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b62fc0-d3b5-4fbd-9979-bd4aba17ce37 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:59.097721 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b62fc0-d3b5-4fbd-9979-bd4aba17ce37 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:59.098006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b62fc0-d3b5-4fbd-9979-bd4aba17ce37 None admin] PATH_INFO: `/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/e78792e617d84a7cbb384ed764c391fb/roles/2c0eba8863f74445bb0726c9dc7510fb` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.100547 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b62fc0-d3b5-4fbd-9979-bd4aba17ce37 None admin] RBAC: Authorizing `identity:create_grant(project_id=416a38494ed54934ba8ab0d8e18afb35, user_id=e78792e617d84a7cbb384ed764c391fb, role_id=2c0eba8863f74445bb0726c9dc7510fb)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:59.102068 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b62fc0-d3b5-4fbd-9979-bd4aba17ce37 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:59.110740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ea88a669-bf50-490b-8527-4d342046e072 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:11:59.110740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:59.110740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:11:59.110740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:11:59.110740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:11:59.110740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:11:59.110740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:11:59.110740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:59.110740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:11:59.110740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:59.110740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:11:59.110740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:59.110740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:59.110740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:59.110740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:59.110740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:59.110740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:59.111825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:59.111825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:59.111825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:59.111825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:59.111825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:59.111825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:59.111825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:11:59.111825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:11:59.111825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:11:59.111825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:11:59.111825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:59.111825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:59.111825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:59.111825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:59.111825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:59.111825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:59.112697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:59.112697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:59.112697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:59.112697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:59.112697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:59.112697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:59.112697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:59.112697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:59.112697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:59.112697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:59.112697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:11:59.112697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:11:59.112697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:11:59.112697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:11:59.120372 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 474/947] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jul 20 19:11:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:11:59.123398 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88a669-bf50-490b-8527-4d342046e072 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:59.124624 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 473/947] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:11:58 2022] PUT /identity/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/e78792e617d84a7cbb384ed764c391fb/roles/2c0eba8863f74445bb0726c9dc7510fb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:11:59.146991 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e55106-9b59-4329-af0b-0ab6c3d9c899 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:59.147218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e55106-9b59-4329-af0b-0ab6c3d9c899 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:59.147477 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e55106-9b59-4329-af0b-0ab6c3d9c899 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.149251 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 474/948] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:11:59.156325 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40502696-a6a1-40a7-be66-bd378556e156 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:59.156687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40502696-a6a1-40a7-be66-bd378556e156 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:59.156898 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40502696-a6a1-40a7-be66-bd378556e156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.177781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-40502696-a6a1-40a7-be66-bd378556e156 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:11:59.179143 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-40502696-a6a1-40a7-be66-bd378556e156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:11:59.218955 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:59.258068 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88a669-bf50-490b-8527-4d342046e072 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:59.270899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 475/949] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:11:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:11:59.286894 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40502696-a6a1-40a7-be66-bd378556e156 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:59.300387 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320bbc0-e70f-44a3-80f1-d5f54d70067c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:59.301509 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320bbc0-e70f-44a3-80f1-d5f54d70067c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:59.301796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320bbc0-e70f-44a3-80f1-d5f54d70067c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:59.302074 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320bbc0-e70f-44a3-80f1-d5f54d70067c None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.302841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320bbc0-e70f-44a3-80f1-d5f54d70067c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:59.303153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320bbc0-e70f-44a3-80f1-d5f54d70067c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:59.304529 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320bbc0-e70f-44a3-80f1-d5f54d70067c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:59.310447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 475/950] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jul 20 19:11:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:59.317902 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320bbc0-e70f-44a3-80f1-d5f54d70067c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:59.405548 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:59.443058 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40502696-a6a1-40a7-be66-bd378556e156 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:59.443771 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320bbc0-e70f-44a3-80f1-d5f54d70067c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:59.482381 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f52d9c-b612-4061-b15f-bd5b199a2517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:59.483267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f52d9c-b612-4061-b15f-bd5b199a2517 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:59.483555 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f52d9c-b612-4061-b15f-bd5b199a2517 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:59.483836 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f52d9c-b612-4061-b15f-bd5b199a2517 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.484664 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f52d9c-b612-4061-b15f-bd5b199a2517 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:59.486119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f52d9c-b612-4061-b15f-bd5b199a2517 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:59.487714 dv-cinder-819149-14-smb devstack@keystone.service[80233]: WARNING keystone.server.flask.common [None req-62f52d9c-b612-4061-b15f-bd5b199a2517 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 20 19:11:59.496351 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f4bcd-10b1-4d5d-b425-92b7ef52dc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:59.497563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f4bcd-10b1-4d5d-b425-92b7ef52dc1b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:59.497851 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f4bcd-10b1-4d5d-b425-92b7ef52dc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:59.498132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f4bcd-10b1-4d5d-b425-92b7ef52dc1b None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.499376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f4bcd-10b1-4d5d-b425-92b7ef52dc1b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:59.499688 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f4bcd-10b1-4d5d-b425-92b7ef52dc1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:59.501349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f4bcd-10b1-4d5d-b425-92b7ef52dc1b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:59.504937 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:59.510074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.sql.core [None req-62f52d9c-b612-4061-b15f-bd5b199a2517 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 19:11:59.510074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 19:11:59.510074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [parameters: {'id': 'f4ab42b4840e4f0f9d05f70815b04c06', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 19:11:59.510074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80233) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 19:11:59.514126 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 476/951] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jul 20 19:11:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:11:59.515001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f4bcd-10b1-4d5d-b425-92b7ef52dc1b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:59.520539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-62f52d9c-b612-4061-b15f-bd5b199a2517 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f4ab42b4840e4f0f9d05f70815b04c06.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f4ab42b4840e4f0f9d05f70815b04c06. Jul 20 19:11:59.520539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:59.520539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 19:11:59.520539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 19:11:59.520539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 19:11:59.520539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 19:11:59.520539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 19:11:59.520539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 19:11:59.520539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 19:11:59.520539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application conn.query(q) Jul 20 19:11:59.520539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 19:11:59.520539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 19:11:59.520539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 19:11:59.521556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result.read() Jul 20 19:11:59.521556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 19:11:59.521556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 19:11:59.521556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 19:11:59.521556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 19:11:59.521556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 19:11:59.521556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 19:11:59.521556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 19:11:59.521556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 19:11:59.521556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 19:11:59.521556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:59.521556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 19:11:59.521556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:59.521556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:59.521556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 19:11:59.521556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 19:11:59.521556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 20 19:11:59.521556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 20 19:11:59.522687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 19:11:59.522687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application next(self.gen) Jul 20 19:11:59.522687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 19:11:59.522687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application yield resource Jul 20 19:11:59.522687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 19:11:59.522687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application next(self.gen) Jul 20 19:11:59.522687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 19:11:59.522687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 19:11:59.522687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 19:11:59.522687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 19:11:59.522687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 19:11:59.522687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise self.value Jul 20 19:11:59.522687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 19:11:59.522687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 19:11:59.522687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 19:11:59.522687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application session.commit() Jul 20 19:11:59.522687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 19:11:59.523607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 19:11:59.523607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 19:11:59.523607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 19:11:59.523607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 19:11:59.523607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.session.flush() Jul 20 19:11:59.523607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 19:11:59.523607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 19:11:59.523607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 19:11:59.523607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 19:11:59.523607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 19:11:59.523607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application compat.raise_( Jul 20 19:11:59.523607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 19:11:59.523607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception Jul 20 19:11:59.523607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 19:11:59.523607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 19:11:59.523607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 19:11:59.523607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 19:11:59.525016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 19:11:59.525016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 19:11:59.525016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 19:11:59.525016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 19:11:59.525016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 19:11:59.525016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 19:11:59.525016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 19:11:59.525016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 19:11:59.525016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 19:11:59.525016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 19:11:59.525016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 19:11:59.525016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 19:11:59.525016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 19:11:59.525016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 19:11:59.525016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 19:11:59.525899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 19:11:59.525899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 19:11:59.525899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception Jul 20 19:11:59.525899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 19:11:59.525899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 19:11:59.525899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 19:11:59.525899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 19:11:59.525899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 19:11:59.525899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 19:11:59.525899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 19:11:59.525899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application conn.query(q) Jul 20 19:11:59.525899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 19:11:59.525899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 19:11:59.525899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 19:11:59.525899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application result.read() Jul 20 19:11:59.525899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 19:11:59.525899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 19:11:59.527317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 19:11:59.527317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 19:11:59.527317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 19:11:59.527317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 19:11:59.527317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 19:11:59.527317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 19:11:59.527317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 19:11:59.527317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 19:11:59.527317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [parameters: {'id': 'f4ab42b4840e4f0f9d05f70815b04c06', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 19:11:59.527317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 19:11:59.527317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:59.527317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:11:59.527317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:59.527317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:59.527317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 20 19:11:59.533726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 20 19:11:59.533726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 19:11:59.533726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 19:11:59.533726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 20 19:11:59.533726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:59.533726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:11:59.533726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:59.533726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:59.533726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:59.533726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:59.533726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:59.533726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:59.533726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:59.533726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:59.533726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:59.533726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:59.533726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:59.535554 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:59.535554 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 20 19:11:59.535554 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 20 19:11:59.535554 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:59.535554 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:59.535554 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 20 19:11:59.535554 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 20 19:11:59.535554 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f4ab42b4840e4f0f9d05f70815b04c06. Jul 20 19:11:59.535554 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:59.535554 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 476/952] 10.222.0.18 () {60 vars in 1140 bytes} [Wed Jul 20 19:11:59 2022] POST /identity/v3/projects => generated 262 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:59.539730 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f52d9c-b612-4061-b15f-bd5b199a2517 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:59.649146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f4bcd-10b1-4d5d-b425-92b7ef52dc1b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:59.686291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464c587-1626-4432-9d8e-9f16c60e8db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:59.687206 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464c587-1626-4432-9d8e-9f16c60e8db3 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:59.687327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464c587-1626-4432-9d8e-9f16c60e8db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:59.687552 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464c587-1626-4432-9d8e-9f16c60e8db3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.688292 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464c587-1626-4432-9d8e-9f16c60e8db3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:59.689652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464c587-1626-4432-9d8e-9f16c60e8db3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:59.690849 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f52d9c-b612-4061-b15f-bd5b199a2517 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:59.726708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 477/953] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 20 19:11:59 2022] POST /identity/v3/endpoints => generated 349 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:11:59.789856 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:59.796580 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff755b0-9a03-4b01-98e9-3ce902685cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:59.797701 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff755b0-9a03-4b01-98e9-3ce902685cce None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:59.798397 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff755b0-9a03-4b01-98e9-3ce902685cce None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:59.799056 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff755b0-9a03-4b01-98e9-3ce902685cce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.808283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff755b0-9a03-4b01-98e9-3ce902685cce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:59.810477 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff755b0-9a03-4b01-98e9-3ce902685cce None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:11:59.827275 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-7ff755b0-9a03-4b01-98e9-3ce902685cce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:59.827275 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:11:59.827275 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:11:59.827275 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:11:59.827275 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:11:59.827275 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:11:59.827275 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:11:59.827275 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:11:59.827275 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:11:59.827275 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:11:59.827275 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:11:59.827275 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:11:59.827275 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:11:59.827275 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:11:59.827275 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:11:59.828593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:11:59.828593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:11:59.828593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:11:59.828593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:11:59.828593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:11:59.828593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:11:59.828593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:11:59.828593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:11:59.828593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:11:59.828593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:11:59.828593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:11:59.828593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:11:59.828593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:11:59.828593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:11:59.828593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:11:59.828593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:11:59.828593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:11:59.829821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:11:59.829821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:11:59.829821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:11:59.829821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:11:59.829821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:11:59.829821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:11:59.829821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:11:59.829821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:11:59.836985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 477/954] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:11:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:11:59.838710 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464c587-1626-4432-9d8e-9f16c60e8db3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:11:59.904703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:11:59.953529 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464c587-1626-4432-9d8e-9f16c60e8db3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:11:59.990601 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80356e-d53c-494a-8e52-16327bd8ce59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:11:59.991518 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80356e-d53c-494a-8e52-16327bd8ce59 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:11:59.991981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80356e-d53c-494a-8e52-16327bd8ce59 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:11:59.992418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80356e-d53c-494a-8e52-16327bd8ce59 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:11:59.993327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80356e-d53c-494a-8e52-16327bd8ce59 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:11:59.993785 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80356e-d53c-494a-8e52-16327bd8ce59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:11:59.995381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a80356e-d53c-494a-8e52-16327bd8ce59 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:00.018442 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 478/955] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 20 19:11:59 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:00.041544 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dad91-2c28-4158-b416-bbaf6cf7f09e None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:00.042086 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dad91-2c28-4158-b416-bbaf6cf7f09e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:00.042568 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dad91-2c28-4158-b416-bbaf6cf7f09e None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:00.044167 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 478/956] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:00.050063 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8aba9-ae05-4892-b197-f68540b287d4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:00.050452 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8aba9-ae05-4892-b197-f68540b287d4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:00.050771 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8aba9-ae05-4892-b197-f68540b287d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:00.079139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-77c8aba9-ae05-4892-b197-f68540b287d4 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:00.080362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-77c8aba9-ae05-4892-b197-f68540b287d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:00.158540 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 479/957] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:00.177436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34dad91-2c28-4158-b416-bbaf6cf7f09e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:00.290442 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34dad91-2c28-4158-b416-bbaf6cf7f09e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:00.327143 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c0f3a-2170-476d-9dbd-f3a36be4dcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:00.327965 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c0f3a-2170-476d-9dbd-f3a36be4dcd7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:00.328253 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c0f3a-2170-476d-9dbd-f3a36be4dcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:00.328533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c0f3a-2170-476d-9dbd-f3a36be4dcd7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:00.329211 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c0f3a-2170-476d-9dbd-f3a36be4dcd7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:00.330658 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c0f3a-2170-476d-9dbd-f3a36be4dcd7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:00.344245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-191c0f3a-2170-476d-9dbd-f3a36be4dcd7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:12:00.344245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:00.344245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:00.344245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:00.344245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:00.344245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:00.344245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:00.344245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:00.344245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:12:00.344245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:00.344245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:00.344245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:00.344245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:00.344245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:00.344245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:00.344245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:00.344245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:00.345437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:00.345437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:00.345437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:00.345437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:00.345437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:00.345437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:00.345437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:00.345437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:00.345437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:00.345437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:00.345437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:00.345437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:00.345437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:00.345437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:00.345437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:00.345437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:00.346934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:00.346934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:00.346934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:00.346934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:00.346934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:00.346934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:00.346934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:00.346934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:00.346934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:00.346934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:00.346934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:00.346934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:00.346934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:12:00.346934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:00.346934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 479/958] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:12:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:00.351723 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8aba9-ae05-4892-b197-f68540b287d4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:00.432846 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:00.453771 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8aba9-ae05-4892-b197-f68540b287d4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:00.490181 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460787d-8fb6-4f36-9090-3da6439d865e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:00.490878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460787d-8fb6-4f36-9090-3da6439d865e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:00.491158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460787d-8fb6-4f36-9090-3da6439d865e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:00.491431 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460787d-8fb6-4f36-9090-3da6439d865e None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:00.492140 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460787d-8fb6-4f36-9090-3da6439d865e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:00.492445 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460787d-8fb6-4f36-9090-3da6439d865e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:00.493810 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460787d-8fb6-4f36-9090-3da6439d865e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:00.499654 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 480/959] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 20 19:12:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:00.505962 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c0f3a-2170-476d-9dbd-f3a36be4dcd7 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:00.567975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:00.612911 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c0f3a-2170-476d-9dbd-f3a36be4dcd7 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:00.650330 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8966344-6c56-4744-a0a0-bd116bbdb7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:00.651056 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8966344-6c56-4744-a0a0-bd116bbdb7fb None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:00.651346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8966344-6c56-4744-a0a0-bd116bbdb7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:00.651621 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8966344-6c56-4744-a0a0-bd116bbdb7fb None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:00.652444 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8966344-6c56-4744-a0a0-bd116bbdb7fb None admin] RBAC: Adding query filter params (type=compute) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:00.652750 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8966344-6c56-4744-a0a0-bd116bbdb7fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:00.654217 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8966344-6c56-4744-a0a0-bd116bbdb7fb None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:00.659655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 480/960] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 20 19:12:00 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:01.332285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b66b96-0325-4c73-ab39-96d4d03d3b37 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:01.332698 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b66b96-0325-4c73-ab39-96d4d03d3b37 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:01.332893 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b66b96-0325-4c73-ab39-96d4d03d3b37 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:01.334503 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 481/961] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:01.339660 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a4f37-ff57-4324-bc35-2dee48eee4cd None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:01.339949 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a4f37-ff57-4324-bc35-2dee48eee4cd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:01.340227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a4f37-ff57-4324-bc35-2dee48eee4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:01.358288 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-192a4f37-ff57-4324-bc35-2dee48eee4cd None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:01.359830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-192a4f37-ff57-4324-bc35-2dee48eee4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:01.435346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 481/962] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:01.459764 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b66b96-0325-4c73-ab39-96d4d03d3b37 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:01.586388 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b66b96-0325-4c73-ab39-96d4d03d3b37 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:01.623796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:01.635114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebf95a-b407-44ff-b22c-7bef0c98a9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:01.636234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebf95a-b407-44ff-b22c-7bef0c98a9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:01.636761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebf95a-b407-44ff-b22c-7bef0c98a9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:01.637256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebf95a-b407-44ff-b22c-7bef0c98a9c0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:01.649243 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbebf95a-b407-44ff-b22c-7bef0c98a9c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:12:01.658100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-cbebf95a-b407-44ff-b22c-7bef0c98a9c0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:12:01.658100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:01.658100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:01.658100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:01.658100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:01.658100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:01.658100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:01.658100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:01.658100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:01.658100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:01.658100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:01.658100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:01.658100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:12:01.658100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:12:01.658100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:12:01.658100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:12:01.659108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:12:01.659108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:12:01.659108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:12:01.659108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:12:01.659108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:01.659108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:01.659108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:01.659108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:01.659108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:01.659108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:01.659108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:01.659108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:01.659108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:01.659108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:01.659108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:01.659108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:01.660555 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:01.660555 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:01.660555 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:01.660555 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:01.660555 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:12:01.660555 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:12:01.660555 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:12:01.660555 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:12:01.660555 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:12:01.660555 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:12:01.660555 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:12:01.660555 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:01.664364 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 482/963] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jul 20 19:12:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:01.674330 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a4f37-ff57-4324-bc35-2dee48eee4cd None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:01.721529 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:01.777450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a4f37-ff57-4324-bc35-2dee48eee4cd None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:01.813204 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346589b-809c-4386-a180-e3b87968c168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:01.813889 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346589b-809c-4386-a180-e3b87968c168 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:01.814174 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346589b-809c-4386-a180-e3b87968c168 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:01.814489 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346589b-809c-4386-a180-e3b87968c168 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:01.815271 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346589b-809c-4386-a180-e3b87968c168 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:01.815585 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346589b-809c-4386-a180-e3b87968c168 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:01.817516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346589b-809c-4386-a180-e3b87968c168 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:01.826880 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 482/964] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jul 20 19:12:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:01.832722 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebf95a-b407-44ff-b22c-7bef0c98a9c0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:01.946582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebf95a-b407-44ff-b22c-7bef0c98a9c0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:01.983378 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e28361-2ddf-4307-bcb7-4f009cca70aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:01.984228 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e28361-2ddf-4307-bcb7-4f009cca70aa None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:01.984519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e28361-2ddf-4307-bcb7-4f009cca70aa None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:01.984800 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e28361-2ddf-4307-bcb7-4f009cca70aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:01.996523 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e28361-2ddf-4307-bcb7-4f009cca70aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:01.998079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e28361-2ddf-4307-bcb7-4f009cca70aa None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:02.001833 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e820f-c40d-4cc3-8bcd-67e4fcc0ea90 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:02.002146 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e820f-c40d-4cc3-8bcd-67e4fcc0ea90 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:02.002459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e820f-c40d-4cc3-8bcd-67e4fcc0ea90 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:02.004668 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 483/965] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:12:02.011062 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b14ce9-6d0a-4930-8d61-5dea3c1675b5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:02.011353 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b14ce9-6d0a-4930-8d61-5dea3c1675b5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:02.011637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b14ce9-6d0a-4930-8d61-5dea3c1675b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:02.018964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-16e28361-2ddf-4307-bcb7-4f009cca70aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:02.018964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:02.018964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:02.018964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:02.018964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:02.018964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:02.018964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:02.018964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:02.018964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:02.018964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:02.018964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:02.018964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:02.018964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:02.018964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:02.018964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:02.020469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:02.020469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:02.020469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:02.020469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:02.020469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:02.020469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:02.020469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:02.020469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:02.020469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:02.020469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:02.020469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:02.020469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:02.020469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:02.020469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:02.020469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:02.020469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:02.020469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:02.021404 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:02.021404 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:02.021404 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:02.021404 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:02.025346 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 483/966] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:02.026813 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e28361-2ddf-4307-bcb7-4f009cca70aa None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:02.034019 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-75b14ce9-6d0a-4930-8d61-5dea3c1675b5 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:02.035588 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-75b14ce9-6d0a-4930-8d61-5dea3c1675b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:02.061104 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:02.129880 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 484/967] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:02.148969 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e28361-2ddf-4307-bcb7-4f009cca70aa None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:02.153782 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b14ce9-6d0a-4930-8d61-5dea3c1675b5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:02.195718 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9500e8-d939-46c2-81c9-4cf792b10a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:02.196392 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9500e8-d939-46c2-81c9-4cf792b10a31 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:02.196734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9500e8-d939-46c2-81c9-4cf792b10a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:02.196952 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9500e8-d939-46c2-81c9-4cf792b10a31 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:02.197678 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9500e8-d939-46c2-81c9-4cf792b10a31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:02.197984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9500e8-d939-46c2-81c9-4cf792b10a31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:02.200218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9500e8-d939-46c2-81c9-4cf792b10a31 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:02.211219 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:02.213780 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 484/968] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:02.227340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9500e8-d939-46c2-81c9-4cf792b10a31 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:02.279988 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b14ce9-6d0a-4930-8d61-5dea3c1675b5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:02.317750 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:02.320130 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fd865-6730-483e-b945-5c3b328fd29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:02.321069 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fd865-6730-483e-b945-5c3b328fd29d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:02.321720 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fd865-6730-483e-b945-5c3b328fd29d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:02.322193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9fd865-6730-483e-b945-5c3b328fd29d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:02.323019 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fd865-6730-483e-b945-5c3b328fd29d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:02.325601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9fd865-6730-483e-b945-5c3b328fd29d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:02.339171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-af9fd865-6730-483e-b945-5c3b328fd29d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:12:02.339171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:02.339171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:02.339171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:02.339171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:02.339171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:02.339171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:02.339171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:02.339171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:12:02.339171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:02.339171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:02.339171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:02.339171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:02.339171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:02.339171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:02.339171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:02.339171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:02.340482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:02.340482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:02.340482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:02.340482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:02.340482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:02.340482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:02.340482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:02.340482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:02.340482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:02.340482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:02.340482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:02.340482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:02.340482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:02.340482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:02.340482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:02.340482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:02.341571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:02.341571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:02.341571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:02.341571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:02.341571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:02.341571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:02.341571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:02.341571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:02.341571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:02.341571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:02.341571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:02.341571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:02.341571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:12:02.341571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:02.342967 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 485/969] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jul 20 19:12:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:02.347644 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9500e8-d939-46c2-81c9-4cf792b10a31 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:02.349753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fd865-6730-483e-b945-5c3b328fd29d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:02.398533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9cd84-5bf2-4c1b-acf5-5295f1e16129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:02.399378 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9cd84-5bf2-4c1b-acf5-5295f1e16129 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:02.399668 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9cd84-5bf2-4c1b-acf5-5295f1e16129 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:02.399986 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9cd84-5bf2-4c1b-acf5-5295f1e16129 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:02.408779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f9cd84-5bf2-4c1b-acf5-5295f1e16129 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:02.410328 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f9cd84-5bf2-4c1b-acf5-5295f1e16129 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:02.426988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-81f9cd84-5bf2-4c1b-acf5-5295f1e16129 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:12:02.426988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:02.426988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:02.426988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:02.426988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:02.426988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:02.426988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:02.426988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:02.426988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:02.426988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:02.426988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:02.426988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:02.426988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:12:02.426988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:12:02.426988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:12:02.426988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:12:02.428030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:02.428030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:02.428030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:12:02.428030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:02.428030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:12:02.428030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:02.428030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:02.428030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:02.428030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:02.428030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:02.428030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:02.428030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:02.428030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:02.428030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:02.428030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:02.428030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:02.428030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:02.428030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:02.429039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:02.429039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:02.429039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:12:02.429039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:12:02.429039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:12:02.429039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:12:02.429039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:12:02.429039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:12:02.429039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 19:12:02.429039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:02.429039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 485/970] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jul 20 19:12:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:02.429673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b26e5-098f-4693-a154-da8e74a28ca9 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:02.430345 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b26e5-098f-4693-a154-da8e74a28ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:02.430345 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b26e5-098f-4693-a154-da8e74a28ca9 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:02.435779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 486/971] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:02.435779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b26e5-098f-4693-a154-da8e74a28ca9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:02.486381 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9fd865-6730-483e-b945-5c3b328fd29d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:02.495239 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:02.528733 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbcd4c-156f-496b-904b-64bcc85480cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:02.529412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbcd4c-156f-496b-904b-64bcc85480cf None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:02.529708 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbcd4c-156f-496b-904b-64bcc85480cf None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:02.529985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbcd4c-156f-496b-904b-64bcc85480cf None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:02.530731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbcd4c-156f-496b-904b-64bcc85480cf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:02.531041 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbcd4c-156f-496b-904b-64bcc85480cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:02.532680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbcd4c-156f-496b-904b-64bcc85480cf None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:02.538244 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 486/972] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jul 20 19:12:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:02.539487 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b9b7b-2222-42f8-a949-c050d6080af5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:02.539773 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b9b7b-2222-42f8-a949-c050d6080af5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:02.540053 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0b9b7b-2222-42f8-a949-c050d6080af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:02.557438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4e0b9b7b-2222-42f8-a949-c050d6080af5 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:02.557785 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b26e5-098f-4693-a154-da8e74a28ca9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:02.558710 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4e0b9b7b-2222-42f8-a949-c050d6080af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:02.597825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fdb84-6cec-4075-87d4-8d60e9c38e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:02.598531 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fdb84-6cec-4075-87d4-8d60e9c38e14 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:02.598811 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fdb84-6cec-4075-87d4-8d60e9c38e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:02.599080 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fdb84-6cec-4075-87d4-8d60e9c38e14 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:02.599921 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fdb84-6cec-4075-87d4-8d60e9c38e14 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:02.600224 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fdb84-6cec-4075-87d4-8d60e9c38e14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:02.601647 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fdb84-6cec-4075-87d4-8d60e9c38e14 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:02.617982 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:02.622060 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 487/973] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Jul 20 19:12:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:02.622547 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fdb84-6cec-4075-87d4-8d60e9c38e14 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:02.644801 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 487/974] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:02.645658 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b9b7b-2222-42f8-a949-c050d6080af5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:02.753044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fdb84-6cec-4075-87d4-8d60e9c38e14 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:02.780329 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:02.783538 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0b9b7b-2222-42f8-a949-c050d6080af5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:02.799323 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ff060-e6e5-412d-a494-5c2da6a59c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:02.801092 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ff060-e6e5-412d-a494-5c2da6a59c7a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:02.801641 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ff060-e6e5-412d-a494-5c2da6a59c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:02.801929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ff060-e6e5-412d-a494-5c2da6a59c7a None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:02.802933 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ff060-e6e5-412d-a494-5c2da6a59c7a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:02.803250 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ff060-e6e5-412d-a494-5c2da6a59c7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:02.805025 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ff060-e6e5-412d-a494-5c2da6a59c7a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:02.816605 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 488/975] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jul 20 19:12:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:02.816605 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ff060-e6e5-412d-a494-5c2da6a59c7a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:02.823063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67c562-d0f0-4b98-a392-28a2528c24e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:02.823918 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67c562-d0f0-4b98-a392-28a2528c24e5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:02.824434 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67c562-d0f0-4b98-a392-28a2528c24e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:02.824434 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67c562-d0f0-4b98-a392-28a2528c24e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:02.881696 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:02.898813 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67c562-d0f0-4b98-a392-28a2528c24e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:02.900274 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67c562-d0f0-4b98-a392-28a2528c24e5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:02.923088 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ff060-e6e5-412d-a494-5c2da6a59c7a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:02.959997 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad728e4-6666-4469-a166-9515ac4dcfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:02.960659 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad728e4-6666-4469-a166-9515ac4dcfc4 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:02.960943 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad728e4-6666-4469-a166-9515ac4dcfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:02.961222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad728e4-6666-4469-a166-9515ac4dcfc4 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:02.961921 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad728e4-6666-4469-a166-9515ac4dcfc4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:02.963522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad728e4-6666-4469-a166-9515ac4dcfc4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:02.965025 dv-cinder-819149-14-smb devstack@keystone.service[80234]: WARNING keystone.server.flask.common [None req-3ad728e4-6666-4469-a166-9515ac4dcfc4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 20 19:12:02.977502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.sql.core [None req-3ad728e4-6666-4469-a166-9515ac4dcfc4 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 19:12:02.977502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 19:12:02.977502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [parameters: {'user_id': 'ec79e221864f4f59bb155bf52fbfa061', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 19:12:02.977502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80234) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 19:12:02.998724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-3ad728e4-6666-4469-a166-9515ac4dcfc4 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 19:12:02.998724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:02.998724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 19:12:02.998724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 19:12:02.998724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 19:12:02.998724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 19:12:02.998724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 19:12:02.998724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 19:12:02.998724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 19:12:02.998724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application conn.query(q) Jul 20 19:12:02.998724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 19:12:02.998724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 19:12:02.998724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 19:12:02.998724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application result.read() Jul 20 19:12:02.998724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 19:12:02.999994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 19:12:02.999994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 19:12:02.999994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 19:12:02.999994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 19:12:02.999994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 19:12:02.999994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 19:12:02.999994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 19:12:02.999994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 19:12:02.999994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:02.999994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 19:12:02.999994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:02.999994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:02.999994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 19:12:02.999994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 19:12:02.999994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 20 19:12:02.999994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 20 19:12:02.999994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 19:12:02.999994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application next(self.gen) Jul 20 19:12:03.001146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 19:12:03.001146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application yield resource Jul 20 19:12:03.001146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 19:12:03.001146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application next(self.gen) Jul 20 19:12:03.001146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 19:12:03.001146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 19:12:03.001146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 19:12:03.001146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 19:12:03.001146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 19:12:03.001146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise self.value Jul 20 19:12:03.001146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 19:12:03.001146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 19:12:03.001146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 19:12:03.001146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application session.commit() Jul 20 19:12:03.001146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 19:12:03.001146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 19:12:03.001146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 19:12:03.002964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 19:12:03.002964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 19:12:03.002964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.session.flush() Jul 20 19:12:03.002964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 19:12:03.002964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 19:12:03.002964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 19:12:03.002964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 19:12:03.002964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 19:12:03.002964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application compat.raise_( Jul 20 19:12:03.002964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 19:12:03.002964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception Jul 20 19:12:03.002964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 19:12:03.002964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 19:12:03.002964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 19:12:03.002964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 19:12:03.002964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 19:12:03.002964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 19:12:03.004290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 19:12:03.004290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 19:12:03.004290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 19:12:03.004290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 20 19:12:03.004290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 19:12:03.004290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 19:12:03.004290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 19:12:03.004290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 19:12:03.004290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 19:12:03.004290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 19:12:03.004290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 19:12:03.004290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 19:12:03.004290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 19:12:03.004290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 19:12:03.004290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 19:12:03.004290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception Jul 20 19:12:03.005796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 19:12:03.005796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 19:12:03.005796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 19:12:03.005796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 19:12:03.005796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 19:12:03.005796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 19:12:03.005796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 19:12:03.005796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application conn.query(q) Jul 20 19:12:03.005796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 19:12:03.005796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 19:12:03.005796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 19:12:03.005796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application result.read() Jul 20 19:12:03.005796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 19:12:03.005796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 19:12:03.005796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 19:12:03.005796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 19:12:03.007136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 19:12:03.007136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 19:12:03.007136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 19:12:03.007136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 19:12:03.007136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 19:12:03.007136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 19:12:03.007136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ec79e221864f4f59bb155bf52fbfa061', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 19:12:03.007136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 19:12:03.007136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:03.007136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:03.007136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:03.007136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:03.007136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:03.007136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:03.007136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:03.008519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:03.008519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:03.008519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:03.008519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:03.008519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:03.008519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:03.008519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:03.008519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 20 19:12:03.008519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 20 19:12:03.008519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:03.008519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:03.008519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:12:03.008519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:03.008519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:12:03.008519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:03.008519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 20 19:12:03.008519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 20 19:12:03.009751 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 20 19:12:03.009751 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 20 19:12:03.009751 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 19:12:03.009751 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 19:12:03.009751 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 19:12:03.009751 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:03.009751 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 489/976] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Jul 20 19:12:02 2022] POST /identity/v3/users => generated 160 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:03.009751 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad728e4-6666-4469-a166-9515ac4dcfc4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:03.028037 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:03.032864 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 488/977] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:12:02 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:12:03.035503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f8b94-d8b7-4965-a65d-dbfdbd4781ed None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:03.035788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f8b94-d8b7-4965-a65d-dbfdbd4781ed None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:03.036110 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9f8b94-d8b7-4965-a65d-dbfdbd4781ed None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:03.037790 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 489/978] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:03.040030 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f8b94-d8b7-4965-a65d-dbfdbd4781ed None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:03.135675 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad728e4-6666-4469-a166-9515ac4dcfc4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:03.165250 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:03.167084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9f8b94-d8b7-4965-a65d-dbfdbd4781ed None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:03.176486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bc59f-699f-4e45-b561-21ee8c2faac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:03.177270 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bc59f-699f-4e45-b561-21ee8c2faac4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:03.177554 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bc59f-699f-4e45-b561-21ee8c2faac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:03.177832 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bc59f-699f-4e45-b561-21ee8c2faac4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:03.178771 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1bc59f-699f-4e45-b561-21ee8c2faac4 None admin] RBAC: Adding query filter params (interface=admin, service_id=f42bcaf28ffa4a4a88280fa226fc853d, region_id=RegionOne) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:03.179092 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1bc59f-699f-4e45-b561-21ee8c2faac4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:03.180734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1bc59f-699f-4e45-b561-21ee8c2faac4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:03.190389 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 490/979] 10.222.0.18 () {56 vars in 1249 bytes} [Wed Jul 20 19:12:03 2022] GET /identity/v3/endpoints?service_id=f42bcaf28ffa4a4a88280fa226fc853d&interface=admin®ion_id=RegionOne => generated 193 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:03.192061 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028e236-f7b0-459e-867a-13a2ebb6d05e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:03.192453 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028e236-f7b0-459e-867a-13a2ebb6d05e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:03.192872 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028e236-f7b0-459e-867a-13a2ebb6d05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:03.208193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff33d9c-540b-44b3-873c-4dc0d85f82f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:03.209007 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff33d9c-540b-44b3-873c-4dc0d85f82f8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:03.209281 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff33d9c-540b-44b3-873c-4dc0d85f82f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:03.209552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff33d9c-540b-44b3-873c-4dc0d85f82f8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:03.211066 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c028e236-f7b0-459e-867a-13a2ebb6d05e None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:03.212661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c028e236-f7b0-459e-867a-13a2ebb6d05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:03.217569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff33d9c-540b-44b3-873c-4dc0d85f82f8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:03.219050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff33d9c-540b-44b3-873c-4dc0d85f82f8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:03.234827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-fff33d9c-540b-44b3-873c-4dc0d85f82f8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:12:03.234827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:03.234827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:03.234827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:03.234827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:03.234827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:03.234827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:03.234827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:03.234827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:03.234827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:03.234827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:03.234827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:03.234827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:12:03.234827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:12:03.234827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:12:03.234827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:12:03.235947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:03.235947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:03.235947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:12:03.235947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:03.235947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:12:03.235947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:03.235947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:03.235947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:03.235947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:03.235947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:03.235947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:03.235947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:03.235947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:03.235947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:03.235947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:03.235947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:03.235947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:03.235947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:03.237039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:03.237039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:03.237039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:12:03.237039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:12:03.237039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:12:03.237039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:12:03.237039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:12:03.237039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:12:03.237039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 19:12:03.237039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:03.237039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 490/980] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:12:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:03.237766 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff33d9c-540b-44b3-873c-4dc0d85f82f8 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:03.300907 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 491/981] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:03.302338 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028e236-f7b0-459e-867a-13a2ebb6d05e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:03.317910 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:03.373395 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff33d9c-540b-44b3-873c-4dc0d85f82f8 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:03.412488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475e2f8-a227-4f6c-b644-9b4879f7788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:03.413279 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475e2f8-a227-4f6c-b644-9b4879f7788a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:03.413586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475e2f8-a227-4f6c-b644-9b4879f7788a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:03.413836 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475e2f8-a227-4f6c-b644-9b4879f7788a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:03.425626 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475e2f8-a227-4f6c-b644-9b4879f7788a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:03.427195 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475e2f8-a227-4f6c-b644-9b4879f7788a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:03.444244 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028e236-f7b0-459e-867a-13a2ebb6d05e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:03.445667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-3475e2f8-a227-4f6c-b644-9b4879f7788a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:03.445667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:03.445667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:03.445667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:03.445667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:03.445667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:03.445667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:03.445667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:03.445667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:03.445667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:03.445667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:03.445667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:03.445667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:03.445667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:03.445667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:03.446605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:03.446605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:03.446605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:03.446605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:03.446605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:03.446605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:03.446605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:03.446605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:03.446605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:03.446605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:03.446605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:03.446605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:03.446605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:03.446605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:03.446605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:03.446605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:03.446605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:03.447539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:03.447539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:03.447539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:03.447539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:03.447539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 491/982] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:03.448321 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475e2f8-a227-4f6c-b644-9b4879f7788a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:03.468202 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:03.488973 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37de82-8da9-41f7-a71e-9d490f6038f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:03.489810 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37de82-8da9-41f7-a71e-9d490f6038f5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:03.490205 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37de82-8da9-41f7-a71e-9d490f6038f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:03.490628 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37de82-8da9-41f7-a71e-9d490f6038f5 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:03.491468 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37de82-8da9-41f7-a71e-9d490f6038f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:03.492836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37de82-8da9-41f7-a71e-9d490f6038f5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:03.499335 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 492/983] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jul 20 19:12:03 2022] GET /identity/v3/services => generated 1497 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:12:03.506020 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37de82-8da9-41f7-a71e-9d490f6038f5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:03.586564 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475e2f8-a227-4f6c-b644-9b4879f7788a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:03.601541 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:03.627723 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37de82-8da9-41f7-a71e-9d490f6038f5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:03.630844 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c65736-3ff3-4252-aa0d-f580dc792e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:03.631539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c65736-3ff3-4252-aa0d-f580dc792e88 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:03.631826 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c65736-3ff3-4252-aa0d-f580dc792e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:03.632233 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c65736-3ff3-4252-aa0d-f580dc792e88 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:03.633061 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c65736-3ff3-4252-aa0d-f580dc792e88 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:03.633372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c65736-3ff3-4252-aa0d-f580dc792e88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:03.634892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c65736-3ff3-4252-aa0d-f580dc792e88 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:03.674541 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 492/984] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Jul 20 19:12:03 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:03.674964 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c65736-3ff3-4252-aa0d-f580dc792e88 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:03.693259 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db60cc8-509e-4442-8e89-1a02b6cfb759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:03.694698 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db60cc8-509e-4442-8e89-1a02b6cfb759 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:03.695124 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db60cc8-509e-4442-8e89-1a02b6cfb759 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:03.695267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db60cc8-509e-4442-8e89-1a02b6cfb759 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:03.695988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db60cc8-509e-4442-8e89-1a02b6cfb759 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:03.697380 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db60cc8-509e-4442-8e89-1a02b6cfb759 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:03.722053 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 493/985] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 20 19:12:03 2022] POST /identity/v3/services => generated 242 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:12:03.831520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c65736-3ff3-4252-aa0d-f580dc792e88 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:03.886058 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931dfeb-b88f-411f-a92b-85d66b85e97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:03.887176 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931dfeb-b88f-411f-a92b-85d66b85e97a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:03.887692 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931dfeb-b88f-411f-a92b-85d66b85e97a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:03.888177 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931dfeb-b88f-411f-a92b-85d66b85e97a None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:03.889139 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931dfeb-b88f-411f-a92b-85d66b85e97a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:03.889646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931dfeb-b88f-411f-a92b-85d66b85e97a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:03.891414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931dfeb-b88f-411f-a92b-85d66b85e97a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:03.905919 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 493/986] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:03.914343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db60cc8-509e-4442-8e89-1a02b6cfb759 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:03.979036 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:04.053652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db60cc8-509e-4442-8e89-1a02b6cfb759 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:04.101823 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dedf94-2aed-457b-96c6-d0045cbfde11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:04.102642 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dedf94-2aed-457b-96c6-d0045cbfde11 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:04.102926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dedf94-2aed-457b-96c6-d0045cbfde11 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:04.103203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dedf94-2aed-457b-96c6-d0045cbfde11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:04.110279 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dedf94-2aed-457b-96c6-d0045cbfde11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:04.111750 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dedf94-2aed-457b-96c6-d0045cbfde11 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:04.127820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-13dedf94-2aed-457b-96c6-d0045cbfde11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:04.127820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:04.127820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:04.127820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:04.127820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:04.127820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:04.127820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:04.127820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:04.127820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:04.127820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:04.127820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:04.127820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:04.127820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:12:04.127820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:12:04.127820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:12:04.129905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:12:04.129905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:04.129905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:04.129905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:04.129905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:04.129905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:04.129905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:04.129905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:04.129905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:04.129905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:04.129905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:04.129905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:04.129905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:04.129905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:04.129905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:04.129905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:04.129905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:04.131857 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:12:04.131857 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:12:04.131857 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:12:04.131857 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:12:04.131857 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:12:04.131857 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:12:04.131857 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:04.131857 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:04.131857 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 494/987] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:12:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:04.136501 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931dfeb-b88f-411f-a92b-85d66b85e97a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:04.173590 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:04.262206 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931dfeb-b88f-411f-a92b-85d66b85e97a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:04.308725 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c4f20-d03e-485f-9b35-d5cc9d96a1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:04.309553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c4f20-d03e-485f-9b35-d5cc9d96a1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:04.309936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c4f20-d03e-485f-9b35-d5cc9d96a1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:04.310336 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c4f20-d03e-485f-9b35-d5cc9d96a1a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:04.311473 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c4f20-d03e-485f-9b35-d5cc9d96a1a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:04.311879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c4f20-d03e-485f-9b35-d5cc9d96a1a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:04.313411 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c4f20-d03e-485f-9b35-d5cc9d96a1a4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:04.326691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 494/988] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:12:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:04.332768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dedf94-2aed-457b-96c6-d0045cbfde11 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:04.480570 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dedf94-2aed-457b-96c6-d0045cbfde11 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:04.483198 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:04.527474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef25d2-0830-4052-a5fd-f4bc4c845bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:04.528148 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef25d2-0830-4052-a5fd-f4bc4c845bec None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:04.528430 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef25d2-0830-4052-a5fd-f4bc4c845bec None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:04.528708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef25d2-0830-4052-a5fd-f4bc4c845bec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:04.529539 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef25d2-0830-4052-a5fd-f4bc4c845bec None admin] RBAC: Adding query filter params (role.id=2c0eba8863f74445bb0726c9dc7510fb, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=e78792e617d84a7cbb384ed764c391fb) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:04.529858 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef25d2-0830-4052-a5fd-f4bc4c845bec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:04.531315 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef25d2-0830-4052-a5fd-f4bc4c845bec None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:04.548488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 495/989] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:12:04 2022] GET /identity/v3/role_assignments?user.id=e78792e617d84a7cbb384ed764c391fb&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=2c0eba8863f74445bb0726c9dc7510fb => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:05.681609 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09334d-ecff-4240-bf0f-8de980068160 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:05.682135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09334d-ecff-4240-bf0f-8de980068160 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:05.682135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09334d-ecff-4240-bf0f-8de980068160 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:05.683575 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 495/990] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:05.689417 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7bc07-5b2b-4294-9b50-3dd17f91817e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:05.689883 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7bc07-5b2b-4294-9b50-3dd17f91817e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:05.689998 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7bc07-5b2b-4294-9b50-3dd17f91817e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:05.715911 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-59c7bc07-5b2b-4294-9b50-3dd17f91817e None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:05.717505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-59c7bc07-5b2b-4294-9b50-3dd17f91817e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:05.818532 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 496/991] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:05.841634 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09334d-ecff-4240-bf0f-8de980068160 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:05.915416 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3296a-7a93-42e8-ace2-3272fb4e9c80 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:05.915825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3296a-7a93-42e8-ace2-3272fb4e9c80 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:05.916003 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3296a-7a93-42e8-ace2-3272fb4e9c80 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:05.917371 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 497/992] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:12:05.922988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1030dcb-10ec-48bd-9503-e6a6af335ae9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:05.923478 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1030dcb-10ec-48bd-9503-e6a6af335ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:05.923805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1030dcb-10ec-48bd-9503-e6a6af335ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:05.948835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d1030dcb-10ec-48bd-9503-e6a6af335ae9 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:05.949934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:05.950076 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d1030dcb-10ec-48bd-9503-e6a6af335ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:05.975023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09334d-ecff-4240-bf0f-8de980068160 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:06.019466 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad285d8-47b4-4864-aea8-ea09db392825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:06.020276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad285d8-47b4-4864-aea8-ea09db392825 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:06.020564 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad285d8-47b4-4864-aea8-ea09db392825 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:06.020819 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad285d8-47b4-4864-aea8-ea09db392825 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:06.021522 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad285d8-47b4-4864-aea8-ea09db392825 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:06.022911 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad285d8-47b4-4864-aea8-ea09db392825 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:06.037245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-2ad285d8-47b4-4864-aea8-ea09db392825 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:12:06.037245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:06.037245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:06.037245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:06.037245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:06.037245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:06.037245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:06.037245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:06.037245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:12:06.037245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:06.037245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:06.037245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:06.037245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:06.037245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:06.037245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:06.037245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:06.037245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:06.044153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:06.044153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:06.044153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:06.044153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:06.044153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:06.044153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:06.044153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:06.044153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:06.044153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:06.044153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:06.044153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:06.044153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:06.044153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:06.044153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:06.044153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:06.044153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:06.045072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:06.045072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:06.045072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:06.045072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:06.045072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:06.045072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:06.045072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:06.045072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:06.045072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:06.045072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:06.045072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:06.045072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:06.045072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 19:12:06.045072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:06.045072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 496/993] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Jul 20 19:12:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:06.045918 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad285d8-47b4-4864-aea8-ea09db392825 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:06.046527 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 498/994] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:06.061099 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1030dcb-10ec-48bd-9503-e6a6af335ae9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:06.097901 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:06.187359 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1030dcb-10ec-48bd-9503-e6a6af335ae9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:06.201192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad285d8-47b4-4864-aea8-ea09db392825 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:06.244651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20a7f6-cdec-431d-9fcd-d653104ee735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:06.245960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20a7f6-cdec-431d-9fcd-d653104ee735 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:06.246469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20a7f6-cdec-431d-9fcd-d653104ee735 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:06.246954 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20a7f6-cdec-431d-9fcd-d653104ee735 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:06.248138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20a7f6-cdec-431d-9fcd-d653104ee735 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:06.250595 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20a7f6-cdec-431d-9fcd-d653104ee735 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:06.253973 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bbdef-e560-43ad-a1c1-5b4ca0980cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:06.255016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bbdef-e560-43ad-a1c1-5b4ca0980cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:06.255474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bbdef-e560-43ad-a1c1-5b4ca0980cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:06.255974 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bbdef-e560-43ad-a1c1-5b4ca0980cf5 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:06.256994 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bbdef-e560-43ad-a1c1-5b4ca0980cf5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:06.257432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bbdef-e560-43ad-a1c1-5b4ca0980cf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:06.259864 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bbdef-e560-43ad-a1c1-5b4ca0980cf5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:06.269596 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 497/995] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jul 20 19:12:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:06.273415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1d20a7f6-cdec-431d-9fcd-d653104ee735 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:12:06.273415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:06.273415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:06.273415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:06.273415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:06.273415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:06.273415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:06.273415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:06.273415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:12:06.273415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:06.273415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:06.273415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:06.273415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:06.273415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:06.273415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:06.273415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:06.273415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:06.274854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:06.274854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:06.274854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:06.274854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:06.274854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:06.274854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:06.274854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:06.274854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:06.274854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:06.274854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:06.274854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:06.274854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:06.274854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:06.274854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:06.274854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:06.274854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:06.275713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:06.275713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:06.275713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:06.275713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:06.275713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:06.275713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:06.275713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:06.275713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:06.275713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:06.275713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:06.275713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:06.275713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:06.275713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:12:06.275713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:06.276760 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 499/996] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:12:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:06.280346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bbdef-e560-43ad-a1c1-5b4ca0980cf5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:06.283434 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20a7f6-cdec-431d-9fcd-d653104ee735 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:06.300269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:06.408519 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bbdef-e560-43ad-a1c1-5b4ca0980cf5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:06.433564 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:06.450239 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20a7f6-cdec-431d-9fcd-d653104ee735 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:06.454870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9b141-eecd-453e-93f8-38c49bfe7b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:06.455510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9b141-eecd-453e-93f8-38c49bfe7b52 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:06.455794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9b141-eecd-453e-93f8-38c49bfe7b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:06.456101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9b141-eecd-453e-93f8-38c49bfe7b52 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:06.457355 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9b141-eecd-453e-93f8-38c49bfe7b52 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:06.457654 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9b141-eecd-453e-93f8-38c49bfe7b52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:06.459275 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9b141-eecd-453e-93f8-38c49bfe7b52 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:06.482753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 498/997] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Jul 20 19:12:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:06.483998 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9b141-eecd-453e-93f8-38c49bfe7b52 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:06.495593 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c448a-b321-4b87-af24-9ae6c7a24ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:06.497156 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c448a-b321-4b87-af24-9ae6c7a24ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:06.497156 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c448a-b321-4b87-af24-9ae6c7a24ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:06.497464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c448a-b321-4b87-af24-9ae6c7a24ec3 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:06.498662 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c448a-b321-4b87-af24-9ae6c7a24ec3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:06.498978 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c448a-b321-4b87-af24-9ae6c7a24ec3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:06.500781 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c448a-b321-4b87-af24-9ae6c7a24ec3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:06.512544 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 500/998] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 20 19:12:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:06.513800 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c448a-b321-4b87-af24-9ae6c7a24ec3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:06.585632 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:06.615950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9b141-eecd-453e-93f8-38c49bfe7b52 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:06.646124 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c448a-b321-4b87-af24-9ae6c7a24ec3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:06.663874 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac5f10-ed5a-40a5-9dff-1aebc3b0b035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:06.664553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac5f10-ed5a-40a5-9dff-1aebc3b0b035 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:06.664867 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac5f10-ed5a-40a5-9dff-1aebc3b0b035 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:06.665123 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac5f10-ed5a-40a5-9dff-1aebc3b0b035 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:06.665860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac5f10-ed5a-40a5-9dff-1aebc3b0b035 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:06.667281 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac5f10-ed5a-40a5-9dff-1aebc3b0b035 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:06.683846 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 499/999] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 20 19:12:06 2022] POST /identity/v3/endpoints => generated 325 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:12:06.695053 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8806e1c-26d9-40be-9ce1-506d2301cff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:06.695854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8806e1c-26d9-40be-9ce1-506d2301cff4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:06.696076 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8806e1c-26d9-40be-9ce1-506d2301cff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:06.696456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8806e1c-26d9-40be-9ce1-506d2301cff4 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:06.697311 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8806e1c-26d9-40be-9ce1-506d2301cff4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:06.697676 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8806e1c-26d9-40be-9ce1-506d2301cff4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:06.699338 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8806e1c-26d9-40be-9ce1-506d2301cff4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:06.705706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 501/1000] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 20 19:12:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:06.712472 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac5f10-ed5a-40a5-9dff-1aebc3b0b035 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:06.720507 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77824f-c45e-468d-a566-d2fbc77628db None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:06.720972 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77824f-c45e-468d-a566-d2fbc77628db None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:06.721394 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77824f-c45e-468d-a566-d2fbc77628db None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:06.724761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 502/1001] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:06.729791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8e76c-8592-49c0-afdb-1320b4883ef5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:06.730075 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8e76c-8592-49c0-afdb-1320b4883ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:06.730387 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8e76c-8592-49c0-afdb-1320b4883ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:06.752519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-adc8e76c-8592-49c0-afdb-1320b4883ef5 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:06.754428 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-adc8e76c-8592-49c0-afdb-1320b4883ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:06.767149 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:06.842367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac5f10-ed5a-40a5-9dff-1aebc3b0b035 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:06.846680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 503/1002] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:06 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:06.865371 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8e76c-8592-49c0-afdb-1320b4883ef5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:06.881309 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9365de4-6645-42dc-ac19-71f33a6852dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:06.882432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9365de4-6645-42dc-ac19-71f33a6852dd None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:06.882922 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9365de4-6645-42dc-ac19-71f33a6852dd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:06.883383 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9365de4-6645-42dc-ac19-71f33a6852dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:06.884376 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9365de4-6645-42dc-ac19-71f33a6852dd None admin] RBAC: Adding query filter params (interface=public, service_id=f77c64a299f24c79b0963dd641ef4f1f, region_id=RegionOne) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:06.884980 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9365de4-6645-42dc-ac19-71f33a6852dd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:06.886464 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9365de4-6645-42dc-ac19-71f33a6852dd None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:06.893704 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 500/1003] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jul 20 19:12:06 2022] GET /identity/v3/endpoints?service_id=f77c64a299f24c79b0963dd641ef4f1f&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:06.899483 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9365de4-6645-42dc-ac19-71f33a6852dd None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:06.902552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:06.985308 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8e76c-8592-49c0-afdb-1320b4883ef5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:07.024289 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9365de4-6645-42dc-ac19-71f33a6852dd None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:07.026920 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5fb18-0c35-4ebd-b840-ef1d75f95302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:07.027702 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5fb18-0c35-4ebd-b840-ef1d75f95302 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:07.027985 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5fb18-0c35-4ebd-b840-ef1d75f95302 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:07.028260 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5fb18-0c35-4ebd-b840-ef1d75f95302 None admin] PATH_INFO: `/v3/services/image` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:07.028915 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5fb18-0c35-4ebd-b840-ef1d75f95302 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:07.030276 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5fb18-0c35-4ebd-b840-ef1d75f95302 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:07.043048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-14b5fb18-0c35-4ebd-b840-ef1d75f95302 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:12:07.043048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:07.043048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:07.043048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:07.043048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:07.043048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:07.043048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:07.043048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:07.043048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:12:07.043048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:07.043048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:07.043048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:07.043048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:07.043048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:07.043048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:07.043048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:07.043048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:07.044196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:07.044196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:07.044196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:07.044196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:07.044196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:07.044196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:07.044196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:07.044196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:07.044196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:07.044196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:07.044196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:07.044196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:07.044196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:07.044196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:07.044196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:07.044196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:07.045706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:07.045706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:07.045706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:07.045706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:07.045706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:07.045706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:07.045706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:07.045706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:07.045706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:07.045706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:07.045706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:07.045706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:07.045706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:12:07.045706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:07.045706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 504/1004] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Jul 20 19:12:06 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:07.051004 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5fb18-0c35-4ebd-b840-ef1d75f95302 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:07.064175 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:07.073727 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67094543-769f-4051-b886-1058c7d8a05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:07.074870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67094543-769f-4051-b886-1058c7d8a05a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:07.075343 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67094543-769f-4051-b886-1058c7d8a05a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:07.075774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67094543-769f-4051-b886-1058c7d8a05a None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:07.076779 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67094543-769f-4051-b886-1058c7d8a05a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:07.079090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67094543-769f-4051-b886-1058c7d8a05a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:07.094522 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 501/1005] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jul 20 19:12:06 2022] GET /identity/v3/services => generated 1727 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:12:07.172174 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5fb18-0c35-4ebd-b840-ef1d75f95302 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:07.217020 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c28ca2-c87e-4d94-a601-de0eaf08681f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:07.218117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c28ca2-c87e-4d94-a601-de0eaf08681f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:07.218607 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c28ca2-c87e-4d94-a601-de0eaf08681f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:07.219087 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c28ca2-c87e-4d94-a601-de0eaf08681f None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:07.220418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c28ca2-c87e-4d94-a601-de0eaf08681f None admin] RBAC: Adding query filter params (name=image) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:07.220916 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c28ca2-c87e-4d94-a601-de0eaf08681f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:07.224041 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c28ca2-c87e-4d94-a601-de0eaf08681f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:07.238908 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 505/1006] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:07.240730 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67094543-769f-4051-b886-1058c7d8a05a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:07.314518 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:07.351665 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67094543-769f-4051-b886-1058c7d8a05a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:07.387136 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6405691-1f2e-4189-882f-103fe6a12f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:07.387809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6405691-1f2e-4189-882f-103fe6a12f89 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:07.388088 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6405691-1f2e-4189-882f-103fe6a12f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:07.388364 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6405691-1f2e-4189-882f-103fe6a12f89 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:07.389065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6405691-1f2e-4189-882f-103fe6a12f89 None admin] RBAC: Adding query filter params (type=image) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:07.389368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6405691-1f2e-4189-882f-103fe6a12f89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:07.390753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6405691-1f2e-4189-882f-103fe6a12f89 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:07.396168 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 502/1007] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:07 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:08.868966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d55bcd-0d7f-4ea7-b9ad-b869c15e0523 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:08.869935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d55bcd-0d7f-4ea7-b9ad-b869c15e0523 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:08.870466 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d55bcd-0d7f-4ea7-b9ad-b869c15e0523 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:08.872357 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 506/1008] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:08.881357 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc1f59-4dbc-44cf-b96c-a9292337f1e6 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:08.882424 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc1f59-4dbc-44cf-b96c-a9292337f1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:08.882932 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc1f59-4dbc-44cf-b96c-a9292337f1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:08.906386 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9fbc1f59-4dbc-44cf-b96c-a9292337f1e6 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:08.907897 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9fbc1f59-4dbc-44cf-b96c-a9292337f1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:08.990424 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 503/1009] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:08 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:09.015519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d55bcd-0d7f-4ea7-b9ad-b869c15e0523 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:09.102631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:09.135116 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d55bcd-0d7f-4ea7-b9ad-b869c15e0523 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:09.177790 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89236ebd-a9c7-41a8-92cc-c004eb8805dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:09.179147 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89236ebd-a9c7-41a8-92cc-c004eb8805dc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:09.180219 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89236ebd-a9c7-41a8-92cc-c004eb8805dc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:09.180782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89236ebd-a9c7-41a8-92cc-c004eb8805dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:09.182469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89236ebd-a9c7-41a8-92cc-c004eb8805dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:09.184498 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89236ebd-a9c7-41a8-92cc-c004eb8805dc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:09.186888 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 507/1010] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:09.197285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc1f59-4dbc-44cf-b96c-a9292337f1e6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:09.245960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a55b2-64d9-44cf-b44d-f47e4c9b3e0f None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:09.246339 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a55b2-64d9-44cf-b44d-f47e4c9b3e0f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:09.246641 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a55b2-64d9-44cf-b44d-f47e4c9b3e0f None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:09.248239 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 508/1011] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:09.254043 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676813b-e650-43c6-accd-aee2d668509e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:09.254377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676813b-e650-43c6-accd-aee2d668509e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:09.254689 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676813b-e650-43c6-accd-aee2d668509e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:09.271586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:09.272450 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2676813b-e650-43c6-accd-aee2d668509e None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:09.274205 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2676813b-e650-43c6-accd-aee2d668509e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:09.330379 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc1f59-4dbc-44cf-b96c-a9292337f1e6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:09.364042 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 509/1012] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:09 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:09.367711 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd321b-d975-41e8-a1dc-5d04590f3978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:09.368623 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd321b-d975-41e8-a1dc-5d04590f3978 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:09.369088 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd321b-d975-41e8-a1dc-5d04590f3978 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:09.369552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd321b-d975-41e8-a1dc-5d04590f3978 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:09.370582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd321b-d975-41e8-a1dc-5d04590f3978 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:09.373041 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd321b-d975-41e8-a1dc-5d04590f3978 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:09.387645 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676813b-e650-43c6-accd-aee2d668509e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:09.403419 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 504/1013] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 20 19:12:09 2022] POST /identity/v3/projects => generated 311 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:12:09.480241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:09.517263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676813b-e650-43c6-accd-aee2d668509e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:09.563335 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91519a5a-e96c-4377-acfb-c607865e47f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:09.564164 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91519a5a-e96c-4377-acfb-c607865e47f3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:09.564445 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91519a5a-e96c-4377-acfb-c607865e47f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:09.564718 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91519a5a-e96c-4377-acfb-c607865e47f3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:09.565386 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91519a5a-e96c-4377-acfb-c607865e47f3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:09.567337 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91519a5a-e96c-4377-acfb-c607865e47f3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:09.570074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fda8a-3df6-4a42-a8f5-a6bc610a6e78 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:09.570403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fda8a-3df6-4a42-a8f5-a6bc610a6e78 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:09.570685 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fda8a-3df6-4a42-a8f5-a6bc610a6e78 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:09.572076 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 505/1014] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:12:09.577695 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d216d2-71aa-4ef4-b7ee-cc64028ab307 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:09.577987 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d216d2-71aa-4ef4-b7ee-cc64028ab307 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:09.579125 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d216d2-71aa-4ef4-b7ee-cc64028ab307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:09.585153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-91519a5a-e96c-4377-acfb-c607865e47f3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:12:09.585153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:09.585153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:09.585153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:09.585153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:09.585153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:09.585153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:09.585153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:09.585153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:12:09.585153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:09.585153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:09.585153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:09.585153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:09.585153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:09.585153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:09.585153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:09.585153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:09.586720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:09.586720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:09.586720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:09.586720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:09.586720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:09.586720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:09.586720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:09.586720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:09.586720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:09.586720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:09.586720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:09.586720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:09.586720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:09.586720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:09.586720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:09.586720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:09.587891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:09.587891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:09.587891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:09.587891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:09.587891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:09.587891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:09.587891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:09.587891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:09.587891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:09.587891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:09.587891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:09.587891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:09.587891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 19:12:09.587891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:09.587891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 510/1015] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:12:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:09.592636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91519a5a-e96c-4377-acfb-c607865e47f3 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:09.602480 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-94d216d2-71aa-4ef4-b7ee-cc64028ab307 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:09.604330 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-94d216d2-71aa-4ef4-b7ee-cc64028ab307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:09.695311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 506/1016] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:09 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:09.719154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d216d2-71aa-4ef4-b7ee-cc64028ab307 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:09.734563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91519a5a-e96c-4377-acfb-c607865e47f3 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:09.782836 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:09.788102 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f33218-78d5-4a08-9b6a-e7c02be456f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:09.789212 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f33218-78d5-4a08-9b6a-e7c02be456f1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:09.789582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f33218-78d5-4a08-9b6a-e7c02be456f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:09.790063 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f33218-78d5-4a08-9b6a-e7c02be456f1 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:09.791270 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f33218-78d5-4a08-9b6a-e7c02be456f1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:09.791709 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f33218-78d5-4a08-9b6a-e7c02be456f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:09.793990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f33218-78d5-4a08-9b6a-e7c02be456f1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:09.797221 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:09.810612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 511/1017] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 20 19:12:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:09.812162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f33218-78d5-4a08-9b6a-e7c02be456f1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:09.872961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d216d2-71aa-4ef4-b7ee-cc64028ab307 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:09.923448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be237421-d371-40f4-b2cb-bac4bfce50f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:09.924125 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be237421-d371-40f4-b2cb-bac4bfce50f2 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:09.924450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be237421-d371-40f4-b2cb-bac4bfce50f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:09.924683 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be237421-d371-40f4-b2cb-bac4bfce50f2 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:09.925413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be237421-d371-40f4-b2cb-bac4bfce50f2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:09.927469 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be237421-d371-40f4-b2cb-bac4bfce50f2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:09.946501 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 507/1018] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 20 19:12:09 2022] POST /identity/v3/services => generated 242 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:12:09.968330 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f33218-78d5-4a08-9b6a-e7c02be456f1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:10.024083 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb6c81-9d07-429f-ba62-6205fffdf2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:10.024771 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb6c81-9d07-429f-ba62-6205fffdf2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:10.025052 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb6c81-9d07-429f-ba62-6205fffdf2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:10.025327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb6c81-9d07-429f-ba62-6205fffdf2e4 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:10.026054 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb6c81-9d07-429f-ba62-6205fffdf2e4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:10.026397 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb6c81-9d07-429f-ba62-6205fffdf2e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:10.027833 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb6c81-9d07-429f-ba62-6205fffdf2e4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:10.034242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 512/1019] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Jul 20 19:12:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:10.040374 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be237421-d371-40f4-b2cb-bac4bfce50f2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:10.187681 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be237421-d371-40f4-b2cb-bac4bfce50f2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:10.189789 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:10.226352 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971afdb3-1b04-4083-b8e5-3a7bb3a98322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:10.227096 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971afdb3-1b04-4083-b8e5-3a7bb3a98322 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:10.227391 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971afdb3-1b04-4083-b8e5-3a7bb3a98322 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:10.227669 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971afdb3-1b04-4083-b8e5-3a7bb3a98322 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:10.228435 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971afdb3-1b04-4083-b8e5-3a7bb3a98322 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:10.229832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971afdb3-1b04-4083-b8e5-3a7bb3a98322 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:10.251076 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 508/1020] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 20 19:12:10 2022] POST /identity/v3/endpoints => generated 334 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:12:11.680327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a2f43-ee16-4ab6-960f-1bdf4e456271 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:11.680879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a2f43-ee16-4ab6-960f-1bdf4e456271 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:11.681178 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a2f43-ee16-4ab6-960f-1bdf4e456271 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:11.683214 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 513/1021] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:11.689298 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ded1cb-9dcc-4df1-a9d0-f023e45557df None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:11.689851 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ded1cb-9dcc-4df1-a9d0-f023e45557df None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:11.689851 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ded1cb-9dcc-4df1-a9d0-f023e45557df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:11.709576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-96ded1cb-9dcc-4df1-a9d0-f023e45557df None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:11.711242 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-96ded1cb-9dcc-4df1-a9d0-f023e45557df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:11.807560 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 509/1022] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:11.837300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a2f43-ee16-4ab6-960f-1bdf4e456271 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:11.918344 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:11.993639 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a2f43-ee16-4ab6-960f-1bdf4e456271 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:12.038832 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca917c6-0c75-4cbc-8f09-aa37d73cb4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:12.039798 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca917c6-0c75-4cbc-8f09-aa37d73cb4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:12.040081 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca917c6-0c75-4cbc-8f09-aa37d73cb4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:12.040365 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca917c6-0c75-4cbc-8f09-aa37d73cb4a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:12.041863 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca917c6-0c75-4cbc-8f09-aa37d73cb4a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:12.043856 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca917c6-0c75-4cbc-8f09-aa37d73cb4a0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:12.046053 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 514/1023] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:12.052705 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ded1cb-9dcc-4df1-a9d0-f023e45557df None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:12.140047 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435fa0d-af79-4997-81a8-54741f61606e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:12.140228 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435fa0d-af79-4997-81a8-54741f61606e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:12.140505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435fa0d-af79-4997-81a8-54741f61606e None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:12.141964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 515/1024] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:12:12.147819 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2440c4-56b0-485f-9e3c-a7de53cba2dd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:12.148160 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2440c4-56b0-485f-9e3c-a7de53cba2dd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:12.148386 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2440c4-56b0-485f-9e3c-a7de53cba2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:12.170683 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ae2440c4-56b0-485f-9e3c-a7de53cba2dd None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:12.172573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ae2440c4-56b0-485f-9e3c-a7de53cba2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:12.185323 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:12.212307 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ded1cb-9dcc-4df1-a9d0-f023e45557df None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:12.263602 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47177f6b-b5ee-4601-821b-791918f63afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:12.264589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47177f6b-b5ee-4601-821b-791918f63afa None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:12.265010 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47177f6b-b5ee-4601-821b-791918f63afa None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:12.265485 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47177f6b-b5ee-4601-821b-791918f63afa None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:12.266733 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47177f6b-b5ee-4601-821b-791918f63afa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:12.271247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47177f6b-b5ee-4601-821b-791918f63afa None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:12.281056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 516/1025] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:12.305274 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2440c4-56b0-485f-9e3c-a7de53cba2dd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:12.305763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 510/1026] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 20 19:12:12 2022] POST /identity/v3/users => generated 285 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:12:12.411787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:12.481395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2440c4-56b0-485f-9e3c-a7de53cba2dd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:12.533857 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb234c7-50a4-49f9-a91d-6fe5698b0813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:12.535519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb234c7-50a4-49f9-a91d-6fe5698b0813 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:12.535744 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb234c7-50a4-49f9-a91d-6fe5698b0813 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:12.536028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb234c7-50a4-49f9-a91d-6fe5698b0813 None admin] PATH_INFO: `/v3/services/image` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:12.537076 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb234c7-50a4-49f9-a91d-6fe5698b0813 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:12.538494 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb234c7-50a4-49f9-a91d-6fe5698b0813 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:12.541127 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06503be-08d3-4563-b593-2bc41db390af None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:12.541550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06503be-08d3-4563-b593-2bc41db390af None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:12.541845 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06503be-08d3-4563-b593-2bc41db390af None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:12.543430 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 511/1027] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:12:12.552496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ccb234c7-50a4-49f9-a91d-6fe5698b0813 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:12:12.552496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:12.552496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:12.552496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:12.552496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:12.552496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:12.552496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:12.552496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:12.552496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:12:12.552496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:12.552496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:12.552496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:12.552496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:12.552496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:12.552496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:12.552496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:12.552496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:12.554740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:12.554740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:12.554740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:12.554740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:12.554740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:12.554740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:12.554740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:12.554740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:12.554740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:12.554740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:12.554740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:12.554740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:12.554740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:12.554740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:12.554740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:12.554740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:12.555682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:12.555682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:12.555682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:12.555682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:12.555682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:12.555682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:12.555682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:12.555682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:12.555682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:12.555682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:12.555682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:12.555682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:12.555682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:12:12.555682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:12.556782 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae500f0-6ea4-4d68-a07e-722f0212117e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:12.556782 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae500f0-6ea4-4d68-a07e-722f0212117e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:12.556782 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae500f0-6ea4-4d68-a07e-722f0212117e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:12.557013 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 517/1028] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Jul 20 19:12:12 2022] GET /identity/v3/services/image => generated 86 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:12.562894 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb234c7-50a4-49f9-a91d-6fe5698b0813 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:12.580549 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3ae500f0-6ea4-4d68-a07e-722f0212117e None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:12.580549 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3ae500f0-6ea4-4d68-a07e-722f0212117e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:12.698271 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 512/1029] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:12.712820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb234c7-50a4-49f9-a91d-6fe5698b0813 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:12.728074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae500f0-6ea4-4d68-a07e-722f0212117e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:12.743968 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:12.763589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e29cbc-6db3-4e98-bedf-4fa27ae2d7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:12.764620 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e29cbc-6db3-4e98-bedf-4fa27ae2d7dc None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:12.765300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e29cbc-6db3-4e98-bedf-4fa27ae2d7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:12.765910 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e29cbc-6db3-4e98-bedf-4fa27ae2d7dc None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:12.767318 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e29cbc-6db3-4e98-bedf-4fa27ae2d7dc None admin] RBAC: Adding query filter params (name=image) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:12.767830 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e29cbc-6db3-4e98-bedf-4fa27ae2d7dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:12.770688 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e29cbc-6db3-4e98-bedf-4fa27ae2d7dc None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:12.787454 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 518/1030] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:12.789131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e29cbc-6db3-4e98-bedf-4fa27ae2d7dc None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:12.845898 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:12.894211 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae500f0-6ea4-4d68-a07e-722f0212117e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:12.936585 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e29cbc-6db3-4e98-bedf-4fa27ae2d7dc None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:12.942806 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e078a2b-0b69-425d-9361-39e141d8687d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:12.943866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e078a2b-0b69-425d-9361-39e141d8687d None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:12.944367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e078a2b-0b69-425d-9361-39e141d8687d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:12.945267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e078a2b-0b69-425d-9361-39e141d8687d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:12.960201 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e078a2b-0b69-425d-9361-39e141d8687d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:12:12.971295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-2e078a2b-0b69-425d-9361-39e141d8687d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:12:12.971295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:12.971295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:12.971295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:12.971295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:12.971295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:12.971295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:12.971295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:12.971295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:12.971295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:12.971295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:12.971295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:12.971295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:12:12.971295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:12:12.971295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:12:12.971295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:12:12.972563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:12:12.972563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:12:12.972563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:12:12.972563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:12:12.972563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:12.972563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:12.972563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:12.972563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:12.972563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:12.972563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:12.972563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:12.972563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:12.972563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:12.972563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:12.972563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:12.972563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:12.973542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:12.973542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:12.973542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:12.973542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:12.973542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:12:12.973542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:12:12.973542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:12:12.973542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:12:12.973542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:12:12.973542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:12:12.973542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:12:12.973542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:12.975866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 513/1031] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jul 20 19:12:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:12.981769 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e078a2b-0b69-425d-9361-39e141d8687d None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:12.983420 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98d171-bcc1-403c-bf6a-927aee9647de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:12.984125 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98d171-bcc1-403c-bf6a-927aee9647de None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:12.984531 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98d171-bcc1-403c-bf6a-927aee9647de None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:12.984816 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98d171-bcc1-403c-bf6a-927aee9647de None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:12.985762 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98d171-bcc1-403c-bf6a-927aee9647de None admin] RBAC: Adding query filter params (type=image) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:12.986217 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98d171-bcc1-403c-bf6a-927aee9647de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:12.988407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98d171-bcc1-403c-bf6a-927aee9647de None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:12.994212 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 519/1032] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:13.002241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98d171-bcc1-403c-bf6a-927aee9647de None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:13.064205 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:13.124925 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e078a2b-0b69-425d-9361-39e141d8687d None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:13.139844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98d171-bcc1-403c-bf6a-927aee9647de None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:13.158204 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:13.167907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5227a-4f22-40f8-a513-56095f753ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:13.168634 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5227a-4f22-40f8-a513-56095f753ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:13.168873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5227a-4f22-40f8-a513-56095f753ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:13.169193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5227a-4f22-40f8-a513-56095f753ac3 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:13.170034 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5227a-4f22-40f8-a513-56095f753ac3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:13.170551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5227a-4f22-40f8-a513-56095f753ac3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:13.171990 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5227a-4f22-40f8-a513-56095f753ac3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:13.180075 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ae8a2-d666-47f9-84f2-a11a1f191cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:13.180749 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ae8a2-d666-47f9-84f2-a11a1f191cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:13.181034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ae8a2-d666-47f9-84f2-a11a1f191cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:13.181312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ae8a2-d666-47f9-84f2-a11a1f191cf9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:13.182168 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ae8a2-d666-47f9-84f2-a11a1f191cf9 None admin] RBAC: Adding query filter params (interface=public, service_id=c0925795c90a4d6db06cf8f8b7dd1389, region_id=RegionOne) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:13.182494 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ae8a2-d666-47f9-84f2-a11a1f191cf9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:13.183577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 514/1033] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jul 20 19:12:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:13.184317 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ae8a2-d666-47f9-84f2-a11a1f191cf9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:13.189309 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5227a-4f22-40f8-a513-56095f753ac3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:13.190880 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 520/1034] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jul 20 19:12:13 2022] GET /identity/v3/endpoints?service_id=c0925795c90a4d6db06cf8f8b7dd1389&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:13.197882 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ae8a2-d666-47f9-84f2-a11a1f191cf9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:13.318200 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5227a-4f22-40f8-a513-56095f753ac3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:13.331352 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ae8a2-d666-47f9-84f2-a11a1f191cf9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:13.350124 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:13.360023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5360e83-151b-4a31-8035-262554d1a6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:13.360880 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5360e83-151b-4a31-8035-262554d1a6ca None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:13.361199 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5360e83-151b-4a31-8035-262554d1a6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:13.361506 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5360e83-151b-4a31-8035-262554d1a6ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:13.373467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5360e83-151b-4a31-8035-262554d1a6ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:13.374980 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5360e83-151b-4a31-8035-262554d1a6ca None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:13.379419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e27365-cd17-402f-a002-1e0b63af1f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:13.380098 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e27365-cd17-402f-a002-1e0b63af1f54 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:13.380385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e27365-cd17-402f-a002-1e0b63af1f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:13.380661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e27365-cd17-402f-a002-1e0b63af1f54 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:13.381348 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e27365-cd17-402f-a002-1e0b63af1f54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:13.383536 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e27365-cd17-402f-a002-1e0b63af1f54 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:13.391010 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 521/1035] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jul 20 19:12:13 2022] GET /identity/v3/services => generated 1957 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:12:13.393929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-f5360e83-151b-4a31-8035-262554d1a6ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:13.393929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:13.393929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:13.393929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:13.393929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:13.393929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:13.393929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:13.393929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:13.393929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:13.393929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:13.393929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:13.393929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:13.393929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:13.393929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:13.393929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:13.395106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:13.395106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:13.395106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:13.395106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:13.395106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:13.395106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:13.395106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:13.395106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:13.395106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:13.395106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:13.395106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:13.395106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:13.395106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:13.395106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:13.395106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:13.395106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:13.395106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:13.401319 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:13.401319 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:13.401319 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:13.401319 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:13.401319 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 515/1036] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:13.403545 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e27365-cd17-402f-a002-1e0b63af1f54 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:13.547849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e27365-cd17-402f-a002-1e0b63af1f54 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:13.607151 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdcf39-65a7-44c4-b85c-e73105ae421e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:13.608234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdcf39-65a7-44c4-b85c-e73105ae421e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:13.608728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdcf39-65a7-44c4-b85c-e73105ae421e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:13.609236 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdcf39-65a7-44c4-b85c-e73105ae421e None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:13.610975 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cdcf39-65a7-44c4-b85c-e73105ae421e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:13.611782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cdcf39-65a7-44c4-b85c-e73105ae421e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:13.614586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cdcf39-65a7-44c4-b85c-e73105ae421e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:13.634384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 522/1037] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:13.641025 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5360e83-151b-4a31-8035-262554d1a6ca None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:13.696453 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:13.762954 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5360e83-151b-4a31-8035-262554d1a6ca None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:13.804349 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b99d4f-7a0e-4bf6-8f66-68f19dc43c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:13.805519 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b99d4f-7a0e-4bf6-8f66-68f19dc43c9f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:13.805946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b99d4f-7a0e-4bf6-8f66-68f19dc43c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:13.807320 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b99d4f-7a0e-4bf6-8f66-68f19dc43c9f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:13.815954 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b99d4f-7a0e-4bf6-8f66-68f19dc43c9f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:13.817425 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b99d4f-7a0e-4bf6-8f66-68f19dc43c9f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:13.834282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-23b99d4f-7a0e-4bf6-8f66-68f19dc43c9f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:12:13.834282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:13.834282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:13.834282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:13.834282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:13.834282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:13.834282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:13.834282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:13.834282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:13.834282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:13.834282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:13.834282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:13.834282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:12:13.834282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:12:13.834282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:12:13.834282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:12:13.835433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:13.835433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:13.835433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:12:13.835433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:13.835433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:12:13.835433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:13.835433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:13.835433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:13.835433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:13.835433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:13.835433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:13.835433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:13.835433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:13.835433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:13.835433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:13.835433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:13.835433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:13.835433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:13.842175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:13.842175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:13.842175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:12:13.842175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:12:13.842175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:12:13.842175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:12:13.842175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:12:13.842175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:12:13.842175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:12:13.842175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:13.842175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 516/1038] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jul 20 19:12:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:13.842878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdcf39-65a7-44c4-b85c-e73105ae421e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:13.898030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:13.985077 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdcf39-65a7-44c4-b85c-e73105ae421e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:14.025493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9302ce-df33-47fb-ab2b-7a89b168613d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:14.026154 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9302ce-df33-47fb-ab2b-7a89b168613d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:14.026468 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9302ce-df33-47fb-ab2b-7a89b168613d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:14.026807 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9302ce-df33-47fb-ab2b-7a89b168613d None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:14.027699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9302ce-df33-47fb-ab2b-7a89b168613d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:14.028008 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9302ce-df33-47fb-ab2b-7a89b168613d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:14.029433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9302ce-df33-47fb-ab2b-7a89b168613d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:14.050149 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 523/1039] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jul 20 19:12:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:14.055885 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b99d4f-7a0e-4bf6-8f66-68f19dc43c9f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:14.176321 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b99d4f-7a0e-4bf6-8f66-68f19dc43c9f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:14.179195 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:14.235813 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dea746-87ec-4e1f-a89e-5182fcf17386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:14.236657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dea746-87ec-4e1f-a89e-5182fcf17386 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:14.236862 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dea746-87ec-4e1f-a89e-5182fcf17386 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:14.237673 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dea746-87ec-4e1f-a89e-5182fcf17386 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:14.327202 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dea746-87ec-4e1f-a89e-5182fcf17386 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:14.328911 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dea746-87ec-4e1f-a89e-5182fcf17386 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:14.441959 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 517/1040] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:12:14 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:12:14.447549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9302ce-df33-47fb-ab2b-7a89b168613d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:14.563933 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:14.569778 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b5e6f-aff9-406f-acc2-d998b6842232 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:14.570054 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b5e6f-aff9-406f-acc2-d998b6842232 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:14.570346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b5e6f-aff9-406f-acc2-d998b6842232 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:14.571974 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 518/1041] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:12:14.576377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9302ce-df33-47fb-ab2b-7a89b168613d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:14.579818 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddb047-a2f4-42be-902a-167a49684502 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:14.581461 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddb047-a2f4-42be-902a-167a49684502 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:14.582024 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddb047-a2f4-42be-902a-167a49684502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:14.593891 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:14.607303 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3fddb047-a2f4-42be-902a-167a49684502 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:14.608690 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3fddb047-a2f4-42be-902a-167a49684502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:14.633641 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f79a7d-0e85-4ae1-9909-277f80475db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:14.634832 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f79a7d-0e85-4ae1-9909-277f80475db4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:14.635203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f79a7d-0e85-4ae1-9909-277f80475db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:14.635574 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f79a7d-0e85-4ae1-9909-277f80475db4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:14.648745 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f79a7d-0e85-4ae1-9909-277f80475db4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:14.650213 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f79a7d-0e85-4ae1-9909-277f80475db4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:14.673726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-d6f79a7d-0e85-4ae1-9909-277f80475db4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:14.673726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:14.673726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:14.673726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:14.673726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:14.673726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:14.673726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:14.673726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:14.673726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:14.673726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:14.673726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:14.673726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:14.673726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:14.673726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:14.673726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:14.675678 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:14.675678 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:14.675678 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:14.675678 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:14.675678 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:14.675678 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:14.675678 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:14.675678 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:14.675678 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:14.675678 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:14.675678 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:14.675678 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:14.675678 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:14.675678 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:14.675678 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:14.675678 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:14.675678 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:14.677370 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:14.677370 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:14.677370 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:14.677370 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:14.678760 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 524/1042] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:14.681312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f79a7d-0e85-4ae1-9909-277f80475db4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:14.707162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 519/1043] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:14.732163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddb047-a2f4-42be-902a-167a49684502 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:14.823306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f79a7d-0e85-4ae1-9909-277f80475db4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:14.863551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddb047-a2f4-42be-902a-167a49684502 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:14.873608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04926acb-8bd0-4e25-a37e-dff7592a6ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:14.874278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04926acb-8bd0-4e25-a37e-dff7592a6ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:14.874708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04926acb-8bd0-4e25-a37e-dff7592a6ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:14.874982 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04926acb-8bd0-4e25-a37e-dff7592a6ae0 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:14.875785 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04926acb-8bd0-4e25-a37e-dff7592a6ae0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:14.876088 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04926acb-8bd0-4e25-a37e-dff7592a6ae0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:14.877454 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04926acb-8bd0-4e25-a37e-dff7592a6ae0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:14.890774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 525/1044] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:14.896864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04926acb-8bd0-4e25-a37e-dff7592a6ae0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:14.906823 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcca9d-2f77-4eb8-b4fa-323b0c2c855c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:14.907882 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcca9d-2f77-4eb8-b4fa-323b0c2c855c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:14.908205 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcca9d-2f77-4eb8-b4fa-323b0c2c855c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:14.908479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcca9d-2f77-4eb8-b4fa-323b0c2c855c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:14.911400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:14.912910 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:14.925206 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcca9d-2f77-4eb8-b4fa-323b0c2c855c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:12:14.933583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-3ffcca9d-2f77-4eb8-b4fa-323b0c2c855c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:14.933583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:14.933583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:14.933583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:14.933583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:14.933583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:14.933583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:14.933583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:14.933583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:14.933583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:14.933583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:14.933583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:14.933583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:12:14.933583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:12:14.933583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:12:14.933583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:12:14.934855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:12:14.934855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:12:14.934855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:12:14.934855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:12:14.934855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:14.934855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:14.934855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:14.934855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:14.934855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:14.934855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:14.934855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:14.934855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:14.934855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:14.934855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:14.934855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:14.934855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:14.936890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:14.936890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:14.936890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:14.936890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:14.936890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:12:14.936890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:12:14.936890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:12:14.936890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:12:14.936890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:12:14.936890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:12:14.936890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:14.936890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:14.936890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 520/1045] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:12:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:14.941174 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcca9d-2f77-4eb8-b4fa-323b0c2c855c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:15.032779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04926acb-8bd0-4e25-a37e-dff7592a6ae0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:15.070502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcca9d-2f77-4eb8-b4fa-323b0c2c855c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:15.072196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39831b8a-0648-49cd-ab68-54a358d56312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:15.073017 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39831b8a-0648-49cd-ab68-54a358d56312 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:15.073296 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39831b8a-0648-49cd-ab68-54a358d56312 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:15.073569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39831b8a-0648-49cd-ab68-54a358d56312 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:15.081191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39831b8a-0648-49cd-ab68-54a358d56312 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:15.082656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39831b8a-0648-49cd-ab68-54a358d56312 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:15.098016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-39831b8a-0648-49cd-ab68-54a358d56312 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:15.098016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:15.098016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:15.098016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:15.098016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:15.098016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:15.098016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:15.098016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:15.098016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:15.098016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:15.098016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:15.098016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:15.098016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:12:15.098016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:12:15.098016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:12:15.099033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:12:15.099033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:15.099033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:15.099033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:15.099033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:15.099033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:15.099033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:15.099033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:15.099033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:15.099033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:15.099033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:15.099033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:15.099033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:15.099033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:15.099033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:15.099033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:15.099033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:15.099963 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:12:15.099963 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:12:15.099963 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:12:15.099963 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:12:15.099963 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:12:15.099963 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:12:15.099963 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:15.099963 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:15.099963 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 526/1046] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:12:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:15.106258 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39831b8a-0648-49cd-ab68-54a358d56312 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:15.113854 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237eba03-6910-49b0-b931-d63164571f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:15.114822 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237eba03-6910-49b0-b931-d63164571f32 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:15.115295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237eba03-6910-49b0-b931-d63164571f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:15.116241 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237eba03-6910-49b0-b931-d63164571f32 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:15.117276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237eba03-6910-49b0-b931-d63164571f32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:15.118134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237eba03-6910-49b0-b931-d63164571f32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:15.120467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237eba03-6910-49b0-b931-d63164571f32 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:15.136854 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 521/1047] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:12:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:15.138469 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237eba03-6910-49b0-b931-d63164571f32 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:15.193492 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:15.210051 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:15.238280 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39831b8a-0648-49cd-ab68-54a358d56312 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:15.271607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237eba03-6910-49b0-b931-d63164571f32 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:15.283310 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a8f81-1c4b-45da-bd98-aed9413727cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:15.283931 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a8f81-1c4b-45da-bd98-aed9413727cf None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:15.284196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a8f81-1c4b-45da-bd98-aed9413727cf None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:15.284476 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a8f81-1c4b-45da-bd98-aed9413727cf None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:15.285282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a8f81-1c4b-45da-bd98-aed9413727cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:15.285713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a8f81-1c4b-45da-bd98-aed9413727cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:15.287219 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a8f81-1c4b-45da-bd98-aed9413727cf None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:15.300978 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 527/1048] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:12:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:15.306597 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a8f81-1c4b-45da-bd98-aed9413727cf None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:15.310325 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260763e-4f6a-4f08-a161-58bef0e793ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:15.311241 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260763e-4f6a-4f08-a161-58bef0e793ba None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:15.311501 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260763e-4f6a-4f08-a161-58bef0e793ba None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:15.311773 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260763e-4f6a-4f08-a161-58bef0e793ba None admin] PATH_INFO: `/v3/users/4c476e26921843fd86ab27fc4a19e3f3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:15.327260 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260763e-4f6a-4f08-a161-58bef0e793ba None admin] RBAC: Authorizing `identity:get_user(user_id=4c476e26921843fd86ab27fc4a19e3f3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:15.328710 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260763e-4f6a-4f08-a161-58bef0e793ba None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:15.334357 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 522/1049] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:12:15 2022] GET /identity/v3/users/4c476e26921843fd86ab27fc4a19e3f3 => generated 285 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:15.337576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260763e-4f6a-4f08-a161-58bef0e793ba None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:15.430325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a8f81-1c4b-45da-bd98-aed9413727cf None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:15.461893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260763e-4f6a-4f08-a161-58bef0e793ba None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:15.467295 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:15.477172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c57697-712d-4e7e-8b1f-6e44833fd90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:15.477910 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c57697-712d-4e7e-8b1f-6e44833fd90b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:15.478156 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c57697-712d-4e7e-8b1f-6e44833fd90b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:15.478519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c57697-712d-4e7e-8b1f-6e44833fd90b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:15.479414 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c57697-712d-4e7e-8b1f-6e44833fd90b None admin] RBAC: Adding query filter params (role.id=2c0eba8863f74445bb0726c9dc7510fb, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=a1f0f6bc94de4645a8c82038ff2bd34a) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:15.479755 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c57697-712d-4e7e-8b1f-6e44833fd90b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:15.481253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c57697-712d-4e7e-8b1f-6e44833fd90b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:15.482278 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:15.488139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 528/1050] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:12:15 2022] GET /identity/v3/role_assignments?user.id=a1f0f6bc94de4645a8c82038ff2bd34a&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=2c0eba8863f74445bb0726c9dc7510fb => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:15.525964 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066a604-c24f-440d-88ad-c9a124ccf394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:15.526951 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066a604-c24f-440d-88ad-c9a124ccf394 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:15.527787 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066a604-c24f-440d-88ad-c9a124ccf394 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:15.528036 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066a604-c24f-440d-88ad-c9a124ccf394 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:15.556474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f20e6e-20ec-43ad-86fe-606a50b6ae3f None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:15.556657 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f20e6e-20ec-43ad-86fe-606a50b6ae3f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:15.557377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f20e6e-20ec-43ad-86fe-606a50b6ae3f None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:15.558528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 529/1051] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:12:15.564173 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d2b88-c970-4630-aa67-bf58b0f1ab1c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:15.564492 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d2b88-c970-4630-aa67-bf58b0f1ab1c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:15.564740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d2b88-c970-4630-aa67-bf58b0f1ab1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:15.592189 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b10d2b88-c970-4630-aa67-bf58b0f1ab1c None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:15.593497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b10d2b88-c970-4630-aa67-bf58b0f1ab1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:15.643110 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066a604-c24f-440d-88ad-c9a124ccf394 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:15.645502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066a604-c24f-440d-88ad-c9a124ccf394 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:15.688655 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 530/1052] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:15.712212 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d2b88-c970-4630-aa67-bf58b0f1ab1c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:15.770532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 523/1053] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:12:15 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:12:15.775603 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066a604-c24f-440d-88ad-c9a124ccf394 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:15.791208 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:15.827332 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d2b88-c970-4630-aa67-bf58b0f1ab1c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:15.852976 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:15.868130 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda9e87-0d4f-4aa4-a926-fe63ddef2ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:15.869038 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda9e87-0d4f-4aa4-a926-fe63ddef2ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:15.869392 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda9e87-0d4f-4aa4-a926-fe63ddef2ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:15.869731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda9e87-0d4f-4aa4-a926-fe63ddef2ad7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:15.870545 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda9e87-0d4f-4aa4-a926-fe63ddef2ad7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:15.871985 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda9e87-0d4f-4aa4-a926-fe63ddef2ad7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:15.886171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ecda9e87-0d4f-4aa4-a926-fe63ddef2ad7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:12:15.886171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:15.886171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:12:15.886171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:12:15.886171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:12:15.886171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:12:15.886171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:12:15.886171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:15.886171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:12:15.886171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:15.886171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:15.886171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:15.886171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:15.886171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:15.886171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:15.886171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:15.886171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:15.896069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:15.896069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:15.896069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:15.896069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:15.896069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:15.896069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:15.896069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:12:15.896069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:12:15.896069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:12:15.896069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:12:15.896069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:15.896069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:15.896069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:15.896069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:15.896069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:15.896069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:15.898200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:15.898200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:15.898200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:15.898200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:15.898200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:15.898200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:15.898200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:15.898200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:15.898200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:15.898200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:15.898200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:12:15.898200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:12:15.898200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 19:12:15.898200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:15.898200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 531/1054] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Jul 20 19:12:15 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:15.899698 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda9e87-0d4f-4aa4-a926-fe63ddef2ad7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:15.908682 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066a604-c24f-440d-88ad-c9a124ccf394 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:15.945381 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e083a8f-663d-4768-bf11-1a7f5a971052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:15.946619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e083a8f-663d-4768-bf11-1a7f5a971052 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:15.946947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e083a8f-663d-4768-bf11-1a7f5a971052 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:15.947234 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e083a8f-663d-4768-bf11-1a7f5a971052 None admin] PATH_INFO: `/v3/projects/f7a426a30c19481c8961005945fa5ac7` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:15.948470 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e083a8f-663d-4768-bf11-1a7f5a971052 None admin] RBAC: Authorizing `identity:get_project(project_id=f7a426a30c19481c8961005945fa5ac7)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:15.949922 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e083a8f-663d-4768-bf11-1a7f5a971052 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:15.952022 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 524/1055] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:12:15 2022] GET /identity/v3/projects/f7a426a30c19481c8961005945fa5ac7 => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:15.958442 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e083a8f-663d-4768-bf11-1a7f5a971052 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:16.018485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda9e87-0d4f-4aa4-a926-fe63ddef2ad7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:16.053082 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:16.059793 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d2f06-6a73-4a8f-b742-59da2e10529f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:16.060727 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d2f06-6a73-4a8f-b742-59da2e10529f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:16.061043 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d2f06-6a73-4a8f-b742-59da2e10529f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:16.061297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d2f06-6a73-4a8f-b742-59da2e10529f None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:16.062003 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d2f06-6a73-4a8f-b742-59da2e10529f None admin] RBAC: Adding query filter params (name=image) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:16.062340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d2f06-6a73-4a8f-b742-59da2e10529f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:16.063709 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d2f06-6a73-4a8f-b742-59da2e10529f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:16.070348 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 532/1056] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:16.075128 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d2f06-6a73-4a8f-b742-59da2e10529f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:16.082656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e083a8f-663d-4768-bf11-1a7f5a971052 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:16.127876 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052000f-9195-4f20-9a53-7f9f49274330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:16.129077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052000f-9195-4f20-9a53-7f9f49274330 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:16.129365 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052000f-9195-4f20-9a53-7f9f49274330 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:16.129643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052000f-9195-4f20-9a53-7f9f49274330 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:16.131019 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052000f-9195-4f20-9a53-7f9f49274330 None admin] RBAC: Adding query filter params (role.id=6322f657162c45ca85f019a408655ff3, scope.project.id=f7a426a30c19481c8961005945fa5ac7, user.id=4c476e26921843fd86ab27fc4a19e3f3) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:16.131338 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052000f-9195-4f20-9a53-7f9f49274330 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:16.133349 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052000f-9195-4f20-9a53-7f9f49274330 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:16.150344 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 525/1057] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:12:15 2022] GET /identity/v3/role_assignments?user.id=4c476e26921843fd86ab27fc4a19e3f3&scope.project.id=f7a426a30c19481c8961005945fa5ac7&role.id=6322f657162c45ca85f019a408655ff3 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:16.152510 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:16.229705 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d2f06-6a73-4a8f-b742-59da2e10529f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:16.281779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd7d99-2f09-4832-bbd4-29ff9d224671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:16.282748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd7d99-2f09-4832-bbd4-29ff9d224671 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:16.283026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd7d99-2f09-4832-bbd4-29ff9d224671 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:16.283294 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd7d99-2f09-4832-bbd4-29ff9d224671 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:16.284552 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd7d99-2f09-4832-bbd4-29ff9d224671 None admin] RBAC: Adding query filter params (type=image) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:16.284853 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd7d99-2f09-4832-bbd4-29ff9d224671 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:16.286277 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd7d99-2f09-4832-bbd4-29ff9d224671 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:16.296522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 533/1058] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:16.304368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052000f-9195-4f20-9a53-7f9f49274330 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:16.444093 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052000f-9195-4f20-9a53-7f9f49274330 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:16.482857 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3ee9e-e930-4783-9536-91a0b52c4651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:16.483886 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3ee9e-e930-4783-9536-91a0b52c4651 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:16.484422 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3ee9e-e930-4783-9536-91a0b52c4651 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:16.484899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3ee9e-e930-4783-9536-91a0b52c4651 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:16.485877 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3ee9e-e930-4783-9536-91a0b52c4651 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:16.487586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3ee9e-e930-4783-9536-91a0b52c4651 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:16.519827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 526/1059] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 20 19:12:16 2022] POST /identity/v3/endpoints => generated 327 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:12:17.624293 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950ac74-011c-46f5-9532-a2ea974d89ec None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:17.625065 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950ac74-011c-46f5-9532-a2ea974d89ec None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:17.625065 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950ac74-011c-46f5-9532-a2ea974d89ec None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:17.626553 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 534/1060] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:12:17.631747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916429f-0388-4ef9-9347-abf1c5adb2ed None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:17.632477 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916429f-0388-4ef9-9347-abf1c5adb2ed None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:17.632477 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916429f-0388-4ef9-9347-abf1c5adb2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:17.637482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:17.651596 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8916429f-0388-4ef9-9347-abf1c5adb2ed None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:17.652895 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8916429f-0388-4ef9-9347-abf1c5adb2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:17.753553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 527/1061] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:17.776461 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950ac74-011c-46f5-9532-a2ea974d89ec None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:17.921625 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950ac74-011c-46f5-9532-a2ea974d89ec None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:17.944923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:17.977343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec170f6-fe18-4846-922b-9dad461d7787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:17.978784 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec170f6-fe18-4846-922b-9dad461d7787 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:17.979317 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec170f6-fe18-4846-922b-9dad461d7787 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:17.979729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec170f6-fe18-4846-922b-9dad461d7787 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:17.995726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec170f6-fe18-4846-922b-9dad461d7787 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:12:18.004132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-cec170f6-fe18-4846-922b-9dad461d7787 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:12:18.004132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:18.004132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:18.004132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:18.004132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:18.004132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:18.004132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:18.004132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:18.004132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:18.004132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:18.004132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:18.004132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:18.004132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:12:18.004132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:12:18.004132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:12:18.004132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:12:18.013297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:12:18.013297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:12:18.013297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:12:18.013297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:12:18.013297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:18.013297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:18.013297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:18.013297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:18.013297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:18.013297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:18.013297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:18.013297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:18.013297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:18.013297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:18.013297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:18.013297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:18.014263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:18.014263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:18.014263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:18.014263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:18.014263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:12:18.014263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:12:18.014263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:12:18.014263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:12:18.014263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:12:18.014263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:12:18.014263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:12:18.014263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:18.014263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 535/1062] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jul 20 19:12:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:18.017020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916429f-0388-4ef9-9347-abf1c5adb2ed None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:18.155288 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916429f-0388-4ef9-9347-abf1c5adb2ed None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:18.197873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:18.208058 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a14972-9a52-4998-bb5b-d88eaa0725f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:18.208743 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a14972-9a52-4998-bb5b-d88eaa0725f8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:18.209035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a14972-9a52-4998-bb5b-d88eaa0725f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:18.209309 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a14972-9a52-4998-bb5b-d88eaa0725f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:18.210066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a14972-9a52-4998-bb5b-d88eaa0725f8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:18.210406 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a14972-9a52-4998-bb5b-d88eaa0725f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:18.211798 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a14972-9a52-4998-bb5b-d88eaa0725f8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:18.228697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 528/1063] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jul 20 19:12:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:18.234629 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec170f6-fe18-4846-922b-9dad461d7787 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:18.329844 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2325916-364b-423d-b7a7-2fd5a93f348b None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:18.330171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2325916-364b-423d-b7a7-2fd5a93f348b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:18.330435 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2325916-364b-423d-b7a7-2fd5a93f348b None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:18.332378 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 529/1064] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:12:18.338138 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a13d5b-e661-4b1e-a6b5-1f70f937c6b4 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:18.338532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a13d5b-e661-4b1e-a6b5-1f70f937c6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:18.338920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a13d5b-e661-4b1e-a6b5-1f70f937c6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:18.349801 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec170f6-fe18-4846-922b-9dad461d7787 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:18.356178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b1a13d5b-e661-4b1e-a6b5-1f70f937c6b4 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:18.357382 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b1a13d5b-e661-4b1e-a6b5-1f70f937c6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:18.406481 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffe750-18de-4b6d-be0d-21bfab7ab4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:18.407544 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffe750-18de-4b6d-be0d-21bfab7ab4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:18.407828 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffe750-18de-4b6d-be0d-21bfab7ab4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:18.408102 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffe750-18de-4b6d-be0d-21bfab7ab4c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:18.420188 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cffe750-18de-4b6d-be0d-21bfab7ab4c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:18.421680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cffe750-18de-4b6d-be0d-21bfab7ab4c0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:18.447253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-2cffe750-18de-4b6d-be0d-21bfab7ab4c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:18.447253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:18.447253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:18.447253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:18.447253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:18.447253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:18.447253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:18.447253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:18.447253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:18.447253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:18.447253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:18.447253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:18.447253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:18.447253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:18.447253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:18.448376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:18.448376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:18.448376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:18.448376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:18.448376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:18.448376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:18.448376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:18.448376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:18.448376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:18.448376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:18.448376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:18.448376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:18.448376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:18.448376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:18.448376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:18.448376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:18.448376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:18.449319 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:18.449319 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:18.449319 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:18.449319 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:18.450528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 536/1065] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:18.457711 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffe750-18de-4b6d-be0d-21bfab7ab4c0 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:18.458414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 530/1066] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:18.485801 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a13d5b-e661-4b1e-a6b5-1f70f937c6b4 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:18.492759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:18.591292 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffe750-18de-4b6d-be0d-21bfab7ab4c0 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:18.625227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a13d5b-e661-4b1e-a6b5-1f70f937c6b4 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:18.633182 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b7c63-10cc-4339-97eb-4f316e5bc283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:18.633906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b7c63-10cc-4339-97eb-4f316e5bc283 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:18.634145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b7c63-10cc-4339-97eb-4f316e5bc283 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:18.634464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b7c63-10cc-4339-97eb-4f316e5bc283 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:18.635215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b7c63-10cc-4339-97eb-4f316e5bc283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:18.635517 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b7c63-10cc-4339-97eb-4f316e5bc283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:18.636901 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b7c63-10cc-4339-97eb-4f316e5bc283 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:18.657343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 537/1067] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:18.657562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:18.659461 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b7c63-10cc-4339-97eb-4f316e5bc283 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:18.678583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fa191-d185-4e46-968b-ed7a973e3b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:18.679387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fa191-d185-4e46-968b-ed7a973e3b65 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:18.679678 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fa191-d185-4e46-968b-ed7a973e3b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:18.679959 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fa191-d185-4e46-968b-ed7a973e3b65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:18.699153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555fa191-d185-4e46-968b-ed7a973e3b65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:12:18.708026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-555fa191-d185-4e46-968b-ed7a973e3b65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:18.708026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:18.708026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:18.708026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:18.708026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:18.708026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:18.708026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:18.708026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:18.708026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:18.708026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:18.708026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:18.708026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:18.708026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:12:18.708026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:12:18.708026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:12:18.708026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:12:18.709065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:12:18.709065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:12:18.709065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:12:18.709065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:12:18.709065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:18.709065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:18.709065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:18.709065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:18.709065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:18.709065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:18.709065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:18.709065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:18.709065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:18.709065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:18.709065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:18.709065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:18.709940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:18.709940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:18.709940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:18.709940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:18.709940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:12:18.709940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:12:18.709940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:12:18.709940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:12:18.709940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:12:18.709940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:12:18.709940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:18.709940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:18.711144 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 531/1068] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:12:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:18.716721 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fa191-d185-4e46-968b-ed7a973e3b65 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:18.787647 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:18.806794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b7c63-10cc-4339-97eb-4f316e5bc283 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:18.850993 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c0a5b-80d9-40f2-9f0c-2980d9d4c7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:18.851788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c0a5b-80d9-40f2-9f0c-2980d9d4c7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:18.852069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c0a5b-80d9-40f2-9f0c-2980d9d4c7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:18.852345 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c0a5b-80d9-40f2-9f0c-2980d9d4c7a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:18.865809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c0a5b-80d9-40f2-9f0c-2980d9d4c7a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:18.867326 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c0a5b-80d9-40f2-9f0c-2980d9d4c7a4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:18.871162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fa191-d185-4e46-968b-ed7a973e3b65 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:18.886990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-972c0a5b-80d9-40f2-9f0c-2980d9d4c7a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:12:18.886990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:18.886990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:18.886990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:18.886990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:18.886990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:18.886990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:18.886990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:18.886990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:18.886990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:18.886990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:18.886990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:18.886990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:12:18.886990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:12:18.886990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:12:18.886990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:12:18.888085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:18.888085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:18.888085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:12:18.888085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:18.888085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:12:18.888085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:18.888085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:18.888085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:18.888085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:18.888085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:18.888085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:18.888085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:18.888085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:18.888085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:18.888085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:18.888085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:18.888085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:18.888085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:18.889056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:18.889056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:18.889056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:12:18.889056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:12:18.889056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:12:18.889056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:12:18.889056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:12:18.889056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:12:18.889056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:12:18.889056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:18.889056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 538/1069] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jul 20 19:12:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:18.889662 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49e190-c100-4227-98e2-05a63f69088a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:18.889739 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49e190-c100-4227-98e2-05a63f69088a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:18.889986 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49e190-c100-4227-98e2-05a63f69088a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:18.891289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 539/1070] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:18.896541 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49e190-c100-4227-98e2-05a63f69088a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:18.920773 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4947f73-7020-4adb-821f-71d4abe9d8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:18.921453 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4947f73-7020-4adb-821f-71d4abe9d8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:18.921737 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4947f73-7020-4adb-821f-71d4abe9d8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:18.922012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4947f73-7020-4adb-821f-71d4abe9d8c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:18.922799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4947f73-7020-4adb-821f-71d4abe9d8c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:18.923105 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4947f73-7020-4adb-821f-71d4abe9d8c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:18.925007 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4947f73-7020-4adb-821f-71d4abe9d8c2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:18.939899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 532/1071] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:12:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:18.941507 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed14648-1dfb-4257-870d-4a6aeb24b95f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:18.941770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed14648-1dfb-4257-870d-4a6aeb24b95f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:18.942052 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed14648-1dfb-4257-870d-4a6aeb24b95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:18.960107 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8ed14648-1dfb-4257-870d-4a6aeb24b95f None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:18.961219 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8ed14648-1dfb-4257-870d-4a6aeb24b95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:18.998156 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:19.022956 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49e190-c100-4227-98e2-05a63f69088a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:19.032123 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 533/1072] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:19.033161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed14648-1dfb-4257-870d-4a6aeb24b95f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:19.072874 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfaabf-da51-4571-a7ed-746403b00c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:19.073908 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfaabf-da51-4571-a7ed-746403b00c92 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:19.074419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfaabf-da51-4571-a7ed-746403b00c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:19.074886 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfaabf-da51-4571-a7ed-746403b00c92 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:19.076386 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfaabf-da51-4571-a7ed-746403b00c92 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:19.076904 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfaabf-da51-4571-a7ed-746403b00c92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:19.079457 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfaabf-da51-4571-a7ed-746403b00c92 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:19.100888 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 540/1073] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jul 20 19:12:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:19.101741 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfaabf-da51-4571-a7ed-746403b00c92 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:19.109896 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:19.180496 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed14648-1dfb-4257-870d-4a6aeb24b95f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:19.215276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239ee85-2b4d-4907-856e-151a4e5cce35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:19.216048 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239ee85-2b4d-4907-856e-151a4e5cce35 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:19.216332 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239ee85-2b4d-4907-856e-151a4e5cce35 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:19.216605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239ee85-2b4d-4907-856e-151a4e5cce35 None admin] PATH_INFO: `/v3/users/4c476e26921843fd86ab27fc4a19e3f3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:19.217849 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239ee85-2b4d-4907-856e-151a4e5cce35 None admin] RBAC: Authorizing `identity:get_user(user_id=4c476e26921843fd86ab27fc4a19e3f3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:19.219336 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239ee85-2b4d-4907-856e-151a4e5cce35 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:19.221010 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 534/1074] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:12:19 2022] GET /identity/v3/users/4c476e26921843fd86ab27fc4a19e3f3 => generated 285 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:19.221670 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfaabf-da51-4571-a7ed-746403b00c92 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:19.222244 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239ee85-2b4d-4907-856e-151a4e5cce35 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:19.262293 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a825d-9fe1-445a-a1fa-54da077974aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:19.262957 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a825d-9fe1-445a-a1fa-54da077974aa None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:19.263241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a825d-9fe1-445a-a1fa-54da077974aa None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:19.263655 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a825d-9fe1-445a-a1fa-54da077974aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:19.268822 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:19.338213 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239ee85-2b4d-4907-856e-151a4e5cce35 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:19.360680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a825d-9fe1-445a-a1fa-54da077974aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:19.362724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a825d-9fe1-445a-a1fa-54da077974aa None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:19.366272 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:19.380732 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f746a9-7dc9-40b6-90c9-9cb43091deca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:19.381526 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f746a9-7dc9-40b6-90c9-9cb43091deca None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:19.381807 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f746a9-7dc9-40b6-90c9-9cb43091deca None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:19.382082 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f746a9-7dc9-40b6-90c9-9cb43091deca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:19.392611 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f746a9-7dc9-40b6-90c9-9cb43091deca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:19.394617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f746a9-7dc9-40b6-90c9-9cb43091deca None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:19.413044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-49f746a9-7dc9-40b6-90c9-9cb43091deca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:19.413044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:19.413044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:19.413044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:19.413044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:19.413044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:19.413044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:19.413044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:19.413044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:19.413044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:19.413044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:19.413044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:19.413044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:19.413044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:19.413044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:19.422119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:19.422119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:19.422119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:19.422119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:19.422119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:19.422119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:19.422119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:19.422119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:19.422119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:19.422119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:19.422119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:19.422119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:19.422119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:19.422119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:19.422119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:19.422119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:19.422119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:19.423719 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:19.423719 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:19.423719 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:19.423719 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:19.423719 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 535/1075] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:19.423719 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f746a9-7dc9-40b6-90c9-9cb43091deca None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:19.471912 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 541/1076] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:12:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:12:19.472752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a825d-9fe1-445a-a1fa-54da077974aa None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:19.526100 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:19.538427 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f746a9-7dc9-40b6-90c9-9cb43091deca None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:19.583424 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8163940-1d5a-443d-bd37-e6e0398aab1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:19.584283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a825d-9fe1-445a-a1fa-54da077974aa None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:19.584413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8163940-1d5a-443d-bd37-e6e0398aab1e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:19.584570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8163940-1d5a-443d-bd37-e6e0398aab1e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:19.584848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8163940-1d5a-443d-bd37-e6e0398aab1e None admin] PATH_INFO: `/v3/projects/f7a426a30c19481c8961005945fa5ac7` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:19.586057 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8163940-1d5a-443d-bd37-e6e0398aab1e None admin] RBAC: Authorizing `identity:get_project(project_id=f7a426a30c19481c8961005945fa5ac7)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:19.587275 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:19.587603 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8163940-1d5a-443d-bd37-e6e0398aab1e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:19.589606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 536/1077] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:12:19 2022] GET /identity/v3/projects/f7a426a30c19481c8961005945fa5ac7 => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:19.590262 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8163940-1d5a-443d-bd37-e6e0398aab1e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:19.624961 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d3958-7c3a-4c08-9722-a544bf1e4c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:19.625918 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d3958-7c3a-4c08-9722-a544bf1e4c48 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:19.626201 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d3958-7c3a-4c08-9722-a544bf1e4c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:19.626506 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d3958-7c3a-4c08-9722-a544bf1e4c48 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:19.627230 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d3958-7c3a-4c08-9722-a544bf1e4c48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:19.627562 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d3958-7c3a-4c08-9722-a544bf1e4c48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:19.628927 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d3958-7c3a-4c08-9722-a544bf1e4c48 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:19.640262 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 542/1078] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:19.641350 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d3958-7c3a-4c08-9722-a544bf1e4c48 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:19.702799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8163940-1d5a-443d-bd37-e6e0398aab1e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:19.742264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3b42d-5a66-4e64-82c6-80667beea9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:19.743012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3b42d-5a66-4e64-82c6-80667beea9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:19.743301 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3b42d-5a66-4e64-82c6-80667beea9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:19.743579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3b42d-5a66-4e64-82c6-80667beea9f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:19.752731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d3958-7c3a-4c08-9722-a544bf1e4c48 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:19.754622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3b42d-5a66-4e64-82c6-80667beea9f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:19.756074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3b42d-5a66-4e64-82c6-80667beea9f9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:19.774686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-fdf3b42d-5a66-4e64-82c6-80667beea9f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:19.774686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:19.774686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:19.774686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:19.774686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:19.774686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:19.774686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:19.774686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:19.774686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:19.774686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:19.774686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:19.774686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:19.774686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:19.774686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:19.774686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:19.775697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:19.775697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:19.775697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:19.775697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:19.775697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:19.775697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:19.775697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:19.775697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:19.775697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:19.775697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:19.775697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:19.775697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:19.775697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:19.775697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:19.775697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:19.775697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:19.775697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:19.776629 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:19.776629 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:19.776629 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:19.776629 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:19.776629 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 537/1079] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:19.777057 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3b42d-5a66-4e64-82c6-80667beea9f9 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:19.792679 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdec6b-3117-4268-bea6-0fc5847b6459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:19.793558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdec6b-3117-4268-bea6-0fc5847b6459 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:19.793836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdec6b-3117-4268-bea6-0fc5847b6459 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:19.794107 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fdec6b-3117-4268-bea6-0fc5847b6459 None admin] PATH_INFO: `/v3/projects/f7a426a30c19481c8961005945fa5ac7/users/4c476e26921843fd86ab27fc4a19e3f3/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:19.796094 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdec6b-3117-4268-bea6-0fc5847b6459 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7a426a30c19481c8961005945fa5ac7, user_id=4c476e26921843fd86ab27fc4a19e3f3, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:19.796268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:19.797522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fdec6b-3117-4268-bea6-0fc5847b6459 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:19.810894 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 543/1080] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:12:19 2022] PUT /identity/v3/projects/f7a426a30c19481c8961005945fa5ac7/users/4c476e26921843fd86ab27fc4a19e3f3/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:12:19.811427 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdec6b-3117-4268-bea6-0fc5847b6459 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:19.862753 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:19.913143 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3b42d-5a66-4e64-82c6-80667beea9f9 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:19.956418 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b5b67-f2bc-42e2-901d-0fb1a2e8829b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:19.957560 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b5b67-f2bc-42e2-901d-0fb1a2e8829b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:19.958010 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b5b67-f2bc-42e2-901d-0fb1a2e8829b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:19.958286 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b5b67-f2bc-42e2-901d-0fb1a2e8829b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:19.961310 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fdec6b-3117-4268-bea6-0fc5847b6459 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:19.966115 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b5b67-f2bc-42e2-901d-0fb1a2e8829b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:19.967849 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b5b67-f2bc-42e2-901d-0fb1a2e8829b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:19.987985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-695b5b67-f2bc-42e2-901d-0fb1a2e8829b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:19.987985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:19.987985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:19.987985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:19.987985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:19.987985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:19.987985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:19.987985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:19.987985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:19.987985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:19.987985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:19.987985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:19.987985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:12:19.987985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:12:19.987985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:12:19.989000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:12:19.989000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:19.989000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:19.989000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:19.989000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:19.989000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:19.989000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:19.989000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:19.989000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:19.989000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:19.989000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:19.989000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:19.989000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:19.989000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:19.989000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:19.989000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:19.989000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:19.989920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:12:19.989920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:12:19.989920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:12:19.989920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:12:19.989920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:12:19.989920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:12:19.989920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:19.989920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:19.997675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 538/1081] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:12:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:19.999832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b5b67-f2bc-42e2-901d-0fb1a2e8829b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:20.000440 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266a71c-d149-40eb-b4d6-3ed7f79f3b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:20.001109 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266a71c-d149-40eb-b4d6-3ed7f79f3b9f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:20.001395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266a71c-d149-40eb-b4d6-3ed7f79f3b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:20.001674 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266a71c-d149-40eb-b4d6-3ed7f79f3b9f None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:20.002953 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266a71c-d149-40eb-b4d6-3ed7f79f3b9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:20.003266 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266a71c-d149-40eb-b4d6-3ed7f79f3b9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:20.004645 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266a71c-d149-40eb-b4d6-3ed7f79f3b9f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:20.018779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 544/1082] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:20.110028 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:20.153655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b5b67-f2bc-42e2-901d-0fb1a2e8829b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:20.207138 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d20ac-f2d1-4e84-b4a7-9160682bb295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:20.207872 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d20ac-f2d1-4e84-b4a7-9160682bb295 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:20.208163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d20ac-f2d1-4e84-b4a7-9160682bb295 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:20.208439 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d20ac-f2d1-4e84-b4a7-9160682bb295 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:20.209303 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d20ac-f2d1-4e84-b4a7-9160682bb295 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:20.209818 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d20ac-f2d1-4e84-b4a7-9160682bb295 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:20.211054 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d20ac-f2d1-4e84-b4a7-9160682bb295 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:20.231247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 539/1083] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:12:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:20.237853 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266a71c-d149-40eb-b4d6-3ed7f79f3b9f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:20.364284 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:20.382021 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266a71c-d149-40eb-b4d6-3ed7f79f3b9f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:20.422530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6c596-13d4-46eb-b162-3b5f24404d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:20.423418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6c596-13d4-46eb-b162-3b5f24404d72 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:20.423801 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6c596-13d4-46eb-b162-3b5f24404d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:20.424594 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6c596-13d4-46eb-b162-3b5f24404d72 None admin] PATH_INFO: `/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/a1f0f6bc94de4645a8c82038ff2bd34a/roles/2c0eba8863f74445bb0726c9dc7510fb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:20.426872 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6c596-13d4-46eb-b162-3b5f24404d72 None admin] RBAC: Authorizing `identity:create_grant(project_id=416a38494ed54934ba8ab0d8e18afb35, user_id=a1f0f6bc94de4645a8c82038ff2bd34a, role_id=2c0eba8863f74445bb0726c9dc7510fb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:20.428289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6c596-13d4-46eb-b162-3b5f24404d72 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:20.444642 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 545/1084] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:12:20 2022] PUT /identity/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/a1f0f6bc94de4645a8c82038ff2bd34a/roles/2c0eba8863f74445bb0726c9dc7510fb => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:12:21.913460 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f5b8f-5e61-4dd7-8e4b-7bccf5c035f9 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:21.914012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f5b8f-5e61-4dd7-8e4b-7bccf5c035f9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:21.914012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f5b8f-5e61-4dd7-8e4b-7bccf5c035f9 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:21.915354 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 540/1085] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:21.920909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ba8a7-fa96-466c-8e1f-48a1554c3482 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:21.921399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ba8a7-fa96-466c-8e1f-48a1554c3482 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:21.921496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ba8a7-fa96-466c-8e1f-48a1554c3482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:21.941776 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-be1ba8a7-fa96-466c-8e1f-48a1554c3482 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:21.943015 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-be1ba8a7-fa96-466c-8e1f-48a1554c3482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:22.019702 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 546/1086] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:22.044446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f5b8f-5e61-4dd7-8e4b-7bccf5c035f9 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:22.150315 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f5b8f-5e61-4dd7-8e4b-7bccf5c035f9 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:22.182814 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:22.189052 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03830149-eaaa-48f8-bd74-9228970f9403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:22.189939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830149-eaaa-48f8-bd74-9228970f9403 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:22.190219 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830149-eaaa-48f8-bd74-9228970f9403 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:22.190550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830149-eaaa-48f8-bd74-9228970f9403 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:22.201440 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03830149-eaaa-48f8-bd74-9228970f9403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:12:22.211119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-03830149-eaaa-48f8-bd74-9228970f9403 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:22.211119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:22.211119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:22.211119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:22.211119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:22.211119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:22.211119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:22.211119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:22.211119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:22.211119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:22.211119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:22.211119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:22.211119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:12:22.211119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:12:22.211119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:12:22.211119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:12:22.212360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:12:22.212360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:12:22.212360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:12:22.212360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:12:22.212360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:22.212360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:22.212360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:22.212360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:22.212360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:22.212360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:22.212360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:22.212360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:22.212360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:22.212360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:22.212360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:22.212360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:22.213459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:22.213459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:22.213459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:22.213459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:22.213459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:12:22.213459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:12:22.213459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:12:22.213459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:12:22.213459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:12:22.213459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:12:22.213459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:22.213459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:22.214542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 541/1087] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:12:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:22.219628 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ba8a7-fa96-466c-8e1f-48a1554c3482 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:22.298177 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:22.325748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ba8a7-fa96-466c-8e1f-48a1554c3482 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:22.360548 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89ed02-14ef-4e3e-9da6-1eac7a51d02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:22.361219 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89ed02-14ef-4e3e-9da6-1eac7a51d02d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:22.361551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89ed02-14ef-4e3e-9da6-1eac7a51d02d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:22.362346 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89ed02-14ef-4e3e-9da6-1eac7a51d02d None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:22.363109 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89ed02-14ef-4e3e-9da6-1eac7a51d02d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:22.363423 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89ed02-14ef-4e3e-9da6-1eac7a51d02d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:22.364798 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89ed02-14ef-4e3e-9da6-1eac7a51d02d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:22.373660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 547/1088] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:12:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:22.379606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03830149-eaaa-48f8-bd74-9228970f9403 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:22.485605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03830149-eaaa-48f8-bd74-9228970f9403 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:22.510706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b38cd-84b0-4a25-b40d-bb3907a70bf3 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:22.511103 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b38cd-84b0-4a25-b40d-bb3907a70bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:22.511395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b38cd-84b0-4a25-b40d-bb3907a70bf3 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:22.512788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 548/1089] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:12:22.518378 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1b380-98a0-45c0-909d-de2434114516 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:22.518675 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1b380-98a0-45c0-909d-de2434114516 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:22.518953 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1b380-98a0-45c0-909d-de2434114516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:22.522378 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0912b9e-9fd0-4b45-8ccc-16678ec08678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:22.523216 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0912b9e-9fd0-4b45-8ccc-16678ec08678 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:22.523884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0912b9e-9fd0-4b45-8ccc-16678ec08678 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:22.523884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0912b9e-9fd0-4b45-8ccc-16678ec08678 None admin] PATH_INFO: `/v3/users/4c476e26921843fd86ab27fc4a19e3f3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:22.525003 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0912b9e-9fd0-4b45-8ccc-16678ec08678 None admin] RBAC: Authorizing `identity:get_user(user_id=4c476e26921843fd86ab27fc4a19e3f3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:22.526426 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0912b9e-9fd0-4b45-8ccc-16678ec08678 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:22.528122 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 542/1090] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:12:22 2022] GET /identity/v3/users/4c476e26921843fd86ab27fc4a19e3f3 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:22.535457 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0912b9e-9fd0-4b45-8ccc-16678ec08678 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:22.544920 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f5e1b380-98a0-45c0-909d-de2434114516 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:22.546246 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f5e1b380-98a0-45c0-909d-de2434114516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:22.615972 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:22.632881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 549/1091] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:22.657762 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1b380-98a0-45c0-909d-de2434114516 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:22.672955 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0912b9e-9fd0-4b45-8ccc-16678ec08678 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:22.709375 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16448b7-2e4c-46ed-a1a7-cb1192596de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:22.710028 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16448b7-2e4c-46ed-a1a7-cb1192596de2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:22.710338 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16448b7-2e4c-46ed-a1a7-cb1192596de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:22.710619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16448b7-2e4c-46ed-a1a7-cb1192596de2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:22.732616 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:22.771725 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1b380-98a0-45c0-909d-de2434114516 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:22.783972 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16448b7-2e4c-46ed-a1a7-cb1192596de2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:22.785441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16448b7-2e4c-46ed-a1a7-cb1192596de2 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:22.821671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22393a70-10df-4e2d-8cff-55e56d53820b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:22.823038 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22393a70-10df-4e2d-8cff-55e56d53820b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:22.823511 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22393a70-10df-4e2d-8cff-55e56d53820b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:22.823987 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22393a70-10df-4e2d-8cff-55e56d53820b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:22.837443 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22393a70-10df-4e2d-8cff-55e56d53820b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:12:22.848499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-22393a70-10df-4e2d-8cff-55e56d53820b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:12:22.848499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:22.848499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:22.848499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:22.848499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:22.848499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:22.848499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:22.848499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:22.848499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:22.848499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:22.848499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:22.848499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:22.848499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:12:22.848499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:12:22.848499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:12:22.848499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:12:22.849694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:12:22.849694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:12:22.849694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:12:22.849694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:12:22.849694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:22.849694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:22.849694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:22.849694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:22.849694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:22.849694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:22.849694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:22.849694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:22.849694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:22.849694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:22.849694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:22.849694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:22.851090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:22.851090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:22.851090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:22.851090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:22.851090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:12:22.851090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:12:22.851090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:12:22.851090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:12:22.851090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:12:22.851090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:12:22.851090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 19:12:22.851090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:22.851090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 550/1092] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Jul 20 19:12:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:22.852501 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:22.856089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22393a70-10df-4e2d-8cff-55e56d53820b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:22.908912 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 543/1093] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:12:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:12:22.915016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16448b7-2e4c-46ed-a1a7-cb1192596de2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:22.978941 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22393a70-10df-4e2d-8cff-55e56d53820b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:23.008202 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:23.018514 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b312c-c10e-405e-9bcc-70e86ed14580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:23.019228 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b312c-c10e-405e-9bcc-70e86ed14580 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:23.019551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b312c-c10e-405e-9bcc-70e86ed14580 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:23.019788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b312c-c10e-405e-9bcc-70e86ed14580 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:23.020526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b312c-c10e-405e-9bcc-70e86ed14580 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:23.020863 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b312c-c10e-405e-9bcc-70e86ed14580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:23.022364 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b312c-c10e-405e-9bcc-70e86ed14580 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:23.031215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 551/1094] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jul 20 19:12:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:23.037054 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b312c-c10e-405e-9bcc-70e86ed14580 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:23.039718 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16448b7-2e4c-46ed-a1a7-cb1192596de2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:23.079086 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624fd86-6ae2-4a56-a0ac-3534be5daab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:23.079941 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624fd86-6ae2-4a56-a0ac-3534be5daab5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:23.080958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624fd86-6ae2-4a56-a0ac-3534be5daab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:23.081249 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624fd86-6ae2-4a56-a0ac-3534be5daab5 None admin] PATH_INFO: `/v3/projects/f7a426a30c19481c8961005945fa5ac7` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:23.082502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624fd86-6ae2-4a56-a0ac-3534be5daab5 None admin] RBAC: Authorizing `identity:get_project(project_id=f7a426a30c19481c8961005945fa5ac7)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:23.084085 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624fd86-6ae2-4a56-a0ac-3534be5daab5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:23.085846 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 544/1095] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:12:22 2022] GET /identity/v3/projects/f7a426a30c19481c8961005945fa5ac7 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:23.091938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624fd86-6ae2-4a56-a0ac-3534be5daab5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:23.123035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:23.163800 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b312c-c10e-405e-9bcc-70e86ed14580 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:23.204321 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e2b88-4489-4523-abde-5d52667e768d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:23.205189 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e2b88-4489-4523-abde-5d52667e768d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:23.205483 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e2b88-4489-4523-abde-5d52667e768d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:23.205753 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e2b88-4489-4523-abde-5d52667e768d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:23.214248 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624fd86-6ae2-4a56-a0ac-3534be5daab5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:23.219139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e2b88-4489-4523-abde-5d52667e768d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:23.220588 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e2b88-4489-4523-abde-5d52667e768d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:23.240382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-3e1e2b88-4489-4523-abde-5d52667e768d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:23.240382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:23.240382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:23.240382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:23.240382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:23.240382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:23.240382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:23.240382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:23.240382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:23.240382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:23.240382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:23.240382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:23.240382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:23.240382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:23.240382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:23.241385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:23.241385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:23.241385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:23.241385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:23.241385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:23.241385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:23.241385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:23.241385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:23.241385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:23.241385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:23.241385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:23.241385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:23.241385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:23.241385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:23.241385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:23.241385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:23.241385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:23.242342 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:23.242342 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:23.242342 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:23.242342 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:23.242342 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 552/1096] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:23.247554 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e2b88-4489-4523-abde-5d52667e768d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:23.251344 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b7816-6ccd-4ddf-8877-e1ddb89c5e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:23.252010 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b7816-6ccd-4ddf-8877-e1ddb89c5e8f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:23.252822 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b7816-6ccd-4ddf-8877-e1ddb89c5e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:23.253099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b7816-6ccd-4ddf-8877-e1ddb89c5e8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:23.253922 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b7816-6ccd-4ddf-8877-e1ddb89c5e8f None admin] RBAC: Adding query filter params (role.id=6322f657162c45ca85f019a408655ff3, scope.project.id=f7a426a30c19481c8961005945fa5ac7, user.id=4c476e26921843fd86ab27fc4a19e3f3) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:23.254234 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b7816-6ccd-4ddf-8877-e1ddb89c5e8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:23.255705 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b7816-6ccd-4ddf-8877-e1ddb89c5e8f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:23.262066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 545/1097] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:12:23 2022] GET /identity/v3/role_assignments?user.id=4c476e26921843fd86ab27fc4a19e3f3&scope.project.id=f7a426a30c19481c8961005945fa5ac7&role.id=6322f657162c45ca85f019a408655ff3 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:23.302499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:23.372045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e2b88-4489-4523-abde-5d52667e768d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:23.409788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f3a30-221d-48d4-8aee-5cda234ccc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:23.410505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f3a30-221d-48d4-8aee-5cda234ccc87 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:23.410791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f3a30-221d-48d4-8aee-5cda234ccc87 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:23.411069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f3a30-221d-48d4-8aee-5cda234ccc87 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:23.411803 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f3a30-221d-48d4-8aee-5cda234ccc87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:23.412110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f3a30-221d-48d4-8aee-5cda234ccc87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:23.413510 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f3a30-221d-48d4-8aee-5cda234ccc87 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:23.429035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 553/1098] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:23.434095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b7816-6ccd-4ddf-8877-e1ddb89c5e8f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:23.554062 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:23.561620 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b7816-6ccd-4ddf-8877-e1ddb89c5e8f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:23.602471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c12195-1594-4a0b-b4c7-266cc0153894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:23.603256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c12195-1594-4a0b-b4c7-266cc0153894 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:23.603537 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c12195-1594-4a0b-b4c7-266cc0153894 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:23.603801 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c12195-1594-4a0b-b4c7-266cc0153894 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:23.613812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c12195-1594-4a0b-b4c7-266cc0153894 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:23.615639 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c12195-1594-4a0b-b4c7-266cc0153894 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:23.630715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-93c12195-1594-4a0b-b4c7-266cc0153894 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:12:23.630715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:23.630715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:23.630715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:23.630715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:23.630715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:23.630715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:23.630715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:23.630715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:23.630715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:23.630715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:23.630715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:23.630715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:12:23.630715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:12:23.630715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:12:23.630715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:12:23.632914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:23.632914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:23.632914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:12:23.632914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:23.632914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:12:23.632914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:12:23.632914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:23.632914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:23.632914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:23.632914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:23.632914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:23.632914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:23.632914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:23.632914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:23.632914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:23.632914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:23.632914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:23.632914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:23.635870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:23.635870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:23.635870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:12:23.635870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:12:23.635870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:12:23.635870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:12:23.635870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:12:23.635870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:12:23.635870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 19:12:23.635870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:23.635870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 546/1099] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Jul 20 19:12:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:23.639035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f3a30-221d-48d4-8aee-5cda234ccc87 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:23.765499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:23.769123 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f3a30-221d-48d4-8aee-5cda234ccc87 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:23.808565 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de859711-d399-4221-864c-ea8bc1989443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:23.809156 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de859711-d399-4221-864c-ea8bc1989443 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:23.809445 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de859711-d399-4221-864c-ea8bc1989443 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:23.809719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de859711-d399-4221-864c-ea8bc1989443 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:23.810597 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de859711-d399-4221-864c-ea8bc1989443 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:23.810911 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de859711-d399-4221-864c-ea8bc1989443 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:23.812326 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de859711-d399-4221-864c-ea8bc1989443 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:23.830980 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 554/1100] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Jul 20 19:12:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:23.837982 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c12195-1594-4a0b-b4c7-266cc0153894 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:23.959782 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c12195-1594-4a0b-b4c7-266cc0153894 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:24.012691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2744687-2e0c-4a7c-9360-aad5f4f23d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:24.013790 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2744687-2e0c-4a7c-9360-aad5f4f23d7f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:24.014164 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2744687-2e0c-4a7c-9360-aad5f4f23d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:24.014471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2744687-2e0c-4a7c-9360-aad5f4f23d7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:24.040176 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:24.101672 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2744687-2e0c-4a7c-9360-aad5f4f23d7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:24.105845 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2744687-2e0c-4a7c-9360-aad5f4f23d7f None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:24.226234 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 547/1101] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:12:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 19:12:24.232107 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de859711-d399-4221-864c-ea8bc1989443 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:24.349118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de859711-d399-4221-864c-ea8bc1989443 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:24.387610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b336b-40a5-44a6-898c-818f781de07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:24.388317 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b336b-40a5-44a6-898c-818f781de07d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:24.388594 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b336b-40a5-44a6-898c-818f781de07d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:24.388864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b336b-40a5-44a6-898c-818f781de07d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:24.400233 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b336b-40a5-44a6-898c-818f781de07d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:24.401654 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b336b-40a5-44a6-898c-818f781de07d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:24.419491 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-128b336b-40a5-44a6-898c-818f781de07d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:24.419491 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:24.419491 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:24.419491 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:24.419491 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:24.419491 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:24.419491 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:24.419491 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:24.419491 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:24.419491 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:24.419491 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:24.419491 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:24.419491 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:24.419491 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:24.419491 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:24.420579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:24.420579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:24.420579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:24.420579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:24.420579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:24.420579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:24.420579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:24.420579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:24.420579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:24.420579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:24.420579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:24.420579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:24.420579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:24.420579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:24.420579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:24.420579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:24.420579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:24.421645 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:12:24.421645 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:24.421645 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:12:24.421645 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:24.421645 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 555/1102] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:24.427100 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2744687-2e0c-4a7c-9360-aad5f4f23d7f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:24.492178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:24.541689 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2744687-2e0c-4a7c-9360-aad5f4f23d7f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:24.578628 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d139b43-4893-44e7-b3fb-6f02174d925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:24.579295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d139b43-4893-44e7-b3fb-6f02174d925b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:24.579573 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d139b43-4893-44e7-b3fb-6f02174d925b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:24.579837 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d139b43-4893-44e7-b3fb-6f02174d925b None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:24.581255 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d139b43-4893-44e7-b3fb-6f02174d925b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:24.581645 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d139b43-4893-44e7-b3fb-6f02174d925b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:24.583109 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d139b43-4893-44e7-b3fb-6f02174d925b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:24.595055 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 548/1103] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:24.600969 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b336b-40a5-44a6-898c-818f781de07d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:24.614977 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:24.728128 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b336b-40a5-44a6-898c-818f781de07d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:24.762647 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ec5cb-23d0-44c5-b63a-0ae11181caea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:24.763716 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ec5cb-23d0-44c5-b63a-0ae11181caea None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:24.764004 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ec5cb-23d0-44c5-b63a-0ae11181caea None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:24.764285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ec5cb-23d0-44c5-b63a-0ae11181caea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:24.771017 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ec5cb-23d0-44c5-b63a-0ae11181caea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:24.772456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ec5cb-23d0-44c5-b63a-0ae11181caea None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:24.787117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-fe4ec5cb-23d0-44c5-b63a-0ae11181caea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:24.787117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:24.787117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:24.787117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:24.787117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:24.787117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:24.787117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:24.787117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:24.787117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:24.787117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:24.787117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:24.787117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:24.787117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:12:24.787117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:12:24.787117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:12:24.788283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:12:24.788283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:24.788283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:24.788283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:24.788283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:24.788283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:24.788283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:24.788283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:24.788283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:24.788283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:24.788283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:24.788283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:24.788283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:24.788283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:24.788283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:24.788283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:24.788283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:24.789719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:12:24.789719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:12:24.789719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:12:24.789719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:12:24.789719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:12:24.789719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:12:24.789719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:12:24.789719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:24.789719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 556/1104] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:12:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:24.794172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d139b43-4893-44e7-b3fb-6f02174d925b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:24.905433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d139b43-4893-44e7-b3fb-6f02174d925b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:24.923106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:24.946456 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79573c15-0aa4-4b67-b6d1-59124ff9e2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:24.947123 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79573c15-0aa4-4b67-b6d1-59124ff9e2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:24.947439 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79573c15-0aa4-4b67-b6d1-59124ff9e2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:24.947723 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79573c15-0aa4-4b67-b6d1-59124ff9e2e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:24.948590 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79573c15-0aa4-4b67-b6d1-59124ff9e2e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:24.948899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79573c15-0aa4-4b67-b6d1-59124ff9e2e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:24.950475 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79573c15-0aa4-4b67-b6d1-59124ff9e2e6 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:24.964521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 549/1105] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:12:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:24.970842 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ec5cb-23d0-44c5-b63a-0ae11181caea None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:25.061187 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:25.093469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ec5cb-23d0-44c5-b63a-0ae11181caea None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:25.131568 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1953f-8f84-47bc-b299-b1cfb46a1d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:25.132347 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1953f-8f84-47bc-b299-b1cfb46a1d85 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:25.132725 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1953f-8f84-47bc-b299-b1cfb46a1d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:25.133125 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1953f-8f84-47bc-b299-b1cfb46a1d85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:25.134060 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1953f-8f84-47bc-b299-b1cfb46a1d85 None admin] RBAC: Adding query filter params (role.id=2c0eba8863f74445bb0726c9dc7510fb, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=a1f0f6bc94de4645a8c82038ff2bd34a) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:25.134505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1953f-8f84-47bc-b299-b1cfb46a1d85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:25.136032 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1953f-8f84-47bc-b299-b1cfb46a1d85 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:25.142206 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 557/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:12:24 2022] GET /identity/v3/role_assignments?user.id=a1f0f6bc94de4645a8c82038ff2bd34a&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=2c0eba8863f74445bb0726c9dc7510fb => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:12:25.376244 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8e9c4-dba9-4ddd-a404-551cfa8f9fc9 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:25.376442 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8e9c4-dba9-4ddd-a404-551cfa8f9fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:25.376722 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8e9c4-dba9-4ddd-a404-551cfa8f9fc9 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:25.378635 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 550/1107] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:25.384707 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d44e7-5c42-4d94-aaf4-99870a4895c2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:25.385196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d44e7-5c42-4d94-aaf4-99870a4895c2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:25.385633 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d44e7-5c42-4d94-aaf4-99870a4895c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:25.405447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d34d44e7-5c42-4d94-aaf4-99870a4895c2 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:25.407000 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d34d44e7-5c42-4d94-aaf4-99870a4895c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:25.480500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 558/1108] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:25.516682 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8e9c4-dba9-4ddd-a404-551cfa8f9fc9 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:25.637464 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8e9c4-dba9-4ddd-a404-551cfa8f9fc9 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:25.676696 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a8751-7c50-43d5-a2a0-8bebd98c1bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:25.677960 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a8751-7c50-43d5-a2a0-8bebd98c1bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:25.678441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a8751-7c50-43d5-a2a0-8bebd98c1bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:25.678792 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a8751-7c50-43d5-a2a0-8bebd98c1bb8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:25.680392 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a8751-7c50-43d5-a2a0-8bebd98c1bb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:25.682405 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a8751-7c50-43d5-a2a0-8bebd98c1bb8 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:25.684239 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 551/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:25.690996 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d44e7-5c42-4d94-aaf4-99870a4895c2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:25.766081 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:25.814637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d44e7-5c42-4d94-aaf4-99870a4895c2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:25.856274 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb3e58-2d37-4615-a63e-d86c8be515fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:25.856962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb3e58-2d37-4615-a63e-d86c8be515fb None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:25.857248 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb3e58-2d37-4615-a63e-d86c8be515fb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:25.857529 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb3e58-2d37-4615-a63e-d86c8be515fb None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:25.858263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb3e58-2d37-4615-a63e-d86c8be515fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:25.859724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb3e58-2d37-4615-a63e-d86c8be515fb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:25.884554 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 559/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 20 19:12:25 2022] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:12:28.073707 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729094d-9b90-4701-bf13-173c61ed79f0 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:28.074245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729094d-9b90-4701-bf13-173c61ed79f0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:28.074245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729094d-9b90-4701-bf13-173c61ed79f0 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:28.075654 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 552/1111] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:28.081495 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaba745-2bba-4886-959a-2be7e0332d6f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:28.081912 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaba745-2bba-4886-959a-2be7e0332d6f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:28.082046 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaba745-2bba-4886-959a-2be7e0332d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:28.098668 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-adaba745-2bba-4886-959a-2be7e0332d6f None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:28.099847 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-adaba745-2bba-4886-959a-2be7e0332d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:28.166736 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 560/1112] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:28.190512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729094d-9b90-4701-bf13-173c61ed79f0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:28.233734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:28.294100 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729094d-9b90-4701-bf13-173c61ed79f0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:28.327602 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7931f6-e9c9-4f20-a9e5-701a59a53ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:28.328380 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7931f6-e9c9-4f20-a9e5-701a59a53ceb None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:28.328662 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7931f6-e9c9-4f20-a9e5-701a59a53ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:28.328941 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7931f6-e9c9-4f20-a9e5-701a59a53ceb None admin] PATH_INFO: `/v3/roles/61bf7de1301f489ab3311c954d548da5` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:28.330992 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7931f6-e9c9-4f20-a9e5-701a59a53ceb None admin] RBAC: Authorizing `identity:get_role(role_id=61bf7de1301f489ab3311c954d548da5)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:28.332549 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7931f6-e9c9-4f20-a9e5-701a59a53ceb None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:28.334106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 553/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:12:28 2022] GET /identity/v3/roles/61bf7de1301f489ab3311c954d548da5 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:28.340065 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaba745-2bba-4886-959a-2be7e0332d6f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:28.388736 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:28.439985 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaba745-2bba-4886-959a-2be7e0332d6f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:28.478177 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf87c9a-b3be-48f7-bca6-51987a1fd8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:28.479082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf87c9a-b3be-48f7-bca6-51987a1fd8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:28.479382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf87c9a-b3be-48f7-bca6-51987a1fd8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:28.479642 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf87c9a-b3be-48f7-bca6-51987a1fd8e7 None admin] PATH_INFO: `/v3/users/d9138896f19b481f917ecc0f89b1cefe` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:28.496451 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf87c9a-b3be-48f7-bca6-51987a1fd8e7 None admin] RBAC: Authorizing `identity:get_user(user_id=d9138896f19b481f917ecc0f89b1cefe)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:28.497899 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf87c9a-b3be-48f7-bca6-51987a1fd8e7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:28.499654 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 561/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:12:28 2022] GET /identity/v3/users/d9138896f19b481f917ecc0f89b1cefe => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:28.508910 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7931f6-e9c9-4f20-a9e5-701a59a53ceb None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:28.609912 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7931f6-e9c9-4f20-a9e5-701a59a53ceb None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:28.619755 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:28.646914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fa8ca-863c-4b84-8846-75c161d09799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:28.647560 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fa8ca-863c-4b84-8846-75c161d09799 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:28.647845 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fa8ca-863c-4b84-8846-75c161d09799 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:28.648123 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fa8ca-863c-4b84-8846-75c161d09799 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:28.715070 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fa8ca-863c-4b84-8846-75c161d09799 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:28.716520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fa8ca-863c-4b84-8846-75c161d09799 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:28.814589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 554/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:12:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:12:28.820612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf87c9a-b3be-48f7-bca6-51987a1fd8e7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:28.917369 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf87c9a-b3be-48f7-bca6-51987a1fd8e7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:28.926945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:28.951133 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ea308-7a9c-4f05-9e22-cd33c1c6a90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:28.951985 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ea308-7a9c-4f05-9e22-cd33c1c6a90b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:28.952265 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ea308-7a9c-4f05-9e22-cd33c1c6a90b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:28.952536 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ea308-7a9c-4f05-9e22-cd33c1c6a90b None admin] PATH_INFO: `/v3/projects/f7a426a30c19481c8961005945fa5ac7` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:28.953694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ea308-7a9c-4f05-9e22-cd33c1c6a90b None admin] RBAC: Authorizing `identity:get_project(project_id=f7a426a30c19481c8961005945fa5ac7)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:28.955147 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ea308-7a9c-4f05-9e22-cd33c1c6a90b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:28.956840 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 562/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:12:28 2022] GET /identity/v3/projects/f7a426a30c19481c8961005945fa5ac7 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:28.963282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fa8ca-863c-4b84-8846-75c161d09799 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:28.973768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:29.074604 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fa8ca-863c-4b84-8846-75c161d09799 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:29.112038 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893cf9f-5522-4eef-9df8-99124ca936ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:29.112690 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893cf9f-5522-4eef-9df8-99124ca936ae None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:29.112998 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893cf9f-5522-4eef-9df8-99124ca936ae None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:29.113283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893cf9f-5522-4eef-9df8-99124ca936ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:29.114125 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893cf9f-5522-4eef-9df8-99124ca936ae None admin] RBAC: Adding query filter params (role.id=61bf7de1301f489ab3311c954d548da5, scope.project.id=f7a426a30c19481c8961005945fa5ac7, user.id=d9138896f19b481f917ecc0f89b1cefe) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:29.114480 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893cf9f-5522-4eef-9df8-99124ca936ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:29.115944 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893cf9f-5522-4eef-9df8-99124ca936ae None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:29.121421 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 555/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:12:28 2022] GET /identity/v3/role_assignments?user.id=d9138896f19b481f917ecc0f89b1cefe&scope.project.id=f7a426a30c19481c8961005945fa5ac7&role.id=61bf7de1301f489ab3311c954d548da5 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:31.169966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f657f-b421-4918-becf-e007b4b7feef None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:31.170587 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f657f-b421-4918-becf-e007b4b7feef None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:31.170587 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f657f-b421-4918-becf-e007b4b7feef None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:31.171917 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 563/1118] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:12:31.178462 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7700270-095a-4aab-83e2-dd69b36bc0d5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:31.178938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7700270-095a-4aab-83e2-dd69b36bc0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:31.179079 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7700270-095a-4aab-83e2-dd69b36bc0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:31.196115 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d7700270-095a-4aab-83e2-dd69b36bc0d5 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:31.197658 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d7700270-095a-4aab-83e2-dd69b36bc0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:31.286071 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 556/1119] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:31.309235 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f657f-b421-4918-becf-e007b4b7feef None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:31.424442 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f657f-b421-4918-becf-e007b4b7feef None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:31.459647 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b1dc6-5411-4057-a42e-0226b3381a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:31.460507 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b1dc6-5411-4057-a42e-0226b3381a1d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:31.460788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b1dc6-5411-4057-a42e-0226b3381a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:31.461064 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b1dc6-5411-4057-a42e-0226b3381a1d None admin] PATH_INFO: `/v3/roles/61bf7de1301f489ab3311c954d548da5` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:31.462613 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b1dc6-5411-4057-a42e-0226b3381a1d None admin] RBAC: Authorizing `identity:get_role(role_id=61bf7de1301f489ab3311c954d548da5)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:31.464112 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b1dc6-5411-4057-a42e-0226b3381a1d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:31.465515 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 564/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:12:31 2022] GET /identity/v3/roles/61bf7de1301f489ab3311c954d548da5 => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:31.472144 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7700270-095a-4aab-83e2-dd69b36bc0d5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:31.474366 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:31.582814 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7700270-095a-4aab-83e2-dd69b36bc0d5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:31.626627 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d40154-938e-4c86-9d73-bbeb40337486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:31.627536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d40154-938e-4c86-9d73-bbeb40337486 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:31.627824 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d40154-938e-4c86-9d73-bbeb40337486 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:31.628106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d40154-938e-4c86-9d73-bbeb40337486 None admin] PATH_INFO: `/v3/users/d9138896f19b481f917ecc0f89b1cefe` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:31.629336 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d40154-938e-4c86-9d73-bbeb40337486 None admin] RBAC: Authorizing `identity:get_user(user_id=d9138896f19b481f917ecc0f89b1cefe)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:31.630817 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d40154-938e-4c86-9d73-bbeb40337486 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:31.632497 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 557/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:12:31 2022] GET /identity/v3/users/d9138896f19b481f917ecc0f89b1cefe => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:31.638413 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b1dc6-5411-4057-a42e-0226b3381a1d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:31.687236 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:31.751099 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b1dc6-5411-4057-a42e-0226b3381a1d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:31.788106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0f0d0-2716-4c80-b970-15c9ae3479b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:31.788966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0f0d0-2716-4c80-b970-15c9ae3479b3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:31.789246 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0f0d0-2716-4c80-b970-15c9ae3479b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:31.789517 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0f0d0-2716-4c80-b970-15c9ae3479b3 None admin] PATH_INFO: `/v3/projects/f7a426a30c19481c8961005945fa5ac7` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:31.790744 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0f0d0-2716-4c80-b970-15c9ae3479b3 None admin] RBAC: Authorizing `identity:get_project(project_id=f7a426a30c19481c8961005945fa5ac7)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:31.792191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0f0d0-2716-4c80-b970-15c9ae3479b3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:31.793925 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 565/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:12:31 2022] GET /identity/v3/projects/f7a426a30c19481c8961005945fa5ac7 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:31.800467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d40154-938e-4c86-9d73-bbeb40337486 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:31.882379 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:31.922450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d40154-938e-4c86-9d73-bbeb40337486 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:31.961526 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca3828-dd3b-4d6f-83cf-ee94a8d3793d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:31.962333 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca3828-dd3b-4d6f-83cf-ee94a8d3793d None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:31.962631 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca3828-dd3b-4d6f-83cf-ee94a8d3793d None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:31.962913 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca3828-dd3b-4d6f-83cf-ee94a8d3793d None admin] PATH_INFO: `/v3/projects/f7a426a30c19481c8961005945fa5ac7/users/d9138896f19b481f917ecc0f89b1cefe/roles/61bf7de1301f489ab3311c954d548da5` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:31.965221 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca3828-dd3b-4d6f-83cf-ee94a8d3793d None admin] RBAC: Authorizing `identity:create_grant(project_id=f7a426a30c19481c8961005945fa5ac7, user_id=d9138896f19b481f917ecc0f89b1cefe, role_id=61bf7de1301f489ab3311c954d548da5)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:31.966692 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca3828-dd3b-4d6f-83cf-ee94a8d3793d None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:31.981705 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 558/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:12:31 2022] PUT /identity/v3/projects/f7a426a30c19481c8961005945fa5ac7/users/d9138896f19b481f917ecc0f89b1cefe/roles/61bf7de1301f489ab3311c954d548da5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:12:34.000001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bdbba-734e-4630-a9f2-59b0c51836a1 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:34.000545 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bdbba-734e-4630-a9f2-59b0c51836a1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:34.000636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bdbba-734e-4630-a9f2-59b0c51836a1 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:34.002533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 566/1124] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:34.007914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbcb81-1b2e-453f-a8d9-5b44145f49aa None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:34.008317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbcb81-1b2e-453f-a8d9-5b44145f49aa None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:34.008752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbcb81-1b2e-453f-a8d9-5b44145f49aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:34.026482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d5fbcb81-1b2e-453f-a8d9-5b44145f49aa None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:34.027693 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d5fbcb81-1b2e-453f-a8d9-5b44145f49aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:34.093699 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 559/1125] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:34.116576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bdbba-734e-4630-a9f2-59b0c51836a1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:34.216271 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bdbba-734e-4630-a9f2-59b0c51836a1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:34.229221 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:34.250072 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f9eaa-2198-4c05-a72e-364a1566fc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:34.250883 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f9eaa-2198-4c05-a72e-364a1566fc08 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:34.251162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f9eaa-2198-4c05-a72e-364a1566fc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:34.251958 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f9eaa-2198-4c05-a72e-364a1566fc08 None admin] PATH_INFO: `/v3/roles/61bf7de1301f489ab3311c954d548da5` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:34.253413 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f9eaa-2198-4c05-a72e-364a1566fc08 None admin] RBAC: Authorizing `identity:get_role(role_id=61bf7de1301f489ab3311c954d548da5)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:34.254801 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f9eaa-2198-4c05-a72e-364a1566fc08 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:34.256178 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 567/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:12:34 2022] GET /identity/v3/roles/61bf7de1301f489ab3311c954d548da5 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:34.262241 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbcb81-1b2e-453f-a8d9-5b44145f49aa None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:34.332019 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:34.374329 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbcb81-1b2e-453f-a8d9-5b44145f49aa None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:34.408089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a726ddc-bf99-4054-8d00-4ec98c093b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:34.408961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a726ddc-bf99-4054-8d00-4ec98c093b7a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:34.409240 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a726ddc-bf99-4054-8d00-4ec98c093b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:34.409510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a726ddc-bf99-4054-8d00-4ec98c093b7a None admin] PATH_INFO: `/v3/users/d9138896f19b481f917ecc0f89b1cefe` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:34.410729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a726ddc-bf99-4054-8d00-4ec98c093b7a None admin] RBAC: Authorizing `identity:get_user(user_id=d9138896f19b481f917ecc0f89b1cefe)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:34.412165 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a726ddc-bf99-4054-8d00-4ec98c093b7a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:34.413804 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 560/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:12:34 2022] GET /identity/v3/users/d9138896f19b481f917ecc0f89b1cefe => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:34.419721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f9eaa-2198-4c05-a72e-364a1566fc08 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:34.519742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f9eaa-2198-4c05-a72e-364a1566fc08 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:34.555353 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50104d-224b-42b5-91e0-e414de2e96d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:34.556002 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50104d-224b-42b5-91e0-e414de2e96d4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:34.556287 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50104d-224b-42b5-91e0-e414de2e96d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:34.556564 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50104d-224b-42b5-91e0-e414de2e96d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:34.603965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:34.623720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50104d-224b-42b5-91e0-e414de2e96d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:34.625158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50104d-224b-42b5-91e0-e414de2e96d4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:34.732439 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 568/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:12:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 19:12:34.738866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a726ddc-bf99-4054-8d00-4ec98c093b7a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:34.835796 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a726ddc-bf99-4054-8d00-4ec98c093b7a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:34.861622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:34.869777 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3f802-215c-4f71-bda5-bc255c044fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:34.870667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3f802-215c-4f71-bda5-bc255c044fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:34.870950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3f802-215c-4f71-bda5-bc255c044fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:34.871227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3f802-215c-4f71-bda5-bc255c044fd5 None admin] PATH_INFO: `/v3/projects/f7a426a30c19481c8961005945fa5ac7` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:34.872399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3f802-215c-4f71-bda5-bc255c044fd5 None admin] RBAC: Authorizing `identity:get_project(project_id=f7a426a30c19481c8961005945fa5ac7)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:34.873841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3f802-215c-4f71-bda5-bc255c044fd5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:34.875576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 561/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:12:34 2022] GET /identity/v3/projects/f7a426a30c19481c8961005945fa5ac7 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:34.881746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50104d-224b-42b5-91e0-e414de2e96d4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:34.977830 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:35.006101 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50104d-224b-42b5-91e0-e414de2e96d4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:35.043410 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6efd7-43ee-4205-adb5-83fb65364ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:35.044065 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6efd7-43ee-4205-adb5-83fb65364ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:35.044353 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6efd7-43ee-4205-adb5-83fb65364ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:35.044633 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6efd7-43ee-4205-adb5-83fb65364ea6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:35.045468 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6efd7-43ee-4205-adb5-83fb65364ea6 None admin] RBAC: Adding query filter params (role.id=61bf7de1301f489ab3311c954d548da5, scope.project.id=f7a426a30c19481c8961005945fa5ac7, user.id=d9138896f19b481f917ecc0f89b1cefe) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:35.045791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6efd7-43ee-4205-adb5-83fb65364ea6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:35.047244 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6efd7-43ee-4205-adb5-83fb65364ea6 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:35.053708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 569/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:12:34 2022] GET /identity/v3/role_assignments?user.id=d9138896f19b481f917ecc0f89b1cefe&scope.project.id=f7a426a30c19481c8961005945fa5ac7&role.id=61bf7de1301f489ab3311c954d548da5 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:37.089867 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e8ae7-7407-4da8-b522-5992306b0d7d None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:37.090461 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e8ae7-7407-4da8-b522-5992306b0d7d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:37.090461 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e8ae7-7407-4da8-b522-5992306b0d7d None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:37.091815 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 562/1131] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:37.097462 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74bc72-7de5-42ed-bea9-edcee78f0dd6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:37.097858 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74bc72-7de5-42ed-bea9-edcee78f0dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:37.098015 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74bc72-7de5-42ed-bea9-edcee78f0dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:37.114348 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1e74bc72-7de5-42ed-bea9-edcee78f0dd6 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:37.115550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1e74bc72-7de5-42ed-bea9-edcee78f0dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:37.180099 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 570/1132] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:37.203304 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e8ae7-7407-4da8-b522-5992306b0d7d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:37.303320 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e8ae7-7407-4da8-b522-5992306b0d7d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:37.336224 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de160bf-e914-4e6f-a4a2-eb446484edc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:37.337009 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de160bf-e914-4e6f-a4a2-eb446484edc4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:37.337297 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de160bf-e914-4e6f-a4a2-eb446484edc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:37.337572 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de160bf-e914-4e6f-a4a2-eb446484edc4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:37.338800 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de160bf-e914-4e6f-a4a2-eb446484edc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:37.340283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de160bf-e914-4e6f-a4a2-eb446484edc4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:37.341850 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 563/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:37.348302 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74bc72-7de5-42ed-bea9-edcee78f0dd6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:37.420240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:37.445123 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e74bc72-7de5-42ed-bea9-edcee78f0dd6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:37.481141 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4fd0c-fb3a-4ba3-afb8-d0c108f9c163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:37.481801 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4fd0c-fb3a-4ba3-afb8-d0c108f9c163 None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:37.482085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4fd0c-fb3a-4ba3-afb8-d0c108f9c163 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:37.482388 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4fd0c-fb3a-4ba3-afb8-d0c108f9c163 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:37.483110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d4fd0c-fb3a-4ba3-afb8-d0c108f9c163 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:37.484610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d4fd0c-fb3a-4ba3-afb8-d0c108f9c163 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:37.510183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 571/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 20 19:12:37 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:12:39.603883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b9c42-5860-42f1-9e28-b4a259ae3ff1 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:39.604466 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b9c42-5860-42f1-9e28-b4a259ae3ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:39.604466 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b9c42-5860-42f1-9e28-b4a259ae3ff1 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:39.605790 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 564/1135] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:39.611806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a775c6b-4d02-4340-8496-2b82b17eef77 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:39.612254 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a775c6b-4d02-4340-8496-2b82b17eef77 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:39.612377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a775c6b-4d02-4340-8496-2b82b17eef77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:39.630203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6a775c6b-4d02-4340-8496-2b82b17eef77 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:39.631417 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6a775c6b-4d02-4340-8496-2b82b17eef77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:39.697711 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 572/1136] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:39.722329 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b9c42-5860-42f1-9e28-b4a259ae3ff1 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:39.784512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:39.822963 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b9c42-5860-42f1-9e28-b4a259ae3ff1 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:39.856526 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e0db8-26ca-4b24-a76d-42a42e69b3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:39.857238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e0db8-26ca-4b24-a76d-42a42e69b3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:39.857521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e0db8-26ca-4b24-a76d-42a42e69b3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:39.857794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e0db8-26ca-4b24-a76d-42a42e69b3a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:39.858975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e0db8-26ca-4b24-a76d-42a42e69b3a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:39.860996 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e0db8-26ca-4b24-a76d-42a42e69b3a7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:39.862668 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 565/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:12:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:39.868463 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a775c6b-4d02-4340-8496-2b82b17eef77 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:39.922936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:39.968888 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a775c6b-4d02-4340-8496-2b82b17eef77 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:40.005213 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029e5b3-a145-4d6e-94f5-fce99d6793eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:40.006099 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029e5b3-a145-4d6e-94f5-fce99d6793eb None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:40.006417 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029e5b3-a145-4d6e-94f5-fce99d6793eb None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:40.006698 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029e5b3-a145-4d6e-94f5-fce99d6793eb None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:40.007412 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029e5b3-a145-4d6e-94f5-fce99d6793eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:40.009633 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029e5b3-a145-4d6e-94f5-fce99d6793eb None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:40.030975 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 573/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 20 19:12:39 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:12:42.143860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c255e6e-d39c-4449-a194-33c428584265 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:42.144443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c255e6e-d39c-4449-a194-33c428584265 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:42.144443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c255e6e-d39c-4449-a194-33c428584265 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:42.145823 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 566/1139] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:42.151282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f1ab8-244a-486e-9b99-9905701344a7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:42.151710 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f1ab8-244a-486e-9b99-9905701344a7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:42.151846 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f1ab8-244a-486e-9b99-9905701344a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:42.168613 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-451f1ab8-244a-486e-9b99-9905701344a7 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:42.169942 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-451f1ab8-244a-486e-9b99-9905701344a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:42.234930 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 574/1140] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:12:42.258861 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c255e6e-d39c-4449-a194-33c428584265 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:42.365037 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c255e6e-d39c-4449-a194-33c428584265 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:42.394493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:42.399704 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45602bcf-cad4-4be9-858b-08c45a85c73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:42.400533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45602bcf-cad4-4be9-858b-08c45a85c73f None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:42.400814 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45602bcf-cad4-4be9-858b-08c45a85c73f None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:42.401087 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45602bcf-cad4-4be9-858b-08c45a85c73f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:42.411378 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45602bcf-cad4-4be9-858b-08c45a85c73f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:12:42.419066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-45602bcf-cad4-4be9-858b-08c45a85c73f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:42.419066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:42.419066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:42.419066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:42.419066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:42.419066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:42.419066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:42.419066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:42.419066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:42.419066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:42.419066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:42.419066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:42.419066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:12:42.419066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:12:42.419066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:12:42.419066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:12:42.420157 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:12:42.420157 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:12:42.420157 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:12:42.420157 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:12:42.420157 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:42.420157 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:42.420157 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:42.420157 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:42.420157 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:42.420157 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:42.420157 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:42.420157 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:42.420157 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:42.420157 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:42.420157 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:42.420157 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:42.421369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:42.421369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:42.421369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:42.421369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:42.421369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:12:42.421369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:12:42.421369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:12:42.421369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:12:42.421369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:12:42.421369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:12:42.421369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:42.421369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:42.421369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 567/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:12:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:42.426854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f1ab8-244a-486e-9b99-9905701344a7 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:42.468510 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:42.526187 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f1ab8-244a-486e-9b99-9905701344a7 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:42.561795 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5bd46-54e0-4dff-9f3e-a19d1707bf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:42.562527 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5bd46-54e0-4dff-9f3e-a19d1707bf02 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:42.562853 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5bd46-54e0-4dff-9f3e-a19d1707bf02 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:42.563053 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5bd46-54e0-4dff-9f3e-a19d1707bf02 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:42.564401 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5bd46-54e0-4dff-9f3e-a19d1707bf02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:42.564693 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5bd46-54e0-4dff-9f3e-a19d1707bf02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:42.566086 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5bd46-54e0-4dff-9f3e-a19d1707bf02 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:42.574464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 575/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:12:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:42.580318 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45602bcf-cad4-4be9-858b-08c45a85c73f None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:42.686080 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45602bcf-cad4-4be9-858b-08c45a85c73f None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:42.722364 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19704fcd-c47b-406a-9af8-f8fcc5074c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:42.723436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19704fcd-c47b-406a-9af8-f8fcc5074c09 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:42.723724 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19704fcd-c47b-406a-9af8-f8fcc5074c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:42.724002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19704fcd-c47b-406a-9af8-f8fcc5074c09 None admin] PATH_INFO: `/v3/users/ac43ea6a3d6b4e93996782307cbb3d0b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:42.737772 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19704fcd-c47b-406a-9af8-f8fcc5074c09 None admin] RBAC: Authorizing `identity:get_user(user_id=ac43ea6a3d6b4e93996782307cbb3d0b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:42.739251 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19704fcd-c47b-406a-9af8-f8fcc5074c09 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:42.740967 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 568/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:12:42 2022] GET /identity/v3/users/ac43ea6a3d6b4e93996782307cbb3d0b => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:42.746821 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5bd46-54e0-4dff-9f3e-a19d1707bf02 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:42.845274 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5bd46-54e0-4dff-9f3e-a19d1707bf02 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:42.847634 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:42.886263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d38ddc-a07c-4134-94c2-e13cc924b79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:42.886934 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d38ddc-a07c-4134-94c2-e13cc924b79a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:42.887237 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d38ddc-a07c-4134-94c2-e13cc924b79a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:42.887496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d38ddc-a07c-4134-94c2-e13cc924b79a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:42.953421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d38ddc-a07c-4134-94c2-e13cc924b79a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:42.954861 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d38ddc-a07c-4134-94c2-e13cc924b79a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:43.051900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 576/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:12:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:12:43.058085 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19704fcd-c47b-406a-9af8-f8fcc5074c09 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:43.108673 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:43.156784 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19704fcd-c47b-406a-9af8-f8fcc5074c09 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:43.191321 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e1765-d6d5-41bf-865d-9609cb477bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:43.192170 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e1765-d6d5-41bf-865d-9609cb477bcb None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:43.192453 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e1765-d6d5-41bf-865d-9609cb477bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:43.192730 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e1765-d6d5-41bf-865d-9609cb477bcb None admin] PATH_INFO: `/v3/projects/0c67b144b15344c59f2847ebb193675b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:43.193909 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e1765-d6d5-41bf-865d-9609cb477bcb None admin] RBAC: Authorizing `identity:get_project(project_id=0c67b144b15344c59f2847ebb193675b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:43.195374 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e1765-d6d5-41bf-865d-9609cb477bcb None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:43.197070 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 569/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:12:43 2022] GET /identity/v3/projects/0c67b144b15344c59f2847ebb193675b => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:43.203306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d38ddc-a07c-4134-94c2-e13cc924b79a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:43.206977 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:43.300656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d38ddc-a07c-4134-94c2-e13cc924b79a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:43.334190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad980fdf-cc35-4184-a7bb-90798a0e824b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:43.334854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad980fdf-cc35-4184-a7bb-90798a0e824b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:43.335134 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad980fdf-cc35-4184-a7bb-90798a0e824b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:43.335407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad980fdf-cc35-4184-a7bb-90798a0e824b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:43.336230 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad980fdf-cc35-4184-a7bb-90798a0e824b None admin] RBAC: Adding query filter params (role.id=6322f657162c45ca85f019a408655ff3, scope.project.id=0c67b144b15344c59f2847ebb193675b, user.id=ac43ea6a3d6b4e93996782307cbb3d0b) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:43.336539 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad980fdf-cc35-4184-a7bb-90798a0e824b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:43.337968 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad980fdf-cc35-4184-a7bb-90798a0e824b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:43.343369 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 577/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:12:43 2022] GET /identity/v3/role_assignments?user.id=ac43ea6a3d6b4e93996782307cbb3d0b&scope.project.id=0c67b144b15344c59f2847ebb193675b&role.id=6322f657162c45ca85f019a408655ff3 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:45.374032 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77791e-419b-4872-be75-005bb39dd858 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:45.374599 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77791e-419b-4872-be75-005bb39dd858 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:45.374599 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77791e-419b-4872-be75-005bb39dd858 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:45.376630 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 570/1147] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:45.382027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d48de-e8ef-4d05-8517-578b41ac6d13 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:45.382496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d48de-e8ef-4d05-8517-578b41ac6d13 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:45.382588 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d48de-e8ef-4d05-8517-578b41ac6d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:45.399189 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1f9d48de-e8ef-4d05-8517-578b41ac6d13 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:45.400377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1f9d48de-e8ef-4d05-8517-578b41ac6d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:45.464346 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:45.470589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 578/1148] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:45.494898 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77791e-419b-4872-be75-005bb39dd858 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:45.596911 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77791e-419b-4872-be75-005bb39dd858 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:45.614056 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:45.630825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4e9fd-a504-4e90-acd5-ca67f16e06ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:45.631537 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4e9fd-a504-4e90-acd5-ca67f16e06ef None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:45.631866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4e9fd-a504-4e90-acd5-ca67f16e06ef None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:45.632168 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4e9fd-a504-4e90-acd5-ca67f16e06ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:45.642064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4e9fd-a504-4e90-acd5-ca67f16e06ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:12:45.649762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-78f4e9fd-a504-4e90-acd5-ca67f16e06ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:45.649762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:45.649762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:45.649762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:45.649762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:45.649762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:45.649762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:45.649762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:45.649762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:45.649762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:45.649762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:45.649762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:45.649762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:12:45.649762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:12:45.649762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:12:45.649762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:12:45.651035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:12:45.651035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:12:45.651035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:12:45.651035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:12:45.651035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:45.651035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:45.651035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:45.651035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:45.651035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:45.651035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:45.651035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:45.651035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:45.651035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:45.651035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:45.651035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:45.651035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:45.651961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:45.651961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:45.651961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:45.651961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:45.651961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:12:45.651961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:12:45.651961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:12:45.651961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:12:45.651961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:12:45.651961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:12:45.651961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:45.651961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:45.651961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 571/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:12:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:45.657240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d48de-e8ef-4d05-8517-578b41ac6d13 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:45.768202 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d48de-e8ef-4d05-8517-578b41ac6d13 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:45.802132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb132eb-ef4f-4719-9279-7912158e321a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:45.802821 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb132eb-ef4f-4719-9279-7912158e321a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:45.803109 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb132eb-ef4f-4719-9279-7912158e321a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:45.803386 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb132eb-ef4f-4719-9279-7912158e321a None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:45.804127 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb132eb-ef4f-4719-9279-7912158e321a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:45.804436 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb132eb-ef4f-4719-9279-7912158e321a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:45.805913 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb132eb-ef4f-4719-9279-7912158e321a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:45.813864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 579/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:12:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:45.819790 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4e9fd-a504-4e90-acd5-ca67f16e06ef None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:45.917091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4e9fd-a504-4e90-acd5-ca67f16e06ef None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:45.963630 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d3574-b22c-4434-aded-d54eddd0c214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:45.964508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d3574-b22c-4434-aded-d54eddd0c214 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:45.964798 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d3574-b22c-4434-aded-d54eddd0c214 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:45.965078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d3574-b22c-4434-aded-d54eddd0c214 None admin] PATH_INFO: `/v3/users/ac43ea6a3d6b4e93996782307cbb3d0b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:45.966347 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d3574-b22c-4434-aded-d54eddd0c214 None admin] RBAC: Authorizing `identity:get_user(user_id=ac43ea6a3d6b4e93996782307cbb3d0b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:45.967787 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d3574-b22c-4434-aded-d54eddd0c214 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:45.969986 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 572/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:12:45 2022] GET /identity/v3/users/ac43ea6a3d6b4e93996782307cbb3d0b => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:45.975954 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb132eb-ef4f-4719-9279-7912158e321a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:46.038632 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:46.084619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb132eb-ef4f-4719-9279-7912158e321a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:46.118432 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6594754-236d-4b45-9686-69a46aade333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:46.119292 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6594754-236d-4b45-9686-69a46aade333 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:46.119571 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6594754-236d-4b45-9686-69a46aade333 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:46.119842 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6594754-236d-4b45-9686-69a46aade333 None admin] PATH_INFO: `/v3/projects/0c67b144b15344c59f2847ebb193675b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:46.121042 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6594754-236d-4b45-9686-69a46aade333 None admin] RBAC: Authorizing `identity:get_project(project_id=0c67b144b15344c59f2847ebb193675b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:46.122486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6594754-236d-4b45-9686-69a46aade333 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:46.124424 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 580/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:12:45 2022] GET /identity/v3/projects/0c67b144b15344c59f2847ebb193675b => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:46.130208 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d3574-b22c-4434-aded-d54eddd0c214 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:46.184792 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:46.243677 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d3574-b22c-4434-aded-d54eddd0c214 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:46.279914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a3e41-0453-44e7-b98d-316a11e72b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:46.281658 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a3e41-0453-44e7-b98d-316a11e72b7c None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:46.282664 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a3e41-0453-44e7-b98d-316a11e72b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:46.283111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a3e41-0453-44e7-b98d-316a11e72b7c None admin] PATH_INFO: `/v3/projects/0c67b144b15344c59f2847ebb193675b/users/ac43ea6a3d6b4e93996782307cbb3d0b/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:46.285872 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a3e41-0453-44e7-b98d-316a11e72b7c None admin] RBAC: Authorizing `identity:create_grant(project_id=0c67b144b15344c59f2847ebb193675b, user_id=ac43ea6a3d6b4e93996782307cbb3d0b, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:46.287913 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a3e41-0453-44e7-b98d-316a11e72b7c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:46.303361 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 573/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:12:46 2022] PUT /identity/v3/projects/0c67b144b15344c59f2847ebb193675b/users/ac43ea6a3d6b4e93996782307cbb3d0b/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:12:48.411286 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa4095-dbea-4cef-90f9-513652c3078a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:48.411843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa4095-dbea-4cef-90f9-513652c3078a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:48.411843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa4095-dbea-4cef-90f9-513652c3078a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:48.413222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 581/1154] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:48.418909 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca387168-59e2-4a8b-b71f-c0e6cf45538b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:48.419371 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca387168-59e2-4a8b-b71f-c0e6cf45538b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:48.419485 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca387168-59e2-4a8b-b71f-c0e6cf45538b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:48.436716 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ca387168-59e2-4a8b-b71f-c0e6cf45538b None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:48.438546 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ca387168-59e2-4a8b-b71f-c0e6cf45538b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:48.509829 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 574/1155] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:48.534024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa4095-dbea-4cef-90f9-513652c3078a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:48.641221 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa4095-dbea-4cef-90f9-513652c3078a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:48.669339 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:48.678515 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd3b5c-cf0d-4b92-bd2b-71b19a0d0a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:48.679347 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd3b5c-cf0d-4b92-bd2b-71b19a0d0a37 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:48.679623 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd3b5c-cf0d-4b92-bd2b-71b19a0d0a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:48.679901 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd3b5c-cf0d-4b92-bd2b-71b19a0d0a37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:48.690853 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd3b5c-cf0d-4b92-bd2b-71b19a0d0a37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:12:48.698680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a7bd3b5c-cf0d-4b92-bd2b-71b19a0d0a37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:48.698680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:48.698680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:48.698680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:48.698680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:48.698680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:48.698680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:48.698680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:48.698680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:48.698680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:48.698680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:48.698680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:48.698680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:12:48.698680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:12:48.698680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:12:48.698680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:12:48.699849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:12:48.699849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:12:48.699849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:12:48.699849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:12:48.699849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:48.699849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:48.699849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:48.699849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:48.699849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:48.699849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:48.699849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:48.699849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:48.699849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:48.699849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:48.699849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:48.699849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:48.701023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:48.701023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:48.701023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:48.701023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:48.701023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:12:48.701023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:12:48.701023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:12:48.701023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:12:48.701023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:12:48.701023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:12:48.701023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:12:48.701023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:12:48.701023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 582/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:12:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:12:48.705993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca387168-59e2-4a8b-b71f-c0e6cf45538b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:48.743127 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:48.809445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca387168-59e2-4a8b-b71f-c0e6cf45538b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:48.841917 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba15e6b-9799-46f5-9f96-137133a6ed09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:48.842620 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba15e6b-9799-46f5-9f96-137133a6ed09 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:48.842907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba15e6b-9799-46f5-9f96-137133a6ed09 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:48.843185 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba15e6b-9799-46f5-9f96-137133a6ed09 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:48.844450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba15e6b-9799-46f5-9f96-137133a6ed09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:48.844808 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba15e6b-9799-46f5-9f96-137133a6ed09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:48.846228 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba15e6b-9799-46f5-9f96-137133a6ed09 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:48.854142 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 575/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:12:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:48.860745 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd3b5c-cf0d-4b92-bd2b-71b19a0d0a37 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:48.958403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd3b5c-cf0d-4b92-bd2b-71b19a0d0a37 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:48.992160 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ccff7-a4c7-4961-916c-ff345187766e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:48.993019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ccff7-a4c7-4961-916c-ff345187766e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:48.993302 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ccff7-a4c7-4961-916c-ff345187766e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:48.993581 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ccff7-a4c7-4961-916c-ff345187766e None admin] PATH_INFO: `/v3/users/ac43ea6a3d6b4e93996782307cbb3d0b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:48.994796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ccff7-a4c7-4961-916c-ff345187766e None admin] RBAC: Authorizing `identity:get_user(user_id=ac43ea6a3d6b4e93996782307cbb3d0b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:48.996229 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ccff7-a4c7-4961-916c-ff345187766e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:48.997872 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 583/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:12:48 2022] GET /identity/v3/users/ac43ea6a3d6b4e93996782307cbb3d0b => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:49.003704 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba15e6b-9799-46f5-9f96-137133a6ed09 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:49.097255 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:49.101455 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba15e6b-9799-46f5-9f96-137133a6ed09 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:49.134613 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca3509-eede-487a-8335-68f1b31bb790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:49.135261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca3509-eede-487a-8335-68f1b31bb790 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:49.135546 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca3509-eede-487a-8335-68f1b31bb790 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:49.135824 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca3509-eede-487a-8335-68f1b31bb790 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:49.200414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca3509-eede-487a-8335-68f1b31bb790 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:49.201859 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca3509-eede-487a-8335-68f1b31bb790 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:49.292097 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:49.296970 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 576/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:12:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:12:49.302887 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ccff7-a4c7-4961-916c-ff345187766e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:49.357590 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:49.399137 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ccff7-a4c7-4961-916c-ff345187766e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:49.431426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b1b9e-c9f9-43d1-a18a-bf999d9be276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:49.432297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b1b9e-c9f9-43d1-a18a-bf999d9be276 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:49.432582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b1b9e-c9f9-43d1-a18a-bf999d9be276 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:49.432858 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b1b9e-c9f9-43d1-a18a-bf999d9be276 None admin] PATH_INFO: `/v3/projects/0c67b144b15344c59f2847ebb193675b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:49.434036 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b1b9e-c9f9-43d1-a18a-bf999d9be276 None admin] RBAC: Authorizing `identity:get_project(project_id=0c67b144b15344c59f2847ebb193675b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:49.435494 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b1b9e-c9f9-43d1-a18a-bf999d9be276 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:49.437193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 584/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:12:49 2022] GET /identity/v3/projects/0c67b144b15344c59f2847ebb193675b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:49.443802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca3509-eede-487a-8335-68f1b31bb790 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:49.548643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca3509-eede-487a-8335-68f1b31bb790 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:49.583011 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba7157-c8d8-4baa-8398-320a5f7e4022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:49.583669 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba7157-c8d8-4baa-8398-320a5f7e4022 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:49.583955 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba7157-c8d8-4baa-8398-320a5f7e4022 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:49.584231 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba7157-c8d8-4baa-8398-320a5f7e4022 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:49.585239 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba7157-c8d8-4baa-8398-320a5f7e4022 None admin] RBAC: Adding query filter params (role.id=6322f657162c45ca85f019a408655ff3, scope.project.id=0c67b144b15344c59f2847ebb193675b, user.id=ac43ea6a3d6b4e93996782307cbb3d0b) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:49.585375 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba7157-c8d8-4baa-8398-320a5f7e4022 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:49.586855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba7157-c8d8-4baa-8398-320a5f7e4022 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:49.592650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 577/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:12:49 2022] GET /identity/v3/role_assignments?user.id=ac43ea6a3d6b4e93996782307cbb3d0b&scope.project.id=0c67b144b15344c59f2847ebb193675b&role.id=6322f657162c45ca85f019a408655ff3 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:51.646124 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926b365-2f0d-4ea2-a6f0-72f4b81b001a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:51.646754 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926b365-2f0d-4ea2-a6f0-72f4b81b001a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:51.646754 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926b365-2f0d-4ea2-a6f0-72f4b81b001a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:51.648106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 585/1162] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:51.653615 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a3c08-d7ea-4aa1-9042-44cd88623ac4 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:51.654060 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a3c08-d7ea-4aa1-9042-44cd88623ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:51.654160 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a3c08-d7ea-4aa1-9042-44cd88623ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:51.671605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b28a3c08-d7ea-4aa1-9042-44cd88623ac4 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:51.672808 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b28a3c08-d7ea-4aa1-9042-44cd88623ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:51.728327 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:51.739144 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 578/1163] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:51.761857 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926b365-2f0d-4ea2-a6f0-72f4b81b001a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:51.862449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926b365-2f0d-4ea2-a6f0-72f4b81b001a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:51.887179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:51.898554 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7e3d5-9c05-4a26-b235-482225f55769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:51.899202 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7e3d5-9c05-4a26-b235-482225f55769 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:51.899486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7e3d5-9c05-4a26-b235-482225f55769 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:51.899760 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7e3d5-9c05-4a26-b235-482225f55769 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:51.964625 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7e3d5-9c05-4a26-b235-482225f55769 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:51.966061 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7e3d5-9c05-4a26-b235-482225f55769 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:52.061892 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 586/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:12:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:12:52.068379 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a3c08-d7ea-4aa1-9042-44cd88623ac4 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:52.164404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a3c08-d7ea-4aa1-9042-44cd88623ac4 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:52.197825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49062c1-b428-4b5f-aff0-1123b5d068b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:52.198643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49062c1-b428-4b5f-aff0-1123b5d068b6 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:52.198926 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49062c1-b428-4b5f-aff0-1123b5d068b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:52.199203 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49062c1-b428-4b5f-aff0-1123b5d068b6 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:52.205732 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49062c1-b428-4b5f-aff0-1123b5d068b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:52.207192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49062c1-b428-4b5f-aff0-1123b5d068b6 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:52.221162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-d49062c1-b428-4b5f-aff0-1123b5d068b6 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 19:12:52.221162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:52.221162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 20 19:12:52.221162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 20 19:12:52.221162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:12:52.221162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:12:52.221162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:12:52.221162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:12:52.221162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 20 19:12:52.221162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:52.221162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:12:52.221162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:52.221162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:12:52.221162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:12:52.221162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:12:52.221162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:12:52.221162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:12:52.222443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:12:52.222443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:12:52.222443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:12:52.222443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:12:52.222443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:12:52.222443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:12:52.222443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:12:52.222443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:12:52.222443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:12:52.222443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:12:52.222443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:12:52.222443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:12:52.222443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:12:52.222443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:12:52.222443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:12:52.222443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:12:52.223400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:12:52.223400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:12:52.223400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:12:52.223400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:12:52.223400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:12:52.223400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:12:52.223400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:12:52.223400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:12:52.223400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:12:52.223400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:12:52.223400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 20 19:12:52.223400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:12:52.223400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 19:12:52.223400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:12:52.223400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 579/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jul 20 19:12:52 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:12:52.228850 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7e3d5-9c05-4a26-b235-482225f55769 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:52.259537 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:52.338330 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7e3d5-9c05-4a26-b235-482225f55769 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:52.375568 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ac29f-59c1-487b-95e0-a6b19c7d7420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:52.376243 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ac29f-59c1-487b-95e0-a6b19c7d7420 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:52.376528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ac29f-59c1-487b-95e0-a6b19c7d7420 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:52.376810 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ac29f-59c1-487b-95e0-a6b19c7d7420 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:52.377542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ac29f-59c1-487b-95e0-a6b19c7d7420 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:12:52.377848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ac29f-59c1-487b-95e0-a6b19c7d7420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:52.379240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ac29f-59c1-487b-95e0-a6b19c7d7420 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:52.386811 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 587/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Jul 20 19:12:52 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:54.421309 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20ba60-8d80-4835-8c04-539dbc5dd8ca None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:54.421951 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20ba60-8d80-4835-8c04-539dbc5dd8ca None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:54.421951 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20ba60-8d80-4835-8c04-539dbc5dd8ca None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:54.423296 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 580/1167] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:54.429375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548fd5c-3f31-47d8-af8a-107d66c1ee9b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:54.429852 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548fd5c-3f31-47d8-af8a-107d66c1ee9b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:54.430145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548fd5c-3f31-47d8-af8a-107d66c1ee9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:54.454024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c548fd5c-3f31-47d8-af8a-107d66c1ee9b None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:54.455256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c548fd5c-3f31-47d8-af8a-107d66c1ee9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:54.526333 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 588/1168] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:54.550280 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20ba60-8d80-4835-8c04-539dbc5dd8ca None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:54.607341 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:54.658744 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20ba60-8d80-4835-8c04-539dbc5dd8ca None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:54.696599 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ece0b2-fc4c-4109-86da-5f9e18ee9cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:54.697208 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ece0b2-fc4c-4109-86da-5f9e18ee9cbc None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:54.697485 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ece0b2-fc4c-4109-86da-5f9e18ee9cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:54.697760 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ece0b2-fc4c-4109-86da-5f9e18ee9cbc None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:54.698550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ece0b2-fc4c-4109-86da-5f9e18ee9cbc None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:54.700044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ece0b2-fc4c-4109-86da-5f9e18ee9cbc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:54.717395 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 581/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Wed Jul 20 19:12:54 2022] POST /identity/v3/domains => generated 267 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:12:56.789234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8a7cf-da1f-4332-9eee-29d75c23761b None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:56.789757 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8a7cf-da1f-4332-9eee-29d75c23761b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:56.789877 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8a7cf-da1f-4332-9eee-29d75c23761b None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:56.791219 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 589/1170] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:56.796316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75091122-fcfc-4a9c-b221-fbda8ed8f2a0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:56.797292 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75091122-fcfc-4a9c-b221-fbda8ed8f2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:56.797388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75091122-fcfc-4a9c-b221-fbda8ed8f2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:56.814271 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-75091122-fcfc-4a9c-b221-fbda8ed8f2a0 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:56.815471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-75091122-fcfc-4a9c-b221-fbda8ed8f2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:56.879978 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 582/1171] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:56.903849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8a7cf-da1f-4332-9eee-29d75c23761b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:56.923388 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:57.004681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8a7cf-da1f-4332-9eee-29d75c23761b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:57.037627 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80402e4d-6f59-48a2-9a26-ac02c48d90d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:57.038507 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80402e4d-6f59-48a2-9a26-ac02c48d90d7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:57.038797 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80402e4d-6f59-48a2-9a26-ac02c48d90d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:57.039077 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80402e4d-6f59-48a2-9a26-ac02c48d90d7 None admin] PATH_INFO: `/v3/domains/90ac4a7acd8a43ebb9ca0fbe02aaae6a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:57.049670 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80402e4d-6f59-48a2-9a26-ac02c48d90d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=90ac4a7acd8a43ebb9ca0fbe02aaae6a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:57.051130 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80402e4d-6f59-48a2-9a26-ac02c48d90d7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:57.052766 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 590/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Wed Jul 20 19:12:56 2022] GET /identity/v3/domains/90ac4a7acd8a43ebb9ca0fbe02aaae6a => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:57.058807 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75091122-fcfc-4a9c-b221-fbda8ed8f2a0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:57.099643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:57.157533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75091122-fcfc-4a9c-b221-fbda8ed8f2a0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:57.191615 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e422a8-c2ff-4c61-bf91-30a18da99742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:57.192279 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e422a8-c2ff-4c61-bf91-30a18da99742 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:57.192564 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e422a8-c2ff-4c61-bf91-30a18da99742 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:57.192841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e422a8-c2ff-4c61-bf91-30a18da99742 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:57.193614 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e422a8-c2ff-4c61-bf91-30a18da99742 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:57.195087 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e422a8-c2ff-4c61-bf91-30a18da99742 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:57.224813 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 583/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 20 19:12:57 2022] POST /identity/v3/projects => generated 361 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:12:59.340194 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fb9f2-18e7-40d9-a4c6-675594779605 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:59.340775 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fb9f2-18e7-40d9-a4c6-675594779605 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:59.340775 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fb9f2-18e7-40d9-a4c6-675594779605 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:59.342138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 591/1174] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:12:59.348086 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c95511-4ec9-4c87-bc40-7199829de4c1 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:59.348672 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c95511-4ec9-4c87-bc40-7199829de4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:59.348672 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c95511-4ec9-4c87-bc40-7199829de4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:59.366197 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-70c95511-4ec9-4c87-bc40-7199829de4c1 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:12:59.367458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-70c95511-4ec9-4c87-bc40-7199829de4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:12:59.438106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 584/1175] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:12:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:12:59.462971 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fb9f2-18e7-40d9-a4c6-675594779605 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:59.540860 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:59.563910 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fb9f2-18e7-40d9-a4c6-675594779605 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:59.597305 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f294eb-d5c4-46f4-89f7-5f4a9996afa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:59.598104 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f294eb-d5c4-46f4-89f7-5f4a9996afa0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:59.598426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f294eb-d5c4-46f4-89f7-5f4a9996afa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:59.598705 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f294eb-d5c4-46f4-89f7-5f4a9996afa0 None admin] PATH_INFO: `/v3/domains/90ac4a7acd8a43ebb9ca0fbe02aaae6a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:59.599876 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f294eb-d5c4-46f4-89f7-5f4a9996afa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=90ac4a7acd8a43ebb9ca0fbe02aaae6a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:59.601300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f294eb-d5c4-46f4-89f7-5f4a9996afa0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:59.602954 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 592/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Wed Jul 20 19:12:59 2022] GET /identity/v3/domains/90ac4a7acd8a43ebb9ca0fbe02aaae6a => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:12:59.609221 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c95511-4ec9-4c87-bc40-7199829de4c1 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:12:59.633381 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:12:59.706486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c95511-4ec9-4c87-bc40-7199829de4c1 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:12:59.738619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afb358-3dad-44f3-a68d-c151c1cfc0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:12:59.739270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afb358-3dad-44f3-a68d-c151c1cfc0c6 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:12:59.739551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afb358-3dad-44f3-a68d-c151c1cfc0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:12:59.739825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afb358-3dad-44f3-a68d-c151c1cfc0c6 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:12:59.740532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afb358-3dad-44f3-a68d-c151c1cfc0c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:12:59.741954 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afb358-3dad-44f3-a68d-c151c1cfc0c6 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:12:59.761656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 585/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 20 19:12:59 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:13:01.856758 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7aa6b-5728-4dcd-9597-1006e0763f10 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:01.857293 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7aa6b-5728-4dcd-9597-1006e0763f10 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:01.857293 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7aa6b-5728-4dcd-9597-1006e0763f10 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:01.858659 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 593/1178] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:13:01.863921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e5008-2e28-4fbf-b94f-f012b3fe930f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:01.864345 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e5008-2e28-4fbf-b94f-f012b3fe930f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:01.864484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e5008-2e28-4fbf-b94f-f012b3fe930f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:01.880915 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-225e5008-2e28-4fbf-b94f-f012b3fe930f None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:13:01.882109 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-225e5008-2e28-4fbf-b94f-f012b3fe930f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:13:01.947689 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 586/1179] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:13:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:13:01.971718 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7aa6b-5728-4dcd-9597-1006e0763f10 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:02.069237 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7aa6b-5728-4dcd-9597-1006e0763f10 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:02.102627 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aed2d0-9d05-424d-88bc-f8396bb47695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:02.103396 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aed2d0-9d05-424d-88bc-f8396bb47695 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:02.103675 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aed2d0-9d05-424d-88bc-f8396bb47695 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:02.103946 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aed2d0-9d05-424d-88bc-f8396bb47695 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:02.113670 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aed2d0-9d05-424d-88bc-f8396bb47695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:13:02.121166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-89aed2d0-9d05-424d-88bc-f8396bb47695 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:13:02.121166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:13:02.121166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:13:02.121166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:13:02.121166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:13:02.121166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:13:02.121166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:13:02.121166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:13:02.121166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:13:02.121166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:13:02.121166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:13:02.121166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:13:02.121166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:13:02.121166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:13:02.121166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:13:02.121166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:13:02.122384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:13:02.122384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:13:02.122384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:13:02.122384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:13:02.122384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:13:02.122384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:13:02.122384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:13:02.122384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:13:02.122384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:13:02.122384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:13:02.122384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:13:02.122384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:13:02.122384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:13:02.122384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:13:02.122384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:13:02.122384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:13:02.123409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:13:02.123409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:13:02.123409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:13:02.123409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:13:02.123409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:13:02.123409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:13:02.123409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:13:02.123409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:13:02.123409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:13:02.123409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:13:02.123409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:13:02.123409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:13:02.123409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 594/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:13:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:13:02.128682 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e5008-2e28-4fbf-b94f-f012b3fe930f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:02.140757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:02.230720 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e5008-2e28-4fbf-b94f-f012b3fe930f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:02.266842 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab77a1-f594-442b-af42-a38781fee84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:02.267601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab77a1-f594-442b-af42-a38781fee84e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:02.267832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab77a1-f594-442b-af42-a38781fee84e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:02.268113 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab77a1-f594-442b-af42-a38781fee84e None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:02.268862 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab77a1-f594-442b-af42-a38781fee84e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:13:02.269170 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab77a1-f594-442b-af42-a38781fee84e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:02.270560 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab77a1-f594-442b-af42-a38781fee84e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:02.278483 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 587/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:13:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:02.285355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aed2d0-9d05-424d-88bc-f8396bb47695 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:02.295609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:02.409283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aed2d0-9d05-424d-88bc-f8396bb47695 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:02.441492 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23936dc-6d21-41b5-83ba-dcce33d7bdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:02.442382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23936dc-6d21-41b5-83ba-dcce33d7bdd4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:02.442667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23936dc-6d21-41b5-83ba-dcce33d7bdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:02.442939 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23936dc-6d21-41b5-83ba-dcce33d7bdd4 None admin] PATH_INFO: `/v3/users/cf2ca64ffc8f4e488a3feed471658ee7` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:02.456727 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23936dc-6d21-41b5-83ba-dcce33d7bdd4 None admin] RBAC: Authorizing `identity:get_user(user_id=cf2ca64ffc8f4e488a3feed471658ee7)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:02.458180 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23936dc-6d21-41b5-83ba-dcce33d7bdd4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:02.459878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 595/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:13:02 2022] GET /identity/v3/users/cf2ca64ffc8f4e488a3feed471658ee7 => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:02.465718 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab77a1-f594-442b-af42-a38781fee84e None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:02.533928 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:02.563479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab77a1-f594-442b-af42-a38781fee84e None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:02.596318 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8acca-bc64-4e14-82d2-8640eaa45d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:02.596971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8acca-bc64-4e14-82d2-8640eaa45d51 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:02.597256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8acca-bc64-4e14-82d2-8640eaa45d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:02.597533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8acca-bc64-4e14-82d2-8640eaa45d51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:02.672805 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8acca-bc64-4e14-82d2-8640eaa45d51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:02.674177 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8acca-bc64-4e14-82d2-8640eaa45d51 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:02.740446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:02.769822 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 588/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:13:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:13:02.775769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23936dc-6d21-41b5-83ba-dcce33d7bdd4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:02.835890 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:02.872855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23936dc-6d21-41b5-83ba-dcce33d7bdd4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:02.906033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92364e-6a2f-456a-9116-322db1dfcdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:02.906908 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92364e-6a2f-456a-9116-322db1dfcdd3 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:02.907195 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92364e-6a2f-456a-9116-322db1dfcdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:02.907473 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92364e-6a2f-456a-9116-322db1dfcdd3 None admin] PATH_INFO: `/v3/projects/6bd10676eeb64c8ea026c2b6a24dd798` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:02.908647 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b92364e-6a2f-456a-9116-322db1dfcdd3 None admin] RBAC: Authorizing `identity:get_project(project_id=6bd10676eeb64c8ea026c2b6a24dd798)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:02.910060 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b92364e-6a2f-456a-9116-322db1dfcdd3 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:02.911791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 596/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:13:02 2022] GET /identity/v3/projects/6bd10676eeb64c8ea026c2b6a24dd798 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:02.917891 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8acca-bc64-4e14-82d2-8640eaa45d51 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:03.016110 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8acca-bc64-4e14-82d2-8640eaa45d51 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:03.049746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5552f7-e795-4f41-abb5-5eda79ca50bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:03.050416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5552f7-e795-4f41-abb5-5eda79ca50bc None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:03.050701 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5552f7-e795-4f41-abb5-5eda79ca50bc None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:03.050977 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5552f7-e795-4f41-abb5-5eda79ca50bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:03.051821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5552f7-e795-4f41-abb5-5eda79ca50bc None admin] RBAC: Adding query filter params (role.id=6322f657162c45ca85f019a408655ff3, scope.project.id=6bd10676eeb64c8ea026c2b6a24dd798, user.id=cf2ca64ffc8f4e488a3feed471658ee7) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:13:03.052134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5552f7-e795-4f41-abb5-5eda79ca50bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:03.053556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5552f7-e795-4f41-abb5-5eda79ca50bc None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:03.058853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 589/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:13:02 2022] GET /identity/v3/role_assignments?user.id=cf2ca64ffc8f4e488a3feed471658ee7&scope.project.id=6bd10676eeb64c8ea026c2b6a24dd798&role.id=6322f657162c45ca85f019a408655ff3 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:05.043578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45a84e-b4ef-4c94-933c-a6c904434c67 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:05.044155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45a84e-b4ef-4c94-933c-a6c904434c67 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:05.044155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45a84e-b4ef-4c94-933c-a6c904434c67 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:05.045478 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 597/1186] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:13:05.050676 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ac43b-09a2-4052-aec4-a9655c7b7c5b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:05.051064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ac43b-09a2-4052-aec4-a9655c7b7c5b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:05.051230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ac43b-09a2-4052-aec4-a9655c7b7c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:05.067598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3f5ac43b-09a2-4052-aec4-a9655c7b7c5b None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:13:05.068783 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3f5ac43b-09a2-4052-aec4-a9655c7b7c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:13:05.097531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:05.134405 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 590/1187] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:13:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:13:05.157561 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45a84e-b4ef-4c94-933c-a6c904434c67 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:05.254323 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45a84e-b4ef-4c94-933c-a6c904434c67 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:05.282742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:05.288160 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489b39b-f601-4abe-a6b4-075905d7706e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:05.289007 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489b39b-f601-4abe-a6b4-075905d7706e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:05.289442 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489b39b-f601-4abe-a6b4-075905d7706e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:05.289727 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489b39b-f601-4abe-a6b4-075905d7706e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:05.299810 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489b39b-f601-4abe-a6b4-075905d7706e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:13:05.307377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-e489b39b-f601-4abe-a6b4-075905d7706e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:13:05.307377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:13:05.307377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:13:05.307377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:13:05.307377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:13:05.307377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:13:05.307377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:13:05.307377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:13:05.307377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:13:05.307377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:13:05.307377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:13:05.307377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:13:05.307377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:13:05.307377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:13:05.307377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:13:05.307377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:13:05.308521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:13:05.308521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:13:05.308521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:13:05.308521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:13:05.308521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:13:05.308521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:13:05.308521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:13:05.308521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:13:05.308521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:13:05.308521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:13:05.308521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:13:05.308521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:13:05.308521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:13:05.308521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:13:05.308521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:13:05.308521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:13:05.309549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:13:05.309549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:13:05.309549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:13:05.309549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:13:05.309549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:13:05.309549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:13:05.309549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:13:05.309549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:13:05.309549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:13:05.309549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:13:05.309549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:13:05.309549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:13:05.309549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 598/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:13:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:13:05.316496 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ac43b-09a2-4052-aec4-a9655c7b7c5b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:05.424805 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ac43b-09a2-4052-aec4-a9655c7b7c5b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:05.458403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d613137-467a-4ee8-beea-97cd3d67db70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:05.459121 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d613137-467a-4ee8-beea-97cd3d67db70 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:05.459404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d613137-467a-4ee8-beea-97cd3d67db70 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:05.459679 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d613137-467a-4ee8-beea-97cd3d67db70 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:05.460413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d613137-467a-4ee8-beea-97cd3d67db70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:13:05.460716 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d613137-467a-4ee8-beea-97cd3d67db70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:05.462105 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d613137-467a-4ee8-beea-97cd3d67db70 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:05.469843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 591/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:13:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:05.475856 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489b39b-f601-4abe-a6b4-075905d7706e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:05.573522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489b39b-f601-4abe-a6b4-075905d7706e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:05.606427 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed661901-01b5-47c6-b398-27145de1091e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:05.607290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed661901-01b5-47c6-b398-27145de1091e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:05.607577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed661901-01b5-47c6-b398-27145de1091e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:05.607852 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed661901-01b5-47c6-b398-27145de1091e None admin] PATH_INFO: `/v3/users/cf2ca64ffc8f4e488a3feed471658ee7` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:05.609564 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed661901-01b5-47c6-b398-27145de1091e None admin] RBAC: Authorizing `identity:get_user(user_id=cf2ca64ffc8f4e488a3feed471658ee7)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:05.611013 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed661901-01b5-47c6-b398-27145de1091e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:05.612651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 599/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:13:05 2022] GET /identity/v3/users/cf2ca64ffc8f4e488a3feed471658ee7 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:05.618393 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d613137-467a-4ee8-beea-97cd3d67db70 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:05.646887 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:05.723737 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d613137-467a-4ee8-beea-97cd3d67db70 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:05.756902 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e2383-684e-4d93-83dd-6267f62da8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:05.757740 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e2383-684e-4d93-83dd-6267f62da8af None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:05.758020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e2383-684e-4d93-83dd-6267f62da8af None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:05.758294 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e2383-684e-4d93-83dd-6267f62da8af None admin] PATH_INFO: `/v3/projects/6bd10676eeb64c8ea026c2b6a24dd798` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:05.759481 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e2383-684e-4d93-83dd-6267f62da8af None admin] RBAC: Authorizing `identity:get_project(project_id=6bd10676eeb64c8ea026c2b6a24dd798)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:05.760916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e2383-684e-4d93-83dd-6267f62da8af None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:05.762644 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 592/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:13:05 2022] GET /identity/v3/projects/6bd10676eeb64c8ea026c2b6a24dd798 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:05.768741 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed661901-01b5-47c6-b398-27145de1091e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:05.826253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:05.872601 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed661901-01b5-47c6-b398-27145de1091e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:05.906040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ed32b-2cdc-4478-a9e3-1f317920f448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:05.906949 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ed32b-2cdc-4478-a9e3-1f317920f448 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:05.907241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ed32b-2cdc-4478-a9e3-1f317920f448 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:05.907521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ed32b-2cdc-4478-a9e3-1f317920f448 None admin] PATH_INFO: `/v3/projects/6bd10676eeb64c8ea026c2b6a24dd798/users/cf2ca64ffc8f4e488a3feed471658ee7/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:05.909468 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ed32b-2cdc-4478-a9e3-1f317920f448 None admin] RBAC: Authorizing `identity:create_grant(project_id=6bd10676eeb64c8ea026c2b6a24dd798, user_id=cf2ca64ffc8f4e488a3feed471658ee7, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:05.910918 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ed32b-2cdc-4478-a9e3-1f317920f448 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:05.923883 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 600/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:13:05 2022] PUT /identity/v3/projects/6bd10676eeb64c8ea026c2b6a24dd798/users/cf2ca64ffc8f4e488a3feed471658ee7/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:13:07.927998 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a14d2b-91c4-4362-935d-1a5d2b2e9133 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:07.928523 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a14d2b-91c4-4362-935d-1a5d2b2e9133 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:07.928523 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a14d2b-91c4-4362-935d-1a5d2b2e9133 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:07.929847 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 593/1193] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:13:07.935217 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abad98-2af1-4ec1-b6f3-5fb1230f3b6d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:07.935620 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abad98-2af1-4ec1-b6f3-5fb1230f3b6d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:07.935773 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abad98-2af1-4ec1-b6f3-5fb1230f3b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:07.952645 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e0abad98-2af1-4ec1-b6f3-5fb1230f3b6d None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:13:07.953813 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e0abad98-2af1-4ec1-b6f3-5fb1230f3b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:13:08.017543 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 601/1194] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:13:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:13:08.041831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a14d2b-91c4-4362-935d-1a5d2b2e9133 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:08.145237 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:08.152578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a14d2b-91c4-4362-935d-1a5d2b2e9133 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:08.190337 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327bd6e-af5c-4294-b676-dfe35097c828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:08.191056 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327bd6e-af5c-4294-b676-dfe35097c828 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:08.191341 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327bd6e-af5c-4294-b676-dfe35097c828 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:08.191616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327bd6e-af5c-4294-b676-dfe35097c828 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:08.201669 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327bd6e-af5c-4294-b676-dfe35097c828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:13:08.209948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-3327bd6e-af5c-4294-b676-dfe35097c828 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:13:08.209948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:13:08.209948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:13:08.209948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:13:08.209948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:13:08.209948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:13:08.209948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:13:08.209948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:13:08.209948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:13:08.209948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:13:08.209948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:13:08.209948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:13:08.209948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:13:08.209948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:13:08.209948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:13:08.209948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:13:08.211101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:13:08.211101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:13:08.211101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:13:08.211101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:13:08.211101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:13:08.211101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:13:08.211101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:13:08.211101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:13:08.211101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:13:08.211101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:13:08.211101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:13:08.211101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:13:08.211101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:13:08.211101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:13:08.211101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:13:08.211101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:13:08.212210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:13:08.212210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:13:08.212210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:13:08.212210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:13:08.212210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:13:08.212210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:13:08.212210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:13:08.212210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:13:08.212210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:13:08.212210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:13:08.212210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:13:08.212210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:13:08.212210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 594/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:13:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:13:08.217389 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abad98-2af1-4ec1-b6f3-5fb1230f3b6d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:08.267058 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:08.316631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abad98-2af1-4ec1-b6f3-5fb1230f3b6d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:08.356090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfb852-396e-4fb4-834f-045a74c23156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:08.356754 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfb852-396e-4fb4-834f-045a74c23156 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:08.357038 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfb852-396e-4fb4-834f-045a74c23156 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:08.357317 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfb852-396e-4fb4-834f-045a74c23156 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:08.358060 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bfb852-396e-4fb4-834f-045a74c23156 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:13:08.358418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bfb852-396e-4fb4-834f-045a74c23156 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:08.359774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bfb852-396e-4fb4-834f-045a74c23156 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:08.368419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 602/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:13:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:08.374792 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327bd6e-af5c-4294-b676-dfe35097c828 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:08.471667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327bd6e-af5c-4294-b676-dfe35097c828 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:08.504383 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35abb74-ff43-4d96-b343-32be5682df01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:08.505247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35abb74-ff43-4d96-b343-32be5682df01 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:08.505533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35abb74-ff43-4d96-b343-32be5682df01 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:08.505813 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35abb74-ff43-4d96-b343-32be5682df01 None admin] PATH_INFO: `/v3/users/cf2ca64ffc8f4e488a3feed471658ee7` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:08.506981 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35abb74-ff43-4d96-b343-32be5682df01 None admin] RBAC: Authorizing `identity:get_user(user_id=cf2ca64ffc8f4e488a3feed471658ee7)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:08.508410 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35abb74-ff43-4d96-b343-32be5682df01 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:08.510053 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 595/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Jul 20 19:13:08 2022] GET /identity/v3/users/cf2ca64ffc8f4e488a3feed471658ee7 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:08.516451 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfb852-396e-4fb4-834f-045a74c23156 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:08.613149 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfb852-396e-4fb4-834f-045a74c23156 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:08.626033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:08.646764 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31d5c6-385e-4867-968f-47506f77ee0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:08.647405 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31d5c6-385e-4867-968f-47506f77ee0b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:08.647693 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31d5c6-385e-4867-968f-47506f77ee0b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:08.647966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31d5c6-385e-4867-968f-47506f77ee0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:08.712333 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31d5c6-385e-4867-968f-47506f77ee0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:08.713786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31d5c6-385e-4867-968f-47506f77ee0b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:08.807929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 603/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:13:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:13:08.814383 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35abb74-ff43-4d96-b343-32be5682df01 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:08.839796 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:08.912434 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35abb74-ff43-4d96-b343-32be5682df01 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:08.945483 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6388a-b0c3-4153-b1c4-2c029f1d5e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:08.946435 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6388a-b0c3-4153-b1c4-2c029f1d5e97 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:08.946725 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6388a-b0c3-4153-b1c4-2c029f1d5e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:08.947004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6388a-b0c3-4153-b1c4-2c029f1d5e97 None admin] PATH_INFO: `/v3/projects/6bd10676eeb64c8ea026c2b6a24dd798` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:08.948180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6388a-b0c3-4153-b1c4-2c029f1d5e97 None admin] RBAC: Authorizing `identity:get_project(project_id=6bd10676eeb64c8ea026c2b6a24dd798)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:08.949605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6388a-b0c3-4153-b1c4-2c029f1d5e97 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:08.951447 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 596/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Jul 20 19:13:08 2022] GET /identity/v3/projects/6bd10676eeb64c8ea026c2b6a24dd798 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:08.957619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31d5c6-385e-4867-968f-47506f77ee0b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:13:08.971837 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:09.055500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31d5c6-385e-4867-968f-47506f77ee0b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:13:09.088211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa833fca-e156-4e90-ac81-6ee787e97190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:13:09.088795 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa833fca-e156-4e90-ac81-6ee787e97190 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:13:09.089081 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa833fca-e156-4e90-ac81-6ee787e97190 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:13:09.089357 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa833fca-e156-4e90-ac81-6ee787e97190 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:13:09.090184 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa833fca-e156-4e90-ac81-6ee787e97190 None admin] RBAC: Adding query filter params (role.id=6322f657162c45ca85f019a408655ff3, scope.project.id=6bd10676eeb64c8ea026c2b6a24dd798, user.id=cf2ca64ffc8f4e488a3feed471658ee7) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:13:09.090527 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa833fca-e156-4e90-ac81-6ee787e97190 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:13:09.091949 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa833fca-e156-4e90-ac81-6ee787e97190 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:13:09.098121 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 604/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:13:08 2022] GET /identity/v3/role_assignments?user.id=cf2ca64ffc8f4e488a3feed471658ee7&scope.project.id=6bd10676eeb64c8ea026c2b6a24dd798&role.id=6322f657162c45ca85f019a408655ff3 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:13:18.941515 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=54 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:13:19.095922 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=62 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:05.251587 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86469a6a-a5ee-4f08-9f7c-5bd18ca2c860 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:05.254348 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86469a6a-a5ee-4f08-9f7c-5bd18ca2c860 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:05.254348 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86469a6a-a5ee-4f08-9f7c-5bd18ca2c860 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:05.255594 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 597/1201] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:14:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:05.261851 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d36fba-983c-4213-ada2-457dd64fd588 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:05.262403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d36fba-983c-4213-ada2-457dd64fd588 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:05.262560 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d36fba-983c-4213-ada2-457dd64fd588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:05.286549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a1d36fba-983c-4213-ada2-457dd64fd588 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:05.287749 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a1d36fba-983c-4213-ada2-457dd64fd588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:05.383239 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 605/1202] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:14:05.408624 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86469a6a-a5ee-4f08-9f7c-5bd18ca2c860 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:05.573432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86469a6a-a5ee-4f08-9f7c-5bd18ca2c860 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:05.618324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b661395-4f70-4350-9f50-9b9632c687f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:05.619453 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b661395-4f70-4350-9f50-9b9632c687f3 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:05.619786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b661395-4f70-4350-9f50-9b9632c687f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:05.620105 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b661395-4f70-4350-9f50-9b9632c687f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:05.634663 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b661395-4f70-4350-9f50-9b9632c687f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:05.636637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b661395-4f70-4350-9f50-9b9632c687f3 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:05.662921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-2b661395-4f70-4350-9f50-9b9632c687f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:05.662921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:05.662921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:05.662921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:05.662921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:05.662921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:05.662921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:05.662921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:05.662921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:05.662921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:05.662921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:05.662921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:05.662921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:05.662921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:05.662921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:05.664178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:05.664178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:05.664178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:05.664178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:05.664178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:05.664178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:05.664178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:05.664178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:05.664178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:05.664178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:05.664178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:05.664178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:05.664178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:05.664178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:05.664178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:05.664178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:05.664178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:05.671129 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:05.671129 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:05.671129 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:05.671129 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:14:05.671129 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 598/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:05.671596 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d36fba-983c-4213-ada2-457dd64fd588 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:05.810798 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d36fba-983c-4213-ada2-457dd64fd588 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:05.854472 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:05.863228 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ad72e-fa6e-46bc-9f6a-6809280af612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:05.863938 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ad72e-fa6e-46bc-9f6a-6809280af612 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:05.864219 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ad72e-fa6e-46bc-9f6a-6809280af612 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:05.864495 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ad72e-fa6e-46bc-9f6a-6809280af612 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:05.865235 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ad72e-fa6e-46bc-9f6a-6809280af612 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:05.865542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ad72e-fa6e-46bc-9f6a-6809280af612 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:05.866956 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ad72e-fa6e-46bc-9f6a-6809280af612 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:05.881584 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 606/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:05.888283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b661395-4f70-4350-9f50-9b9632c687f3 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:05.970452 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:06.048821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b661395-4f70-4350-9f50-9b9632c687f3 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:06.096829 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7649d-aae6-4a15-bb0a-2755d138a88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:06.097574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7649d-aae6-4a15-bb0a-2755d138a88e None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:06.097886 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7649d-aae6-4a15-bb0a-2755d138a88e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:06.098168 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7649d-aae6-4a15-bb0a-2755d138a88e None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:06.098964 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7649d-aae6-4a15-bb0a-2755d138a88e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:06.100431 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7649d-aae6-4a15-bb0a-2755d138a88e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:06.126871 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 599/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Jul 20 19:14:05 2022] POST /identity/v3/users => generated 251 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:14:08.519820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7403c-4556-4eed-aaa7-1fc3d4d54518 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:08.520400 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7403c-4556-4eed-aaa7-1fc3d4d54518 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:08.520400 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7403c-4556-4eed-aaa7-1fc3d4d54518 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:08.522355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 607/1206] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:08.528253 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381906e-1ae2-4efb-8374-73242ca763fa None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:08.528725 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381906e-1ae2-4efb-8374-73242ca763fa None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:08.528872 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381906e-1ae2-4efb-8374-73242ca763fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:08.552064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d381906e-1ae2-4efb-8374-73242ca763fa None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:08.552064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d381906e-1ae2-4efb-8374-73242ca763fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:08.630188 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 600/1207] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:14:08.656126 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7403c-4556-4eed-aaa7-1fc3d4d54518 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:08.787504 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7403c-4556-4eed-aaa7-1fc3d4d54518 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:08.826221 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ef50d-80ae-49d3-869b-485347c1368c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:08.827501 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ef50d-80ae-49d3-869b-485347c1368c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:08.827788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ef50d-80ae-49d3-869b-485347c1368c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:08.828095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ef50d-80ae-49d3-869b-485347c1368c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:08.840184 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ef50d-80ae-49d3-869b-485347c1368c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:08.848809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-347ef50d-80ae-49d3-869b-485347c1368c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:14:08.848809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:08.848809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:08.848809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:08.848809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:08.848809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:08.848809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:08.848809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:08.848809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:08.848809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:08.848809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:08.848809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:08.848809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:08.848809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:08.848809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:08.848809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:08.849936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:08.849936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:08.849936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:08.849936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:08.849936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:08.849936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:08.849936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:08.849936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:08.849936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:08.849936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:08.849936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:08.849936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:08.849936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:08.849936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:08.849936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:08.849936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:08.851936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:08.851936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:08.851936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:08.851936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:08.851936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:08.851936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:08.851936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:08.851936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:08.851936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:08.851936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:08.851936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:14:08.851936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:08.854470 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 608/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:14:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:08.857596 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381906e-1ae2-4efb-8374-73242ca763fa None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:08.906182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:08.989001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381906e-1ae2-4efb-8374-73242ca763fa None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:09.048310 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bb1d4-53d6-4795-8534-6ab2897bd346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:09.048888 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bb1d4-53d6-4795-8534-6ab2897bd346 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:09.049169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bb1d4-53d6-4795-8534-6ab2897bd346 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:09.049442 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bb1d4-53d6-4795-8534-6ab2897bd346 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:09.050192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bb1d4-53d6-4795-8534-6ab2897bd346 None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:09.050525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bb1d4-53d6-4795-8534-6ab2897bd346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:09.051908 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bb1d4-53d6-4795-8534-6ab2897bd346 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:09.068012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 601/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 20 19:14:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:09.071503 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ef50d-80ae-49d3-869b-485347c1368c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:09.159846 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:09.225605 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ef50d-80ae-49d3-869b-485347c1368c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:09.270203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ee5a2-0651-4546-932e-ddfbf762c5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:09.271178 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ee5a2-0651-4546-932e-ddfbf762c5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:09.271557 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ee5a2-0651-4546-932e-ddfbf762c5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:09.271875 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ee5a2-0651-4546-932e-ddfbf762c5d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:09.286059 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ee5a2-0651-4546-932e-ddfbf762c5d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:09.287572 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ee5a2-0651-4546-932e-ddfbf762c5d7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:09.308426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-5b2ee5a2-0651-4546-932e-ddfbf762c5d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:09.308426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:09.308426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:09.308426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:09.308426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:09.308426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:09.308426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:09.308426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:09.308426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:09.308426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:09.308426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:09.308426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:09.308426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:09.308426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:09.308426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:09.309609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:09.309609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:09.309609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:09.309609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:09.309609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:09.309609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:09.309609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:09.309609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:09.309609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:09.309609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:09.309609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:09.309609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:09.309609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:09.309609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:09.309609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:09.309609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:09.309609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:09.310916 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:09.310916 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:09.310916 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:09.310916 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:09.310916 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 609/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:09.315707 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bb1d4-53d6-4795-8534-6ab2897bd346 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:09.478113 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:09.481347 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bb1d4-53d6-4795-8534-6ab2897bd346 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:09.533705 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c7d13-5e57-42c3-90a0-7bdebd28dad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:09.534590 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c7d13-5e57-42c3-90a0-7bdebd28dad1 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:09.534763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c7d13-5e57-42c3-90a0-7bdebd28dad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:09.535549 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c7d13-5e57-42c3-90a0-7bdebd28dad1 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:09.536320 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c7d13-5e57-42c3-90a0-7bdebd28dad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:09.536657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c7d13-5e57-42c3-90a0-7bdebd28dad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:09.541723 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c7d13-5e57-42c3-90a0-7bdebd28dad1 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:09.556948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 602/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:09.562918 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ee5a2-0651-4546-932e-ddfbf762c5d7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:09.689887 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ee5a2-0651-4546-932e-ddfbf762c5d7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:09.691555 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:09.739565 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06cb25-7e7e-4eda-bd95-bc32ae69718a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:09.740406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06cb25-7e7e-4eda-bd95-bc32ae69718a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:09.740692 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06cb25-7e7e-4eda-bd95-bc32ae69718a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:09.740964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06cb25-7e7e-4eda-bd95-bc32ae69718a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:09.749514 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06cb25-7e7e-4eda-bd95-bc32ae69718a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:09.751000 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06cb25-7e7e-4eda-bd95-bc32ae69718a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:09.770935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-2c06cb25-7e7e-4eda-bd95-bc32ae69718a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:09.770935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:09.770935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:09.770935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:09.770935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:09.770935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:09.770935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:09.770935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:09.770935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:09.770935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:09.770935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:09.770935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:09.770935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:14:09.770935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:14:09.770935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:14:09.770935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:14:09.772114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:09.772114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:09.772114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:14:09.772114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:09.772114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:14:09.772114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:09.772114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:09.772114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:09.772114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:09.772114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:09.772114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:09.772114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:09.772114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:09.772114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:09.772114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:09.772114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:09.772114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:09.772114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:09.773138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:09.773138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:09.773138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:14:09.773138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:14:09.773138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:14:09.773138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:14:09.773138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:14:09.773138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:14:09.773138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:09.773138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:09.777163 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 610/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:14:09.778867 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c7d13-5e57-42c3-90a0-7bdebd28dad1 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:09.919061 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c7d13-5e57-42c3-90a0-7bdebd28dad1 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:09.978746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a85092-ae92-4ef9-b0f8-d809fa0c86d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:09.979645 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a85092-ae92-4ef9-b0f8-d809fa0c86d9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:09.979891 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a85092-ae92-4ef9-b0f8-d809fa0c86d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:09.980246 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a85092-ae92-4ef9-b0f8-d809fa0c86d9 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:09.981115 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a85092-ae92-4ef9-b0f8-d809fa0c86d9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:09.981446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a85092-ae92-4ef9-b0f8-d809fa0c86d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:09.983060 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a85092-ae92-4ef9-b0f8-d809fa0c86d9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:10.005923 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 603/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jul 20 19:14:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:10.012674 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06cb25-7e7e-4eda-bd95-bc32ae69718a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:10.153230 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06cb25-7e7e-4eda-bd95-bc32ae69718a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:10.202042 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1b2bb-dd0a-4e42-8d76-e008dc8134ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:10.202991 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1b2bb-dd0a-4e42-8d76-e008dc8134ac None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:10.203452 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1b2bb-dd0a-4e42-8d76-e008dc8134ac None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:10.204550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1b2bb-dd0a-4e42-8d76-e008dc8134ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:10.243386 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:10.301752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1b2bb-dd0a-4e42-8d76-e008dc8134ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:10.303346 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1b2bb-dd0a-4e42-8d76-e008dc8134ac None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:10.431526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 611/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:14:10.438220 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a85092-ae92-4ef9-b0f8-d809fa0c86d9 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:10.461200 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:10.571203 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a85092-ae92-4ef9-b0f8-d809fa0c86d9 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:10.624573 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657ed09-1817-4910-9733-ffceeff55d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:10.625527 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657ed09-1817-4910-9733-ffceeff55d6a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:10.625907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657ed09-1817-4910-9733-ffceeff55d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:10.626278 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657ed09-1817-4910-9733-ffceeff55d6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:10.642569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657ed09-1817-4910-9733-ffceeff55d6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:10.644325 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657ed09-1817-4910-9733-ffceeff55d6a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:10.666832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-3657ed09-1817-4910-9733-ffceeff55d6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:10.666832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:10.666832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:10.666832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:10.666832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:10.666832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:10.666832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:10.666832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:10.666832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:10.666832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:10.666832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:10.666832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:10.666832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:10.666832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:10.666832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:10.668017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:10.668017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:10.668017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:10.668017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:10.668017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:10.668017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:10.668017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:10.668017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:10.668017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:10.668017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:10.668017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:10.668017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:10.668017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:10.668017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:10.668017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:10.668017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:10.668017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:10.669118 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:10.669118 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:10.669118 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:10.669118 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:14:10.669118 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 604/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:14:10.675643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1b2bb-dd0a-4e42-8d76-e008dc8134ac None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:10.757804 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:10.809077 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1b2bb-dd0a-4e42-8d76-e008dc8134ac None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:10.854956 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38685ba7-e60a-42c1-80fa-76affbcf766b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:10.855616 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38685ba7-e60a-42c1-80fa-76affbcf766b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:10.856025 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38685ba7-e60a-42c1-80fa-76affbcf766b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:10.856435 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38685ba7-e60a-42c1-80fa-76affbcf766b None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:10.857236 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38685ba7-e60a-42c1-80fa-76affbcf766b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:10.857578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38685ba7-e60a-42c1-80fa-76affbcf766b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:10.859199 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38685ba7-e60a-42c1-80fa-76affbcf766b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:10.873237 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 612/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:10.879440 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657ed09-1817-4910-9733-ffceeff55d6a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:10.956414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:10.996293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657ed09-1817-4910-9733-ffceeff55d6a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:11.035927 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9652e-4894-44ab-bcf1-9cf48d4eed85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:11.036643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9652e-4894-44ab-bcf1-9cf48d4eed85 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:11.036924 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9652e-4894-44ab-bcf1-9cf48d4eed85 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:11.037203 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9652e-4894-44ab-bcf1-9cf48d4eed85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:11.044721 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9652e-4894-44ab-bcf1-9cf48d4eed85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:11.046165 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9652e-4894-44ab-bcf1-9cf48d4eed85 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:11.061261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-f8f9652e-4894-44ab-bcf1-9cf48d4eed85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:11.061261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:11.061261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:11.061261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:11.061261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:11.061261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:11.061261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:11.061261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:11.061261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:11.061261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:11.061261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:11.061261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:11.061261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:14:11.061261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:14:11.061261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:14:11.063884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:14:11.063884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:11.063884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:11.063884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:11.063884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:11.063884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:11.063884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:11.063884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:11.063884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:11.063884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:11.063884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:11.063884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:11.063884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:11.063884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:11.063884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:11.063884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:11.063884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:11.065043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:14:11.065043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:14:11.065043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:14:11.065043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:14:11.065043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:14:11.065043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:14:11.065043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:11.065043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:14:11.065043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 605/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:14:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:11.068788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38685ba7-e60a-42c1-80fa-76affbcf766b None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:11.197695 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38685ba7-e60a-42c1-80fa-76affbcf766b None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:11.226025 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:11.238405 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdbb87f-2007-446d-8e9c-0baf0aca1c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:11.239179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbb87f-2007-446d-8e9c-0baf0aca1c8b None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:11.239478 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbb87f-2007-446d-8e9c-0baf0aca1c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:11.239736 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdbb87f-2007-446d-8e9c-0baf0aca1c8b None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:11.240556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdbb87f-2007-446d-8e9c-0baf0aca1c8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:11.240882 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdbb87f-2007-446d-8e9c-0baf0aca1c8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:11.242314 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdbb87f-2007-446d-8e9c-0baf0aca1c8b None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:11.254727 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 613/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:14:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:11.262038 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9652e-4894-44ab-bcf1-9cf48d4eed85 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:11.370676 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9652e-4894-44ab-bcf1-9cf48d4eed85 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:11.400439 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:11.408158 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579eb10-9ee7-4bdb-a655-9a4fb4fbcd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:11.408843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579eb10-9ee7-4bdb-a655-9a4fb4fbcd24 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:11.409221 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579eb10-9ee7-4bdb-a655-9a4fb4fbcd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:11.409593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579eb10-9ee7-4bdb-a655-9a4fb4fbcd24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:11.410639 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579eb10-9ee7-4bdb-a655-9a4fb4fbcd24 None admin] RBAC: Adding query filter params (role.id=3e2d1ff906b74bec9c7410e3a3ec9448, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=d310799ac43e42bc9c7810e1296ddb9a) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:11.411017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579eb10-9ee7-4bdb-a655-9a4fb4fbcd24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:11.412560 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579eb10-9ee7-4bdb-a655-9a4fb4fbcd24 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:11.430398 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 606/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:11 2022] GET /identity/v3/role_assignments?user.id=d310799ac43e42bc9c7810e1296ddb9a&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=3e2d1ff906b74bec9c7410e3a3ec9448 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:13.559316 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8a1c9-06e4-412f-818f-4f11fa37d048 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:13.559858 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8a1c9-06e4-412f-818f-4f11fa37d048 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:13.559858 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8a1c9-06e4-412f-818f-4f11fa37d048 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:13.561262 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 614/1220] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:13.566776 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6824d-9210-413a-a984-922b2a219c2b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:13.567288 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6824d-9210-413a-a984-922b2a219c2b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:13.567443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6824d-9210-413a-a984-922b2a219c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:13.585739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5aa6824d-9210-413a-a984-922b2a219c2b None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:13.587107 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5aa6824d-9210-413a-a984-922b2a219c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:13.668199 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 607/1221] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:14:13.693553 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8a1c9-06e4-412f-818f-4f11fa37d048 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:13.813406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8a1c9-06e4-412f-818f-4f11fa37d048 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:13.852410 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dc0a9-ed57-4690-90c0-7e3140cdcb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:13.853435 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dc0a9-ed57-4690-90c0-7e3140cdcb29 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:13.853749 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dc0a9-ed57-4690-90c0-7e3140cdcb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:13.854188 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dc0a9-ed57-4690-90c0-7e3140cdcb29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:13.866497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6dc0a9-ed57-4690-90c0-7e3140cdcb29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:13.875171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-ea6dc0a9-ed57-4690-90c0-7e3140cdcb29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:14:13.875171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:13.875171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:13.875171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:13.875171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:13.875171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:13.875171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:13.875171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:13.875171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:13.875171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:13.875171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:13.875171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:13.875171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:13.875171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:13.875171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:13.875171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:13.876154 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:13.876154 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:13.876154 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:13.876154 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:13.876154 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:13.876154 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:13.876154 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:13.876154 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:13.876154 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:13.876154 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:13.876154 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:13.876154 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:13.876154 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:13.876154 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:13.876154 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:13.876154 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:13.877019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:13.877019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:13.877019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:13.877019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:13.877019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:13.877019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:13.877019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:13.877019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:13.877019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:13.877019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:13.877019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:14:13.877019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:13.877019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 615/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:14:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:13.883398 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6824d-9210-413a-a984-922b2a219c2b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:13.994245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6824d-9210-413a-a984-922b2a219c2b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:14.020123 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:14.031941 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b2223-264b-4cee-b01f-1f022137ea01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:14.032687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b2223-264b-4cee-b01f-1f022137ea01 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:14.032933 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b2223-264b-4cee-b01f-1f022137ea01 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:14.033247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b2223-264b-4cee-b01f-1f022137ea01 None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:14.034092 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b2223-264b-4cee-b01f-1f022137ea01 None admin] RBAC: Adding query filter params (name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:14.034439 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b2223-264b-4cee-b01f-1f022137ea01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:14.036001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008b2223-264b-4cee-b01f-1f022137ea01 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:14.049601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 608/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 20 19:14:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:14.051116 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dc0a9-ed57-4690-90c0-7e3140cdcb29 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:14.098626 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:14.163565 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dc0a9-ed57-4690-90c0-7e3140cdcb29 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:14.200598 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3fdd6-363e-4e69-8cbf-d9e5b29a6df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:14.201383 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3fdd6-363e-4e69-8cbf-d9e5b29a6df7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:14.201662 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3fdd6-363e-4e69-8cbf-d9e5b29a6df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:14.201937 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3fdd6-363e-4e69-8cbf-d9e5b29a6df7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:14.212962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3fdd6-363e-4e69-8cbf-d9e5b29a6df7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:14.214431 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3fdd6-363e-4e69-8cbf-d9e5b29a6df7 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:14.231505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-52d3fdd6-363e-4e69-8cbf-d9e5b29a6df7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:14.231505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:14.231505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:14.231505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:14.231505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:14.231505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:14.231505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:14.231505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:14.231505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:14.231505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:14.231505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:14.231505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:14.231505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:14.231505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:14.231505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:14.232806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:14.232806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:14.232806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:14.232806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:14.232806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:14.232806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:14.232806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:14.232806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:14.232806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:14.232806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:14.232806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:14.232806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:14.232806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:14.232806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:14.232806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:14.232806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:14.232806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:14.233751 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:14.233751 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:14.233751 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:14.233751 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:14.233751 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 616/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:14.239162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b2223-264b-4cee-b01f-1f022137ea01 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:14.351289 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b2223-264b-4cee-b01f-1f022137ea01 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:14.389818 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c9ca7-d720-4327-a834-ecc982838e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:14.391033 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c9ca7-d720-4327-a834-ecc982838e0c None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:14.391426 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c9ca7-d720-4327-a834-ecc982838e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:14.391771 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c9ca7-d720-4327-a834-ecc982838e0c None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:14.392667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c9ca7-d720-4327-a834-ecc982838e0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:14.393000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c9ca7-d720-4327-a834-ecc982838e0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:14.394737 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c9ca7-d720-4327-a834-ecc982838e0c None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:14.410886 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 609/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:14.418234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3fdd6-363e-4e69-8cbf-d9e5b29a6df7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:14.525205 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:14.533896 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3fdd6-363e-4e69-8cbf-d9e5b29a6df7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:14.575547 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e0263-0999-466f-ab5d-d473619ed10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:14.576362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e0263-0999-466f-ab5d-d473619ed10d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:14.576645 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e0263-0999-466f-ab5d-d473619ed10d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:14.576918 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e0263-0999-466f-ab5d-d473619ed10d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:14.584874 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e0263-0999-466f-ab5d-d473619ed10d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:14.586347 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e0263-0999-466f-ab5d-d473619ed10d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:14.608746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-563e0263-0999-466f-ab5d-d473619ed10d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:14.608746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:14.608746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:14.608746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:14.608746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:14.608746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:14.608746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:14.608746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:14.608746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:14.608746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:14.608746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:14.608746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:14.608746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:14:14.608746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:14:14.608746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:14:14.608746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:14:14.611191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:14.611191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:14.611191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:14:14.611191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:14.611191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:14:14.611191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:14.611191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:14.611191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:14.611191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:14.611191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:14.611191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:14.611191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:14.611191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:14.611191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:14.611191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:14.611191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:14.611191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:14.611191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:14.613343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:14.613343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:14.613343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:14:14.613343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:14:14.613343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:14:14.613343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:14:14.613343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:14:14.613343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:14:14.613343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:14.613343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:14.613343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 617/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:14.619335 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c9ca7-d720-4327-a834-ecc982838e0c None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:14.690725 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:14.753827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c9ca7-d720-4327-a834-ecc982838e0c None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:14.793550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999744c-c808-421b-a60f-f4908f218dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:14.794215 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999744c-c808-421b-a60f-f4908f218dfa None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:14.794542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999744c-c808-421b-a60f-f4908f218dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:14.794809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999744c-c808-421b-a60f-f4908f218dfa None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:14.795642 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999744c-c808-421b-a60f-f4908f218dfa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:14.795949 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999744c-c808-421b-a60f-f4908f218dfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:14.797369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999744c-c808-421b-a60f-f4908f218dfa None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:14.820636 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 610/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jul 20 19:14:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:14.822323 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e0263-0999-466f-ab5d-d473619ed10d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:14.939008 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e0263-0999-466f-ab5d-d473619ed10d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:14.980593 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373db992-f142-4302-923e-d6fc0f4b4ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:14.981554 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373db992-f142-4302-923e-d6fc0f4b4ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:14.981980 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373db992-f142-4302-923e-d6fc0f4b4ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:14.982263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373db992-f142-4302-923e-d6fc0f4b4ca2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:14.996078 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373db992-f142-4302-923e-d6fc0f4b4ca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:14.998564 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373db992-f142-4302-923e-d6fc0f4b4ca2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:15.017728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-373db992-f142-4302-923e-d6fc0f4b4ca2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:15.017728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:15.017728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:15.017728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:15.017728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:15.017728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:15.017728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:15.017728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:15.017728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:15.017728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:15.017728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:15.017728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:15.017728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:15.017728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:15.017728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:15.019079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:15.019079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:15.019079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:15.019079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:15.019079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:15.019079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:15.019079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:15.019079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:15.019079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:15.019079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:15.019079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:15.019079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:15.019079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:15.019079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:15.019079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:15.019079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:15.019079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:15.020190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:15.020190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:15.020190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:15.020190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:15.020190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 618/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:15.026447 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999744c-c808-421b-a60f-f4908f218dfa None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:15.150723 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999744c-c808-421b-a60f-f4908f218dfa None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:15.154862 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:15.199236 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8e373-afe1-4741-9c44-0dad21479824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:15.199861 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8e373-afe1-4741-9c44-0dad21479824 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:15.200332 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8e373-afe1-4741-9c44-0dad21479824 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:15.200614 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8e373-afe1-4741-9c44-0dad21479824 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:15.201491 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8e373-afe1-4741-9c44-0dad21479824 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:15.201820 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8e373-afe1-4741-9c44-0dad21479824 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:15.203443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8e373-afe1-4741-9c44-0dad21479824 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:15.223246 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 611/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:15.224680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373db992-f142-4302-923e-d6fc0f4b4ca2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:15.235986 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:15.344060 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373db992-f142-4302-923e-d6fc0f4b4ca2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:15.381454 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e3e25-da69-4d44-a6ec-dd666e33b450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:15.382410 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e3e25-da69-4d44-a6ec-dd666e33b450 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:15.382748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e3e25-da69-4d44-a6ec-dd666e33b450 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:15.383056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e3e25-da69-4d44-a6ec-dd666e33b450 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:15.392675 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e3e25-da69-4d44-a6ec-dd666e33b450 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:15.394227 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e3e25-da69-4d44-a6ec-dd666e33b450 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:15.412903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-fe8e3e25-da69-4d44-a6ec-dd666e33b450 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:15.412903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:15.412903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:15.412903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:15.412903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:15.412903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:15.412903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:15.412903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:15.412903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:15.412903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:15.412903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:15.412903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:15.412903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:14:15.412903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:14:15.412903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:14:15.414145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:14:15.414145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:15.414145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:15.414145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:15.414145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:15.414145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:15.414145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:15.414145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:15.414145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:15.414145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:15.414145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:15.414145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:15.414145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:15.414145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:15.414145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:15.414145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:15.414145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:15.420522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:14:15.420522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:14:15.420522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:14:15.420522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:14:15.420522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:14:15.420522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:14:15.420522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:15.420522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:15.420522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 619/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:14:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:15.421641 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8e373-afe1-4741-9c44-0dad21479824 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:15.536380 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8e373-afe1-4741-9c44-0dad21479824 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:15.572895 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a0ad9-69df-4023-9dcc-5ba6b4166cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:15.573721 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a0ad9-69df-4023-9dcc-5ba6b4166cde None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:15.574120 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a0ad9-69df-4023-9dcc-5ba6b4166cde None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:15.574554 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a0ad9-69df-4023-9dcc-5ba6b4166cde None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:15.575466 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a0ad9-69df-4023-9dcc-5ba6b4166cde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:15.575903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a0ad9-69df-4023-9dcc-5ba6b4166cde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:15.577825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a0ad9-69df-4023-9dcc-5ba6b4166cde None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:15.593179 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 612/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:14:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:15.600309 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e3e25-da69-4d44-a6ec-dd666e33b450 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:15.682893 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:15.724932 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e3e25-da69-4d44-a6ec-dd666e33b450 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:15.765176 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a32465-2f4c-420e-88cd-d244d948a436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:15.766210 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a32465-2f4c-420e-88cd-d244d948a436 None admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:15.766521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a32465-2f4c-420e-88cd-d244d948a436 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:15.766802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a32465-2f4c-420e-88cd-d244d948a436 None admin] PATH_INFO: `/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/d310799ac43e42bc9c7810e1296ddb9a/roles/3e2d1ff906b74bec9c7410e3a3ec9448` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:15.782324 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a32465-2f4c-420e-88cd-d244d948a436 None admin] RBAC: Authorizing `identity:create_grant(project_id=416a38494ed54934ba8ab0d8e18afb35, user_id=d310799ac43e42bc9c7810e1296ddb9a, role_id=3e2d1ff906b74bec9c7410e3a3ec9448)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:15.783780 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a32465-2f4c-420e-88cd-d244d948a436 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:15.798264 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 620/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:14:15 2022] PUT /identity/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/d310799ac43e42bc9c7810e1296ddb9a/roles/3e2d1ff906b74bec9c7410e3a3ec9448 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:14:18.040236 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42664c-973d-4140-9467-87f44e467a9f None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:18.041455 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42664c-973d-4140-9467-87f44e467a9f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:18.041455 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42664c-973d-4140-9467-87f44e467a9f None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:18.042889 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 613/1233] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:14:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:18.049801 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c1108-11a2-41f7-8d0f-134206ef6858 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:18.050331 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c1108-11a2-41f7-8d0f-134206ef6858 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:18.050590 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c1108-11a2-41f7-8d0f-134206ef6858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:18.069625 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d27c1108-11a2-41f7-8d0f-134206ef6858 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:18.070904 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d27c1108-11a2-41f7-8d0f-134206ef6858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:18.151481 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 621/1234] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:14:18.207064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42664c-973d-4140-9467-87f44e467a9f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:18.248825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:18.342588 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42664c-973d-4140-9467-87f44e467a9f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:18.387569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c51b6a-890b-4e90-9b78-497ef3160aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:18.388367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c51b6a-890b-4e90-9b78-497ef3160aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:18.388651 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c51b6a-890b-4e90-9b78-497ef3160aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:18.388930 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c51b6a-890b-4e90-9b78-497ef3160aa2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:18.399383 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c51b6a-890b-4e90-9b78-497ef3160aa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:18.407950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-25c51b6a-890b-4e90-9b78-497ef3160aa2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:14:18.407950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:18.407950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:18.407950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:18.407950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:18.407950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:18.407950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:18.407950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:18.407950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:18.407950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:18.407950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:18.407950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:18.407950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:18.407950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:18.407950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:18.407950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:18.409512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:18.409512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:18.409512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:18.409512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:18.409512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:18.409512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:18.409512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:18.409512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:18.409512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:18.409512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:18.409512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:18.409512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:18.409512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:18.409512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:18.409512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:18.409512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:18.410436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:18.410436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:18.410436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:18.410436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:18.410436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:18.410436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:18.410436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:18.410436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:18.410436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:18.410436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:18.410436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 19:14:18.410436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:14:18.410436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 614/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Jul 20 19:14:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:18.416250 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c1108-11a2-41f7-8d0f-134206ef6858 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:18.469444 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:18.532843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c1108-11a2-41f7-8d0f-134206ef6858 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:18.577989 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763226a-a8b0-45e1-a81a-15729ed29ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:18.579107 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763226a-a8b0-45e1-a81a-15729ed29ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:18.579601 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763226a-a8b0-45e1-a81a-15729ed29ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:18.580076 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763226a-a8b0-45e1-a81a-15729ed29ca1 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:18.581073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763226a-a8b0-45e1-a81a-15729ed29ca1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:18.581656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763226a-a8b0-45e1-a81a-15729ed29ca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:18.584093 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763226a-a8b0-45e1-a81a-15729ed29ca1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:18.598877 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 622/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Jul 20 19:14:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:18.606779 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c51b6a-890b-4e90-9b78-497ef3160aa2 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:18.724566 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:18.746442 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c51b6a-890b-4e90-9b78-497ef3160aa2 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:18.789587 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156d979-b2fb-471c-895d-3e3f9a024305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:18.791476 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156d979-b2fb-471c-895d-3e3f9a024305 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:18.791476 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156d979-b2fb-471c-895d-3e3f9a024305 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:18.792239 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156d979-b2fb-471c-895d-3e3f9a024305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:18.808857 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156d979-b2fb-471c-895d-3e3f9a024305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:18.811603 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7156d979-b2fb-471c-895d-3e3f9a024305 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:18.844230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-7156d979-b2fb-471c-895d-3e3f9a024305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:18.844230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:18.844230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:18.844230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:18.844230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:18.844230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:18.844230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:18.844230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:18.844230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:18.844230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:18.844230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:18.844230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:18.844230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:18.844230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:18.844230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:18.846612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:18.846612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:18.846612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:18.846612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:18.846612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:18.846612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:18.846612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:18.846612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:18.846612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:18.846612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:18.846612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:18.846612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:18.846612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:18.846612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:18.846612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:18.846612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:18.846612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:18.848445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:18.848445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:18.848445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:18.848445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:14:18.848445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 615/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:18.853468 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763226a-a8b0-45e1-a81a-15729ed29ca1 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:18.998723 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763226a-a8b0-45e1-a81a-15729ed29ca1 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:19.012923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:19.047091 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c09e8-23b0-40dd-a8db-02f8c33c8bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:19.048052 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c09e8-23b0-40dd-a8db-02f8c33c8bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:19.048361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c09e8-23b0-40dd-a8db-02f8c33c8bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:19.048999 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c09e8-23b0-40dd-a8db-02f8c33c8bf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:19.050085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c09e8-23b0-40dd-a8db-02f8c33c8bf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:19.050792 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c09e8-23b0-40dd-a8db-02f8c33c8bf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:19.052228 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c09e8-23b0-40dd-a8db-02f8c33c8bf2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:19.067048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 623/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:19.073414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156d979-b2fb-471c-895d-3e3f9a024305 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:19.235812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156d979-b2fb-471c-895d-3e3f9a024305 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:19.278128 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e3d46-5554-4ed8-bd56-b758da6738d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:19.278970 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e3d46-5554-4ed8-bd56-b758da6738d9 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:19.279253 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e3d46-5554-4ed8-bd56-b758da6738d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:19.279526 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e3d46-5554-4ed8-bd56-b758da6738d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:19.282618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:19.289279 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e3d46-5554-4ed8-bd56-b758da6738d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:19.291471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e3d46-5554-4ed8-bd56-b758da6738d9 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:19.309657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-a96e3d46-5554-4ed8-bd56-b758da6738d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:19.309657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:19.309657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:19.309657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:19.309657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:19.309657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:19.309657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:19.309657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:19.309657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:19.309657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:19.309657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:19.309657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:19.309657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:14:19.309657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:14:19.309657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:14:19.309657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:14:19.311795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:19.311795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:19.311795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:14:19.311795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:19.311795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:14:19.311795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:19.311795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:19.311795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:19.311795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:19.311795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:19.311795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:19.311795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:19.311795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:19.311795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:19.311795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:19.311795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:19.311795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:19.311795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:19.313768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:19.313768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:19.313768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:14:19.313768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:14:19.313768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:14:19.313768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:14:19.313768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:14:19.313768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:14:19.313768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:19.313768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:14:19.313768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 616/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:19.318058 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c09e8-23b0-40dd-a8db-02f8c33c8bf2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:19.435396 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c09e8-23b0-40dd-a8db-02f8c33c8bf2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:19.471083 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9963fd8-0b51-480f-8328-937ea20f9429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:19.471754 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9963fd8-0b51-480f-8328-937ea20f9429 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:19.472042 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9963fd8-0b51-480f-8328-937ea20f9429 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:19.472321 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9963fd8-0b51-480f-8328-937ea20f9429 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:19.473157 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9963fd8-0b51-480f-8328-937ea20f9429 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:19.473466 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9963fd8-0b51-480f-8328-937ea20f9429 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:19.474926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9963fd8-0b51-480f-8328-937ea20f9429 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:19.493947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 624/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jul 20 19:14:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:19.499764 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e3d46-5554-4ed8-bd56-b758da6738d9 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:19.621235 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e3d46-5554-4ed8-bd56-b758da6738d9 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:19.660154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377e10b-4de3-415b-bf6b-3b731f32f7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:19.660881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377e10b-4de3-415b-bf6b-3b731f32f7ee None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:19.661217 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377e10b-4de3-415b-bf6b-3b731f32f7ee None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:19.661544 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377e10b-4de3-415b-bf6b-3b731f32f7ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:19.725664 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:19.733437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377e10b-4de3-415b-bf6b-3b731f32f7ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:19.735432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377e10b-4de3-415b-bf6b-3b731f32f7ee None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:19.853234 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 617/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:14:19.858945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9963fd8-0b51-480f-8328-937ea20f9429 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:19.890130 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:19.979175 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9963fd8-0b51-480f-8328-937ea20f9429 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:20.023160 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d40091-545c-47f9-a384-47af8fdb70e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:20.024158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d40091-545c-47f9-a384-47af8fdb70e5 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:20.024483 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d40091-545c-47f9-a384-47af8fdb70e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:20.025362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d40091-545c-47f9-a384-47af8fdb70e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:20.037670 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d40091-545c-47f9-a384-47af8fdb70e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:20.039216 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d40091-545c-47f9-a384-47af8fdb70e5 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:20.057965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-a6d40091-545c-47f9-a384-47af8fdb70e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:20.057965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:20.057965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:20.057965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:20.057965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:20.057965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:20.057965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:20.057965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:20.057965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:20.057965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:20.057965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:20.057965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:20.057965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:20.057965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:20.057965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:20.059729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:20.059729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:20.059729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:20.059729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:20.059729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:20.059729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:20.059729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:20.059729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:20.059729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:20.059729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:20.059729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:20.059729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:20.059729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:20.059729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:20.059729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:20.059729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:20.059729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:20.060792 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:20.060792 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:20.060792 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:20.060792 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:20.060792 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 625/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:20.066132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377e10b-4de3-415b-bf6b-3b731f32f7ee None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:20.181689 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:20.191968 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377e10b-4de3-415b-bf6b-3b731f32f7ee None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:20.234799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e790c90-6166-4a68-9ef9-761959f26f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:20.235478 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e790c90-6166-4a68-9ef9-761959f26f60 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:20.235873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e790c90-6166-4a68-9ef9-761959f26f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:20.236178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e790c90-6166-4a68-9ef9-761959f26f60 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:20.237336 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e790c90-6166-4a68-9ef9-761959f26f60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:20.237925 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e790c90-6166-4a68-9ef9-761959f26f60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:20.240526 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e790c90-6166-4a68-9ef9-761959f26f60 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:20.256808 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 618/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:20.263250 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d40091-545c-47f9-a384-47af8fdb70e5 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:20.349589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:20.373188 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d40091-545c-47f9-a384-47af8fdb70e5 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:20.411995 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119888a-8c83-4d96-b3a3-9aefbe8d9c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:20.413067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119888a-8c83-4d96-b3a3-9aefbe8d9c82 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:20.413485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119888a-8c83-4d96-b3a3-9aefbe8d9c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:20.413878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119888a-8c83-4d96-b3a3-9aefbe8d9c82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:20.422632 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119888a-8c83-4d96-b3a3-9aefbe8d9c82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:20.424403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119888a-8c83-4d96-b3a3-9aefbe8d9c82 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:20.441506 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-7119888a-8c83-4d96-b3a3-9aefbe8d9c82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:20.441506 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:20.441506 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:20.441506 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:20.441506 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:20.441506 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:20.441506 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:20.441506 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:20.441506 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:20.441506 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:20.441506 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:20.441506 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:20.441506 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:14:20.441506 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:14:20.441506 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:14:20.442636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:14:20.442636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:20.442636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:20.442636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:20.442636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:20.442636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:20.442636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:20.442636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:20.442636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:20.442636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:20.442636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:20.442636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:20.442636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:20.442636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:20.442636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:20.442636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:20.442636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:20.443646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:14:20.443646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:14:20.443646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:14:20.443646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:14:20.443646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:14:20.443646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:14:20.443646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:20.443646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:20.443646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 626/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:14:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:20.449606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e790c90-6166-4a68-9ef9-761959f26f60 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:20.568632 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e790c90-6166-4a68-9ef9-761959f26f60 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:20.613781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da04ce-cd3f-4e9d-a8bf-908c69128069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:20.614483 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da04ce-cd3f-4e9d-a8bf-908c69128069 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:20.614868 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da04ce-cd3f-4e9d-a8bf-908c69128069 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:20.615149 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da04ce-cd3f-4e9d-a8bf-908c69128069 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:20.615958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da04ce-cd3f-4e9d-a8bf-908c69128069 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:20.616365 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da04ce-cd3f-4e9d-a8bf-908c69128069 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:20.617901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da04ce-cd3f-4e9d-a8bf-908c69128069 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:20.633342 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 619/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:14:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:20.642147 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119888a-8c83-4d96-b3a3-9aefbe8d9c82 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:20.753727 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119888a-8c83-4d96-b3a3-9aefbe8d9c82 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:20.792623 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8d376-8713-4202-8776-0bf6b0f80955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:20.793296 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8d376-8713-4202-8776-0bf6b0f80955 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:20.793550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8d376-8713-4202-8776-0bf6b0f80955 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:20.793822 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8d376-8713-4202-8776-0bf6b0f80955 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:20.794679 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8d376-8713-4202-8776-0bf6b0f80955 None admin] RBAC: Adding query filter params (role.id=3e2d1ff906b74bec9c7410e3a3ec9448, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=d310799ac43e42bc9c7810e1296ddb9a) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:20.794988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8d376-8713-4202-8776-0bf6b0f80955 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:20.796469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8d376-8713-4202-8776-0bf6b0f80955 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:20.803470 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 627/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:20 2022] GET /identity/v3/role_assignments?user.id=d310799ac43e42bc9c7810e1296ddb9a&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=3e2d1ff906b74bec9c7410e3a3ec9448 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:23.195302 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc2875-6929-4115-bc06-8b549e8131f5 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:23.196008 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc2875-6929-4115-bc06-8b549e8131f5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:23.196008 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc2875-6929-4115-bc06-8b549e8131f5 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:23.197846 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 620/1247] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:14:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:23.204899 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f39a20-a2f1-426b-a138-beab6eaa1ad3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:23.205403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f39a20-a2f1-426b-a138-beab6eaa1ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:23.205515 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f39a20-a2f1-426b-a138-beab6eaa1ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:23.210922 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:23.224569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e7f39a20-a2f1-426b-a138-beab6eaa1ad3 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:23.225860 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e7f39a20-a2f1-426b-a138-beab6eaa1ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:23.304247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 628/1248] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:14:23.331179 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc2875-6929-4115-bc06-8b549e8131f5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:23.353131 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:23.462611 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc2875-6929-4115-bc06-8b549e8131f5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:23.508778 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad65a6e-3746-49a7-a165-a108f9fb06ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:23.509918 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad65a6e-3746-49a7-a165-a108f9fb06ee None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:23.510324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad65a6e-3746-49a7-a165-a108f9fb06ee None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:23.510735 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad65a6e-3746-49a7-a165-a108f9fb06ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:23.525969 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad65a6e-3746-49a7-a165-a108f9fb06ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:23.535500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-6ad65a6e-3746-49a7-a165-a108f9fb06ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:23.535500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:23.535500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:23.535500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:23.535500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:23.535500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:23.535500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:23.535500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:23.535500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:23.535500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:23.535500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:23.535500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:23.535500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:23.535500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:23.535500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:23.535500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:23.537746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:23.537746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:23.537746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:23.537746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:23.537746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:23.537746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:23.537746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:23.537746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:23.537746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:23.537746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:23.537746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:23.537746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:23.537746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:23.537746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:23.537746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:23.537746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:23.538984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:23.538984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:23.538984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:23.538984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:23.538984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:23.538984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:23.538984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:23.538984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:23.538984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:23.538984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:23.538984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:23.538984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:14:23.538984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 621/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:14:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:23.544913 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f39a20-a2f1-426b-a138-beab6eaa1ad3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:23.666925 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f39a20-a2f1-426b-a138-beab6eaa1ad3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:23.703763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:23.711808 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1121fb8-1c72-442a-b89d-6a07a66d4d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:23.713320 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1121fb8-1c72-442a-b89d-6a07a66d4d88 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:23.713541 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1121fb8-1c72-442a-b89d-6a07a66d4d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:23.713824 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1121fb8-1c72-442a-b89d-6a07a66d4d88 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:23.715026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1121fb8-1c72-442a-b89d-6a07a66d4d88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:23.715413 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1121fb8-1c72-442a-b89d-6a07a66d4d88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:23.717293 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1121fb8-1c72-442a-b89d-6a07a66d4d88 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:23.733194 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 629/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:23.734608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad65a6e-3746-49a7-a165-a108f9fb06ee None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:23.827724 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:23.855282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad65a6e-3746-49a7-a165-a108f9fb06ee None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:23.894121 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619f650-62f9-4e2f-9715-99ee7492420b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:23.894958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619f650-62f9-4e2f-9715-99ee7492420b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:23.895243 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619f650-62f9-4e2f-9715-99ee7492420b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:23.895521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619f650-62f9-4e2f-9715-99ee7492420b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:23.908715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619f650-62f9-4e2f-9715-99ee7492420b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:23.910353 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619f650-62f9-4e2f-9715-99ee7492420b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:23.928042 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-6619f650-62f9-4e2f-9715-99ee7492420b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:23.928042 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:23.928042 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:23.928042 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:23.928042 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:23.928042 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:23.928042 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:23.928042 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:23.928042 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:23.928042 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:23.928042 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:23.928042 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:23.928042 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:23.928042 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:23.928042 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:23.929269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:23.929269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:23.929269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:23.929269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:23.929269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:23.929269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:23.929269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:23.929269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:23.929269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:23.929269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:23.929269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:23.929269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:23.929269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:23.929269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:23.929269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:23.929269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:23.929269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:23.931197 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:23.931197 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:23.931197 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:23.931197 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:14:23.931197 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 622/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:23.935636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1121fb8-1c72-442a-b89d-6a07a66d4d88 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:24.069914 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1121fb8-1c72-442a-b89d-6a07a66d4d88 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:24.108796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f3d71-862b-4584-a6b6-7e959c2c656d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:24.110537 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f3d71-862b-4584-a6b6-7e959c2c656d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:24.110537 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f3d71-862b-4584-a6b6-7e959c2c656d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:24.110537 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f3d71-862b-4584-a6b6-7e959c2c656d None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:24.110840 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f3d71-862b-4584-a6b6-7e959c2c656d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:24.111007 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f3d71-862b-4584-a6b6-7e959c2c656d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:24.112360 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f3d71-862b-4584-a6b6-7e959c2c656d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:24.127455 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 630/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:24.133088 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619f650-62f9-4e2f-9715-99ee7492420b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:24.251661 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619f650-62f9-4e2f-9715-99ee7492420b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:24.282570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:24.292240 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0969d85-f71c-4cd1-960e-969456de1b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:24.293050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0969d85-f71c-4cd1-960e-969456de1b19 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:24.293333 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0969d85-f71c-4cd1-960e-969456de1b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:24.293605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0969d85-f71c-4cd1-960e-969456de1b19 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:24.302694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0969d85-f71c-4cd1-960e-969456de1b19 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:24.304234 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0969d85-f71c-4cd1-960e-969456de1b19 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:24.320282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-a0969d85-f71c-4cd1-960e-969456de1b19 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:24.320282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:24.320282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:24.320282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:24.320282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:24.320282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:24.320282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:24.320282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:24.320282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:24.320282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:24.320282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:24.320282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:24.320282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:14:24.320282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:14:24.320282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:14:24.320282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:14:24.321865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:24.321865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:24.321865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:14:24.321865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:24.321865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:14:24.321865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:24.321865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:24.321865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:24.321865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:24.321865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:24.321865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:24.321865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:24.321865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:24.321865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:24.321865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:24.321865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:24.321865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:24.321865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:24.322966 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:24.322966 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:24.322966 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:14:24.322966 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:14:24.322966 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:14:24.322966 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:14:24.322966 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:14:24.322966 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:14:24.322966 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:24.322966 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:14:24.323558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 623/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:14:24.329610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f3d71-862b-4584-a6b6-7e959c2c656d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:24.396732 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:24.461345 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f3d71-862b-4584-a6b6-7e959c2c656d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:24.503180 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797858e0-61ef-46fa-abaf-3f8933126f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:24.503851 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797858e0-61ef-46fa-abaf-3f8933126f81 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:24.504170 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797858e0-61ef-46fa-abaf-3f8933126f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:24.504486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797858e0-61ef-46fa-abaf-3f8933126f81 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:24.505658 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797858e0-61ef-46fa-abaf-3f8933126f81 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:24.506038 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797858e0-61ef-46fa-abaf-3f8933126f81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:24.507632 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797858e0-61ef-46fa-abaf-3f8933126f81 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:24.529062 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 631/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jul 20 19:14:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:24.535036 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0969d85-f71c-4cd1-960e-969456de1b19 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:24.654082 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0969d85-f71c-4cd1-960e-969456de1b19 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:24.693255 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d147f-44cc-4e81-af17-1c67b2325a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:24.693870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d147f-44cc-4e81-af17-1c67b2325a54 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:24.694151 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d147f-44cc-4e81-af17-1c67b2325a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:24.694465 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d147f-44cc-4e81-af17-1c67b2325a54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:24.754063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:24.767233 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d147f-44cc-4e81-af17-1c67b2325a54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:24.768952 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d147f-44cc-4e81-af17-1c67b2325a54 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:24.887012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 624/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:14:24.893338 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797858e0-61ef-46fa-abaf-3f8933126f81 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:25.008114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797858e0-61ef-46fa-abaf-3f8933126f81 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:25.022385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:25.050004 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e454268-a478-4d60-be7d-dd418a68e00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:25.050841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e454268-a478-4d60-be7d-dd418a68e00c None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:25.051171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e454268-a478-4d60-be7d-dd418a68e00c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:25.051440 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e454268-a478-4d60-be7d-dd418a68e00c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:25.065284 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e454268-a478-4d60-be7d-dd418a68e00c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:25.066771 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e454268-a478-4d60-be7d-dd418a68e00c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:25.091289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-7e454268-a478-4d60-be7d-dd418a68e00c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:25.091289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:25.091289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:25.091289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:25.091289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:25.091289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:25.091289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:25.091289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:25.091289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:25.091289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:25.091289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:25.091289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:25.091289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:25.091289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:25.091289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:25.092402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:25.092402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:25.092402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:25.092402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:25.092402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:25.092402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:25.092402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:25.092402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:25.092402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:25.092402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:25.092402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:25.092402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:25.092402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:25.092402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:25.092402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:25.092402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:25.092402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:25.093331 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:25.093331 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:25.093331 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:25.093331 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:25.093331 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 632/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:25.098397 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d147f-44cc-4e81-af17-1c67b2325a54 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:25.204102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:25.217562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d147f-44cc-4e81-af17-1c67b2325a54 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:25.254321 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6b0b5-a149-46f5-849f-b3081b69d085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:25.255925 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6b0b5-a149-46f5-849f-b3081b69d085 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:25.256262 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6b0b5-a149-46f5-849f-b3081b69d085 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:25.256592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6b0b5-a149-46f5-849f-b3081b69d085 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:25.257362 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6b0b5-a149-46f5-849f-b3081b69d085 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:25.257772 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6b0b5-a149-46f5-849f-b3081b69d085 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:25.259955 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6b0b5-a149-46f5-849f-b3081b69d085 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:25.272830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 625/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:25.280750 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e454268-a478-4d60-be7d-dd418a68e00c None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:25.394219 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e454268-a478-4d60-be7d-dd418a68e00c None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:25.437406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff40e3-8ecc-4461-b4b0-d58739d6b703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:25.438205 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff40e3-8ecc-4461-b4b0-d58739d6b703 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:25.438534 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff40e3-8ecc-4461-b4b0-d58739d6b703 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:25.438815 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff40e3-8ecc-4461-b4b0-d58739d6b703 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:25.445795 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff40e3-8ecc-4461-b4b0-d58739d6b703 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:25.447271 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff40e3-8ecc-4461-b4b0-d58739d6b703 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:25.461305 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-3aff40e3-8ecc-4461-b4b0-d58739d6b703 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:25.461305 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:25.461305 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:25.461305 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:25.461305 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:25.461305 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:25.461305 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:25.461305 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:25.461305 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:25.461305 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:25.461305 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:25.461305 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:25.461305 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:14:25.461305 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:14:25.461305 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:14:25.462836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:14:25.462836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:25.462836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:25.462836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:25.462836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:25.462836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:25.462836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:25.462836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:25.462836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:25.462836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:25.462836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:25.462836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:25.462836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:25.462836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:25.462836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:25.462836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:25.462836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:25.463959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:14:25.463959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:14:25.463959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:14:25.463959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:14:25.463959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:14:25.463959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:14:25.463959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:25.463959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:25.463959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 633/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:14:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:25.470089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6b0b5-a149-46f5-849f-b3081b69d085 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:25.588220 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6b0b5-a149-46f5-849f-b3081b69d085 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:25.622766 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc6268-f414-4004-8fd4-21241f991153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:25.623420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc6268-f414-4004-8fd4-21241f991153 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:25.623699 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc6268-f414-4004-8fd4-21241f991153 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:25.623973 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc6268-f414-4004-8fd4-21241f991153 None admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:25.625043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc6268-f414-4004-8fd4-21241f991153 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:25.625169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc6268-f414-4004-8fd4-21241f991153 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:25.626594 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc6268-f414-4004-8fd4-21241f991153 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:25.638483 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 626/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:14:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:25.646105 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff40e3-8ecc-4461-b4b0-d58739d6b703 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:25.675794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:25.756204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff40e3-8ecc-4461-b4b0-d58739d6b703 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:25.794445 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421354e-4a04-44d0-b8e4-108c58118bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:25.795102 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421354e-4a04-44d0-b8e4-108c58118bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:25.795386 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421354e-4a04-44d0-b8e4-108c58118bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:25.795660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421354e-4a04-44d0-b8e4-108c58118bb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:25.796488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421354e-4a04-44d0-b8e4-108c58118bb0 None admin] RBAC: Adding query filter params (role.id=6322f657162c45ca85f019a408655ff3, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=d310799ac43e42bc9c7810e1296ddb9a) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:25.796805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421354e-4a04-44d0-b8e4-108c58118bb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:25.798446 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421354e-4a04-44d0-b8e4-108c58118bb0 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:25.805321 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 634/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:25 2022] GET /identity/v3/role_assignments?user.id=d310799ac43e42bc9c7810e1296ddb9a&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=6322f657162c45ca85f019a408655ff3 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:27.838821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce5618-773a-4ae4-bac4-48d3e871c8c9 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:27.839325 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce5618-773a-4ae4-bac4-48d3e871c8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:27.839325 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce5618-773a-4ae4-bac4-48d3e871c8c9 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:27.840678 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 627/1261] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:27.845854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a34e0-8736-42d2-9c9e-464d91673893 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:27.846328 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a34e0-8736-42d2-9c9e-464d91673893 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:27.846436 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a34e0-8736-42d2-9c9e-464d91673893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:27.862841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-841a34e0-8736-42d2-9c9e-464d91673893 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:27.864024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-841a34e0-8736-42d2-9c9e-464d91673893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:27.931448 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 635/1262] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:14:27.954080 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce5618-773a-4ae4-bac4-48d3e871c8c9 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:27.964829 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:28.052731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce5618-773a-4ae4-bac4-48d3e871c8c9 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:28.087091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38f81b-ffd0-40bd-8d1e-da61ecfbd209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:28.087879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38f81b-ffd0-40bd-8d1e-da61ecfbd209 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:28.088160 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38f81b-ffd0-40bd-8d1e-da61ecfbd209 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:28.088487 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38f81b-ffd0-40bd-8d1e-da61ecfbd209 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:28.098527 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38f81b-ffd0-40bd-8d1e-da61ecfbd209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:28.106511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-4f38f81b-ffd0-40bd-8d1e-da61ecfbd209 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:28.106511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:28.106511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:28.106511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:28.106511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:28.106511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:28.106511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:28.106511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:28.106511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:28.106511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:28.106511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:28.106511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:28.106511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:28.106511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:28.106511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:28.106511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:28.107608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:28.107608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:28.107608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:28.107608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:28.107608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:28.107608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:28.107608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:28.107608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:28.107608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:28.107608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:28.107608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:28.107608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:28.107608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:28.107608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:28.107608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:28.107608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:28.108510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:28.108510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:28.108510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:28.108510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:28.108510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:28.108510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:28.108510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:28.108510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:28.108510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:28.108510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:28.108510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:28.108510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:14:28.108510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 628/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:14:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:28.113922 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a34e0-8736-42d2-9c9e-464d91673893 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:28.133416 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:28.238580 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a34e0-8736-42d2-9c9e-464d91673893 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:28.285568 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88755769-0180-4cdc-be18-1fdb5f9d58a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:28.286616 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88755769-0180-4cdc-be18-1fdb5f9d58a9 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:28.286972 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88755769-0180-4cdc-be18-1fdb5f9d58a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:28.287322 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88755769-0180-4cdc-be18-1fdb5f9d58a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:28.288509 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88755769-0180-4cdc-be18-1fdb5f9d58a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:28.288898 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88755769-0180-4cdc-be18-1fdb5f9d58a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:28.291544 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88755769-0180-4cdc-be18-1fdb5f9d58a9 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:28.302945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 636/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:28.309413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38f81b-ffd0-40bd-8d1e-da61ecfbd209 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:28.376566 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:28.409362 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38f81b-ffd0-40bd-8d1e-da61ecfbd209 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:28.442841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185d475-bd1d-4e8a-ac4e-ec84de46fb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:28.443627 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185d475-bd1d-4e8a-ac4e-ec84de46fb9a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:28.443906 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185d475-bd1d-4e8a-ac4e-ec84de46fb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:28.444183 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185d475-bd1d-4e8a-ac4e-ec84de46fb9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:28.454975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185d475-bd1d-4e8a-ac4e-ec84de46fb9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:28.456418 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185d475-bd1d-4e8a-ac4e-ec84de46fb9a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:28.473488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-a185d475-bd1d-4e8a-ac4e-ec84de46fb9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:28.473488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:28.473488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:28.473488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:28.473488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:28.473488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:28.473488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:28.473488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:28.473488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:28.473488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:28.473488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:28.473488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:28.473488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:28.473488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:28.473488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:28.474675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:28.474675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:28.474675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:28.474675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:28.474675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:28.474675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:28.474675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:28.474675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:28.474675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:28.474675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:28.474675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:28.474675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:28.474675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:28.474675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:28.474675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:28.474675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:28.474675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:28.475663 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:28.475663 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:28.475663 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:28.475663 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:14:28.475663 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 629/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:28.481177 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88755769-0180-4cdc-be18-1fdb5f9d58a9 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:28.559748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:28.578492 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88755769-0180-4cdc-be18-1fdb5f9d58a9 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:28.614052 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4062ef-763f-4051-9caf-d89bbe62c3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:28.615100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4062ef-763f-4051-9caf-d89bbe62c3dd None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:28.615100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4062ef-763f-4051-9caf-d89bbe62c3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:28.615325 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4062ef-763f-4051-9caf-d89bbe62c3dd None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:28.616000 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4062ef-763f-4051-9caf-d89bbe62c3dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:28.616517 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4062ef-763f-4051-9caf-d89bbe62c3dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:28.617653 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4062ef-763f-4051-9caf-d89bbe62c3dd None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:28.629143 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 637/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:28.634778 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185d475-bd1d-4e8a-ac4e-ec84de46fb9a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:28.736160 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185d475-bd1d-4e8a-ac4e-ec84de46fb9a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:28.759529 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:28.778142 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de08ff-60d1-472e-8f36-a56c67fa194b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:28.778967 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de08ff-60d1-472e-8f36-a56c67fa194b None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:28.779246 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de08ff-60d1-472e-8f36-a56c67fa194b None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:28.779518 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de08ff-60d1-472e-8f36-a56c67fa194b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:28.790707 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de08ff-60d1-472e-8f36-a56c67fa194b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:28.792164 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de08ff-60d1-472e-8f36-a56c67fa194b None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:28.810525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-08de08ff-60d1-472e-8f36-a56c67fa194b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:28.810525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:28.810525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:28.810525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:28.810525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:28.810525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:28.810525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:28.810525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:28.810525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:28.810525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:28.810525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:28.810525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:28.810525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:14:28.810525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:14:28.810525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:14:28.810525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:14:28.811586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:28.811586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:28.811586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:14:28.811586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:28.811586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:14:28.811586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:28.811586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:28.811586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:28.811586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:28.811586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:28.811586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:28.811586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:28.811586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:28.811586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:28.811586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:28.811586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:28.811586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:28.811586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:28.812794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:28.812794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:28.812794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:14:28.812794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:14:28.812794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:14:28.812794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:14:28.812794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:14:28.812794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:14:28.812794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:28.812794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:14:28.812794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 630/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:28.821379 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4062ef-763f-4051-9caf-d89bbe62c3dd None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:28.951707 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4062ef-763f-4051-9caf-d89bbe62c3dd None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:28.985244 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efc937-faa1-4356-9b91-89a4b723f457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:28.985904 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efc937-faa1-4356-9b91-89a4b723f457 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:28.986191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efc937-faa1-4356-9b91-89a4b723f457 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:28.986503 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efc937-faa1-4356-9b91-89a4b723f457 None admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:28.987332 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efc937-faa1-4356-9b91-89a4b723f457 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:28.987644 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efc937-faa1-4356-9b91-89a4b723f457 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:28.989057 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efc937-faa1-4356-9b91-89a4b723f457 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:28.997561 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:29.006865 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 638/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jul 20 19:14:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:29.013304 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de08ff-60d1-472e-8f36-a56c67fa194b None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:29.118586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de08ff-60d1-472e-8f36-a56c67fa194b None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:29.160242 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ca4a5-bb83-4c7d-ae73-c620d22e41b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:29.161361 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ca4a5-bb83-4c7d-ae73-c620d22e41b5 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:29.161726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ca4a5-bb83-4c7d-ae73-c620d22e41b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:29.162098 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ca4a5-bb83-4c7d-ae73-c620d22e41b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:29.176609 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ca4a5-bb83-4c7d-ae73-c620d22e41b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:29.178622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ca4a5-bb83-4c7d-ae73-c620d22e41b5 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:29.198728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-170ca4a5-bb83-4c7d-ae73-c620d22e41b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:29.198728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:29.198728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:29.198728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:29.198728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:29.198728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:29.198728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:29.198728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:29.198728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:29.198728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:29.198728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:29.198728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:29.198728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:29.198728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:29.198728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:29.199903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:29.199903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:29.199903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:29.199903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:29.199903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:29.199903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:29.199903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:29.199903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:29.199903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:29.199903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:29.199903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:29.199903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:29.199903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:29.199903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:29.199903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:29.199903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:29.199903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:29.201236 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:29.201236 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:29.201236 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:29.201236 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:14:29.201236 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 631/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:29.205933 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efc937-faa1-4356-9b91-89a4b723f457 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:29.307736 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efc937-faa1-4356-9b91-89a4b723f457 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:29.340624 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac607941-c345-4b44-995f-709d848fa37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:29.341282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac607941-c345-4b44-995f-709d848fa37f None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:29.341563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac607941-c345-4b44-995f-709d848fa37f None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:29.341838 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac607941-c345-4b44-995f-709d848fa37f None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:29.342581 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac607941-c345-4b44-995f-709d848fa37f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:29.342891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac607941-c345-4b44-995f-709d848fa37f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:29.344244 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac607941-c345-4b44-995f-709d848fa37f None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:29.355078 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 639/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:29.360841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ca4a5-bb83-4c7d-ae73-c620d22e41b5 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:29.392560 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:29.465720 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ca4a5-bb83-4c7d-ae73-c620d22e41b5 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:29.500889 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84283e9b-a5ad-4926-9608-dfa1770feeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:29.501674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84283e9b-a5ad-4926-9608-dfa1770feeaf None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:29.501953 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84283e9b-a5ad-4926-9608-dfa1770feeaf None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:29.503444 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84283e9b-a5ad-4926-9608-dfa1770feeaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:29.509305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84283e9b-a5ad-4926-9608-dfa1770feeaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:29.510759 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84283e9b-a5ad-4926-9608-dfa1770feeaf None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:29.525328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-84283e9b-a5ad-4926-9608-dfa1770feeaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:29.525328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:29.525328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:29.525328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:29.525328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:29.525328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:29.525328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:29.525328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:29.525328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:29.525328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:29.525328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:29.525328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:29.525328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:14:29.525328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:14:29.525328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:14:29.526270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:14:29.526270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:29.526270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:29.526270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:29.526270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:29.526270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:29.526270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:29.526270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:29.526270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:29.526270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:29.526270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:29.526270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:29.526270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:29.526270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:29.526270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:29.526270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:29.526270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:29.527567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:14:29.527567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:14:29.527567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:14:29.527567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:14:29.527567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:14:29.527567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:14:29.527567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:29.527567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:14:29.527567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 632/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:14:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:14:29.532654 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac607941-c345-4b44-995f-709d848fa37f None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:29.591020 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:29.634350 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac607941-c345-4b44-995f-709d848fa37f None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:29.667807 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac27a6-4f7f-4b65-be39-fbfc1ff32fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:29.668449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac27a6-4f7f-4b65-be39-fbfc1ff32fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:29.668734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac27a6-4f7f-4b65-be39-fbfc1ff32fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:29.669008 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac27a6-4f7f-4b65-be39-fbfc1ff32fd2 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:29.669848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac27a6-4f7f-4b65-be39-fbfc1ff32fd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:29.670168 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac27a6-4f7f-4b65-be39-fbfc1ff32fd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:29.671624 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac27a6-4f7f-4b65-be39-fbfc1ff32fd2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:29.688869 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 640/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:14:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:29.695232 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84283e9b-a5ad-4926-9608-dfa1770feeaf None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:29.784015 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:29.794620 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84283e9b-a5ad-4926-9608-dfa1770feeaf None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:29.837876 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa70bf6-b1a0-4814-9ac5-7a872cdaf265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:29.838780 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa70bf6-b1a0-4814-9ac5-7a872cdaf265 None admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:29.839060 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa70bf6-b1a0-4814-9ac5-7a872cdaf265 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:29.839329 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa70bf6-b1a0-4814-9ac5-7a872cdaf265 None admin] PATH_INFO: `/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/d310799ac43e42bc9c7810e1296ddb9a/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:29.841257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa70bf6-b1a0-4814-9ac5-7a872cdaf265 None admin] RBAC: Authorizing `identity:create_grant(project_id=416a38494ed54934ba8ab0d8e18afb35, user_id=d310799ac43e42bc9c7810e1296ddb9a, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:29.842711 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa70bf6-b1a0-4814-9ac5-7a872cdaf265 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:29.855513 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 633/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Jul 20 19:14:29 2022] PUT /identity/v3/projects/416a38494ed54934ba8ab0d8e18afb35/users/d310799ac43e42bc9c7810e1296ddb9a/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:14:31.906749 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb27994-7dd3-4386-860f-adf1ae9f5122 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:31.907274 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb27994-7dd3-4386-860f-adf1ae9f5122 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:31.907274 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb27994-7dd3-4386-860f-adf1ae9f5122 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:31.908761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 641/1274] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:31.914718 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6aca4-4feb-4472-8fe1-de3c7cb44759 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:31.915128 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6aca4-4feb-4472-8fe1-de3c7cb44759 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:31.915312 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6aca4-4feb-4472-8fe1-de3c7cb44759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:31.932109 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-cce6aca4-4feb-4472-8fe1-de3c7cb44759 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:31.933299 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cce6aca4-4feb-4472-8fe1-de3c7cb44759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:31.998372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 634/1275] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 19:14:32.021508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb27994-7dd3-4386-860f-adf1ae9f5122 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:32.121372 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb27994-7dd3-4386-860f-adf1ae9f5122 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:32.138783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:32.162941 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71801e50-18e9-49d1-84a7-ccb1b8aefcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:32.163638 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71801e50-18e9-49d1-84a7-ccb1b8aefcd7 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:32.163929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71801e50-18e9-49d1-84a7-ccb1b8aefcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:32.164688 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71801e50-18e9-49d1-84a7-ccb1b8aefcd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:32.175465 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71801e50-18e9-49d1-84a7-ccb1b8aefcd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 19:14:32.183814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-71801e50-18e9-49d1-84a7-ccb1b8aefcd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:32.183814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:32.183814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:32.183814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:32.183814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:32.183814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:32.183814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:32.183814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:32.183814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:32.183814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:32.183814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:32.183814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:32.183814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 19:14:32.183814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 19:14:32.183814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 19:14:32.183814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 19:14:32.185110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 19:14:32.185110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 19:14:32.185110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 19:14:32.185110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 19:14:32.185110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:32.185110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:32.185110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:32.185110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:32.185110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:32.185110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:32.185110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:32.185110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:32.185110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:32.185110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:32.185110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:32.185110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:32.186241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:32.186241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:32.186241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:32.186241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:32.186241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 19:14:32.186241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 19:14:32.186241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 19:14:32.186241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 19:14:32.186241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 19:14:32.186241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 19:14:32.186241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 19:14:32.186241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:32.186241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 642/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Jul 20 19:14:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:32.191110 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6aca4-4feb-4472-8fe1-de3c7cb44759 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:32.270366 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:32.289284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6aca4-4feb-4472-8fe1-de3c7cb44759 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:32.322745 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07a1fc-ca11-48ce-98ef-42cb0c1f019a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:32.323404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07a1fc-ca11-48ce-98ef-42cb0c1f019a None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:32.323684 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07a1fc-ca11-48ce-98ef-42cb0c1f019a None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:32.323954 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07a1fc-ca11-48ce-98ef-42cb0c1f019a None admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:32.324691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07a1fc-ca11-48ce-98ef-42cb0c1f019a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:32.324993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07a1fc-ca11-48ce-98ef-42cb0c1f019a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:32.326381 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07a1fc-ca11-48ce-98ef-42cb0c1f019a None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:32.334384 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 635/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Jul 20 19:14:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:32.341569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71801e50-18e9-49d1-84a7-ccb1b8aefcd7 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:32.439876 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71801e50-18e9-49d1-84a7-ccb1b8aefcd7 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:32.473588 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bf2e2-ca3c-451d-8ee5-b00423cce89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:32.474396 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bf2e2-ca3c-451d-8ee5-b00423cce89a None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:32.474677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bf2e2-ca3c-451d-8ee5-b00423cce89a None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:32.474950 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bf2e2-ca3c-451d-8ee5-b00423cce89a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:32.485695 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8bf2e2-ca3c-451d-8ee5-b00423cce89a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:32.487144 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8bf2e2-ca3c-451d-8ee5-b00423cce89a None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:32.504306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-1e8bf2e2-ca3c-451d-8ee5-b00423cce89a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:32.504306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:32.504306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:32.504306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:32.504306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:32.504306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:32.504306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:32.504306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:32.504306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:32.504306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:32.504306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:32.504306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:32.504306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:32.504306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:32.504306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:32.505391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:32.505391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:32.505391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:32.505391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:32.505391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:32.505391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:32.505391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:32.505391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:32.505391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:32.505391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:32.505391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:32.505391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:32.505391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:32.505391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:32.505391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:32.505391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:32.505391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:32.506569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:32.506569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:32.506569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:32.506569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:32.506569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 643/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:32.511462 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07a1fc-ca11-48ce-98ef-42cb0c1f019a None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:32.610562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07a1fc-ca11-48ce-98ef-42cb0c1f019a None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:32.643691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34226af-8379-4880-b7d7-62be0c9ed9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:32.644346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34226af-8379-4880-b7d7-62be0c9ed9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:32.644640 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34226af-8379-4880-b7d7-62be0c9ed9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:32.644919 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34226af-8379-4880-b7d7-62be0c9ed9d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:32.645636 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34226af-8379-4880-b7d7-62be0c9ed9d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:32.645947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34226af-8379-4880-b7d7-62be0c9ed9d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:32.647344 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34226af-8379-4880-b7d7-62be0c9ed9d4 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:32.659012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 636/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:32.665151 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bf2e2-ca3c-451d-8ee5-b00423cce89a None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:32.695580 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:32.764088 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bf2e2-ca3c-451d-8ee5-b00423cce89a None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:32.796159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826cafc-6986-4b7d-ade6-e0f0fe6e327d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:32.796949 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826cafc-6986-4b7d-ade6-e0f0fe6e327d None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:32.797228 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826cafc-6986-4b7d-ade6-e0f0fe6e327d None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:32.797573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826cafc-6986-4b7d-ade6-e0f0fe6e327d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:32.804650 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826cafc-6986-4b7d-ade6-e0f0fe6e327d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:32.806657 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826cafc-6986-4b7d-ade6-e0f0fe6e327d None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:32.821045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-5826cafc-6986-4b7d-ade6-e0f0fe6e327d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:32.821045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:32.821045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:32.821045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:32.821045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:32.821045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:32.821045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:32.821045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:32.821045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:32.821045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:32.821045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:32.821045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:32.821045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 19:14:32.821045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 19:14:32.821045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 19:14:32.821045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 19:14:32.822355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:32.822355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:32.822355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 19:14:32.822355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:32.822355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 19:14:32.822355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 19:14:32.822355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:32.822355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:32.822355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:32.822355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:32.822355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:32.822355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:32.822355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:32.822355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:32.822355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:32.822355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:32.822355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:32.822355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:32.823363 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:32.823363 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:32.823363 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 19:14:32.823363 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 19:14:32.823363 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 19:14:32.823363 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 19:14:32.823363 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 19:14:32.823363 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 19:14:32.823363 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 19:14:32.823363 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:32.823363 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 644/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:32.828038 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34226af-8379-4880-b7d7-62be0c9ed9d4 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:32.831756 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:32.925593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34226af-8379-4880-b7d7-62be0c9ed9d4 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:32.958789 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbc34f-51cc-4041-8a40-b7fca4b37158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:32.959361 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbc34f-51cc-4041-8a40-b7fca4b37158 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:32.959650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbc34f-51cc-4041-8a40-b7fca4b37158 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:32.959926 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbc34f-51cc-4041-8a40-b7fca4b37158 None admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:32.960753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbc34f-51cc-4041-8a40-b7fca4b37158 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:32.961562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbc34f-51cc-4041-8a40-b7fca4b37158 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:32.963016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbc34f-51cc-4041-8a40-b7fca4b37158 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:32.982502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 637/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Jul 20 19:14:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:32.988405 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826cafc-6986-4b7d-ade6-e0f0fe6e327d None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:33.077472 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:33.088179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826cafc-6986-4b7d-ade6-e0f0fe6e327d None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:33.124553 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257a256-b3e1-436f-aa74-a4d464501f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:33.125196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257a256-b3e1-436f-aa74-a4d464501f44 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:33.125624 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257a256-b3e1-436f-aa74-a4d464501f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:33.126125 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257a256-b3e1-436f-aa74-a4d464501f44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:33.200624 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257a256-b3e1-436f-aa74-a4d464501f44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:33.202081 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257a256-b3e1-436f-aa74-a4d464501f44 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:33.288240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:33.299249 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 645/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Jul 20 19:14:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 19:14:33.305159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbc34f-51cc-4041-8a40-b7fca4b37158 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:33.365418 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:33.405062 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbc34f-51cc-4041-8a40-b7fca4b37158 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:33.438580 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db552487-08d2-4bb3-b2dd-3827f36a5194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:33.439381 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db552487-08d2-4bb3-b2dd-3827f36a5194 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:33.439667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db552487-08d2-4bb3-b2dd-3827f36a5194 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:33.439943 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db552487-08d2-4bb3-b2dd-3827f36a5194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:33.450776 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db552487-08d2-4bb3-b2dd-3827f36a5194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:33.452246 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db552487-08d2-4bb3-b2dd-3827f36a5194 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:33.475441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-db552487-08d2-4bb3-b2dd-3827f36a5194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:33.475441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:33.475441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:33.475441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:33.475441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:33.475441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:33.475441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:33.475441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:33.475441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:33.475441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:33.475441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:33.475441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:33.475441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 19:14:33.475441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 19:14:33.475441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 19:14:33.476598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 19:14:33.476598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:33.476598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:33.476598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:33.476598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:33.476598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:33.476598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:33.476598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:33.476598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:33.476598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:33.476598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:33.476598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:33.476598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:33.476598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:33.476598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:33.476598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:33.476598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:33.477707 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 19:14:33.477707 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 19:14:33.477707 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 19:14:33.477707 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:14:33.477707 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 638/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:14:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:33.483234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257a256-b3e1-436f-aa74-a4d464501f44 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:33.584015 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257a256-b3e1-436f-aa74-a4d464501f44 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:33.619069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ccec01-06a4-43bb-af88-1b676f5d4263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:33.619724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccec01-06a4-43bb-af88-1b676f5d4263 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:33.620006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccec01-06a4-43bb-af88-1b676f5d4263 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:33.620280 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccec01-06a4-43bb-af88-1b676f5d4263 None admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:33.620997 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ccec01-06a4-43bb-af88-1b676f5d4263 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:33.621301 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ccec01-06a4-43bb-af88-1b676f5d4263 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:33.622672 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ccec01-06a4-43bb-af88-1b676f5d4263 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:33.634271 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 646/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Jul 20 19:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:33.640149 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db552487-08d2-4bb3-b2dd-3827f36a5194 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:33.738587 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db552487-08d2-4bb3-b2dd-3827f36a5194 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:33.752903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:33.773349 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378005d9-9ca2-4edd-ae1f-5ea8735c5915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:33.774184 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378005d9-9ca2-4edd-ae1f-5ea8735c5915 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:33.774510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378005d9-9ca2-4edd-ae1f-5ea8735c5915 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:33.774792 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378005d9-9ca2-4edd-ae1f-5ea8735c5915 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:33.781741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378005d9-9ca2-4edd-ae1f-5ea8735c5915 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:33.783237 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378005d9-9ca2-4edd-ae1f-5ea8735c5915 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:33.797416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application [None req-378005d9-9ca2-4edd-ae1f-5ea8735c5915 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:33.797416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:33.797416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:33.797416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:33.797416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:33.797416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:33.797416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:33.797416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:33.797416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:33.797416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:33.797416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:33.797416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:33.797416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 19:14:33.797416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 19:14:33.797416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 19:14:33.798606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 19:14:33.798606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:33.798606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:33.798606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:33.798606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:33.798606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:33.798606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:33.798606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:33.798606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:33.798606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:33.798606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:33.798606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:33.798606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:33.798606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:33.798606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:33.798606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:33.798606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:33.799753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 19:14:33.799753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 19:14:33.799753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 19:14:33.799753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 19:14:33.799753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 19:14:33.799753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 19:14:33.799753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 19:14:33.799753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: ERROR keystone.server.flask.application Jul 20 19:14:33.799753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 639/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Jul 20 19:14:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 19:14:33.805263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ccec01-06a4-43bb-af88-1b676f5d4263 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:33.854083 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:33.905402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ccec01-06a4-43bb-af88-1b676f5d4263 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:33.938529 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f59873-263e-489d-8631-49a2276cf6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:33.939183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f59873-263e-489d-8631-49a2276cf6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:33.939472 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f59873-263e-489d-8631-49a2276cf6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:33.939751 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f59873-263e-489d-8631-49a2276cf6e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:33.940533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f59873-263e-489d-8631-49a2276cf6e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:33.940843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f59873-263e-489d-8631-49a2276cf6e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:33.942255 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f59873-263e-489d-8631-49a2276cf6e1 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:33.954466 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 647/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Jul 20 19:14:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:14:33.960508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378005d9-9ca2-4edd-ae1f-5ea8735c5915 None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:34.059949 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378005d9-9ca2-4edd-ae1f-5ea8735c5915 None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:34.097710 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ec0f7-8c2b-4e4a-908c-da29f8f99751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:34.098380 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ec0f7-8c2b-4e4a-908c-da29f8f99751 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:34.098665 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ec0f7-8c2b-4e4a-908c-da29f8f99751 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:34.098939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ec0f7-8c2b-4e4a-908c-da29f8f99751 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:34.099761 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ec0f7-8c2b-4e4a-908c-da29f8f99751 None admin] RBAC: Adding query filter params (role.id=6322f657162c45ca85f019a408655ff3, scope.project.id=416a38494ed54934ba8ab0d8e18afb35, user.id=d310799ac43e42bc9c7810e1296ddb9a) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:34.100073 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ec0f7-8c2b-4e4a-908c-da29f8f99751 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:34.101506 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ec0f7-8c2b-4e4a-908c-da29f8f99751 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:34.107794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 640/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Jul 20 19:14:33 2022] GET /identity/v3/role_assignments?user.id=d310799ac43e42bc9c7810e1296ddb9a&scope.project.id=416a38494ed54934ba8ab0d8e18afb35&role.id=6322f657162c45ca85f019a408655ff3 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:36.200531 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cebee-c0a9-4057-8d19-e9103c7633bf None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:36.201137 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cebee-c0a9-4057-8d19-e9103c7633bf None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:36.201317 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cebee-c0a9-4057-8d19-e9103c7633bf None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:36.203139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 648/1288] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:14:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:36.209686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4b38d-d4fe-4a39-ba5c-bb4c2cf5919b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:36.210486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4b38d-d4fe-4a39-ba5c-bb4c2cf5919b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:36.210486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4b38d-d4fe-4a39-ba5c-bb4c2cf5919b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:36.228254 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ffd4b38d-d4fe-4a39-ba5c-bb4c2cf5919b None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:36.229442 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ffd4b38d-d4fe-4a39-ba5c-bb4c2cf5919b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:36.259190 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:36.297705 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 641/1289] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:14:36.320593 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cebee-c0a9-4057-8d19-e9103c7633bf None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:36.422231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cebee-c0a9-4057-8d19-e9103c7633bf None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:36.432903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:36.456661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffaf47-33e8-47ba-846f-fe61afdbe5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:36.457382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffaf47-33e8-47ba-846f-fe61afdbe5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:36.457669 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffaf47-33e8-47ba-846f-fe61afdbe5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:36.457950 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffaf47-33e8-47ba-846f-fe61afdbe5a4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:36.458653 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffaf47-33e8-47ba-846f-fe61afdbe5a4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:36.460011 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffaf47-33e8-47ba-846f-fe61afdbe5a4 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:36.475748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-7dffaf47-33e8-47ba-846f-fe61afdbe5a4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:14:36.475748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:36.475748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:14:36.475748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:14:36.475748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:14:36.475748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:14:36.475748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:14:36.475748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:14:36.475748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:14:36.475748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:36.475748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:14:36.475748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:36.475748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:36.475748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:36.475748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:36.475748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:36.475748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:36.477115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:36.477115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:36.477115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:36.477115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:36.477115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:36.477115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:36.477115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:14:36.477115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:14:36.477115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:14:36.477115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:14:36.477115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:36.477115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:36.477115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:36.477115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:36.477115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:36.477115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:36.478923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:36.478923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:36.478923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:36.478923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:36.478923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:36.478923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:36.478923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:36.478923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:36.478923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:36.478923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:36.478923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:14:36.478923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:14:36.478923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:14:36.478923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:36.478923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 649/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jul 20 19:14:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:36.493506 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4b38d-d4fe-4a39-ba5c-bb4c2cf5919b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:36.603140 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4b38d-d4fe-4a39-ba5c-bb4c2cf5919b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:36.636458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1a3dc-d412-4041-af06-0a5c306c6eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:36.637114 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1a3dc-d412-4041-af06-0a5c306c6eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:36.637400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1a3dc-d412-4041-af06-0a5c306c6eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:36.637679 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1a3dc-d412-4041-af06-0a5c306c6eb7 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:36.638408 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1a3dc-d412-4041-af06-0a5c306c6eb7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:36.638719 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1a3dc-d412-4041-af06-0a5c306c6eb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:36.640109 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1a3dc-d412-4041-af06-0a5c306c6eb7 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:36.644934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 642/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Jul 20 19:14:36 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:36.651294 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffaf47-33e8-47ba-846f-fe61afdbe5a4 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:36.749689 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffaf47-33e8-47ba-846f-fe61afdbe5a4 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:36.783479 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e2b30-e287-477d-bd78-d8b4f2002591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:36.784136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e2b30-e287-477d-bd78-d8b4f2002591 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:36.784420 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e2b30-e287-477d-bd78-d8b4f2002591 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:36.784697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e2b30-e287-477d-bd78-d8b4f2002591 None admin] PATH_INFO: `/v3/services` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:36.785403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e2b30-e287-477d-bd78-d8b4f2002591 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:36.785709 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e2b30-e287-477d-bd78-d8b4f2002591 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:36.787113 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e2b30-e287-477d-bd78-d8b4f2002591 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:36.792052 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 650/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Jul 20 19:14:36 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:38.836373 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcfe55-7444-4b12-829e-bd40f395406b None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:38.836884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcfe55-7444-4b12-829e-bd40f395406b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:38.836884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcfe55-7444-4b12-829e-bd40f395406b None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:38.838224 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 643/1293] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:38.843517 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba252f-ada6-4e8a-ad9b-baf8f17847aa None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:38.843931 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba252f-ada6-4e8a-ad9b-baf8f17847aa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:38.844084 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba252f-ada6-4e8a-ad9b-baf8f17847aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:38.861909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0aba252f-ada6-4e8a-ad9b-baf8f17847aa None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:38.863146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0aba252f-ada6-4e8a-ad9b-baf8f17847aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:38.892314 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:38.931593 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 651/1294] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:14:38.953864 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcfe55-7444-4b12-829e-bd40f395406b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:38.991100 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:39.063017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcfe55-7444-4b12-829e-bd40f395406b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:39.096669 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6206b-6c4b-47d7-8ef4-f50cdc11b889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:39.097252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6206b-6c4b-47d7-8ef4-f50cdc11b889 None admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:39.097539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6206b-6c4b-47d7-8ef4-f50cdc11b889 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:39.097820 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6206b-6c4b-47d7-8ef4-f50cdc11b889 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:39.098574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6206b-6c4b-47d7-8ef4-f50cdc11b889 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:39.099943 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6206b-6c4b-47d7-8ef4-f50cdc11b889 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:39.114026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 644/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Jul 20 19:14:38 2022] POST /identity/v3/services => generated 246 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:14:41.199223 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03dee3-76a3-407e-b386-30b476dab78d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:41.199769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03dee3-76a3-407e-b386-30b476dab78d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:41.199769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03dee3-76a3-407e-b386-30b476dab78d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:41.201164 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 652/1296] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:41.206277 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cf461-c919-4842-bd30-7aed64a3fe43 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:41.206729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cf461-c919-4842-bd30-7aed64a3fe43 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:41.206886 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cf461-c919-4842-bd30-7aed64a3fe43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:41.227944 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e41cf461-c919-4842-bd30-7aed64a3fe43 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:41.229172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e41cf461-c919-4842-bd30-7aed64a3fe43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:41.306410 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 645/1297] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:41 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:14:41.329764 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03dee3-76a3-407e-b386-30b476dab78d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:41.432163 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03dee3-76a3-407e-b386-30b476dab78d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:41.465586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d599d-833d-4d94-9467-68363e6f58a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:41.466331 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d599d-833d-4d94-9467-68363e6f58a2 None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:41.466624 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d599d-833d-4d94-9467-68363e6f58a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:41.466907 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d599d-833d-4d94-9467-68363e6f58a2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:41.467563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d599d-833d-4d94-9467-68363e6f58a2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:41.468926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d599d-833d-4d94-9467-68363e6f58a2 None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:41.480983 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-906d599d-833d-4d94-9467-68363e6f58a2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:14:41.480983 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:41.480983 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:14:41.480983 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:14:41.480983 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:14:41.480983 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:14:41.480983 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:14:41.480983 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:14:41.480983 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:14:41.480983 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:41.480983 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:14:41.480983 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:41.480983 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:41.480983 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:41.480983 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:41.480983 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:41.480983 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:41.482240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:41.482240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:41.482240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:41.482240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:41.482240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:41.482240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:41.482240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:14:41.482240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:14:41.482240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:14:41.482240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:14:41.482240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:41.482240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:41.482240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:41.482240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:41.482240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:41.482240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:41.483193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:41.483193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:41.483193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:41.483193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:41.483193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:41.483193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:41.483193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:41.483193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:41.483193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:41.483193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:41.483193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:14:41.483193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:14:41.483193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:14:41.483193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:41.483193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 653/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jul 20 19:14:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:41.488633 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cf461-c919-4842-bd30-7aed64a3fe43 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:41.507095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:41.601988 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cf461-c919-4842-bd30-7aed64a3fe43 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:41.635958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e59153-c0d8-4197-82fd-9d87fe9120bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:41.636760 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e59153-c0d8-4197-82fd-9d87fe9120bd None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:41.637042 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e59153-c0d8-4197-82fd-9d87fe9120bd None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:41.637317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e59153-c0d8-4197-82fd-9d87fe9120bd None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:41.638132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e59153-c0d8-4197-82fd-9d87fe9120bd None admin] RBAC: Adding query filter params (name=placement) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:41.638476 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e59153-c0d8-4197-82fd-9d87fe9120bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:41.639972 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e59153-c0d8-4197-82fd-9d87fe9120bd None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:41.645139 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 646/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Jul 20 19:14:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:41.651204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d599d-833d-4d94-9467-68363e6f58a2 None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:41.682855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:41.753032 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d599d-833d-4d94-9467-68363e6f58a2 None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:41.786044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fcf3f-01bc-4202-9bcd-d793fa0134ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:41.786734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fcf3f-01bc-4202-9bcd-d793fa0134ae None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:41.787015 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fcf3f-01bc-4202-9bcd-d793fa0134ae None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:41.787291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fcf3f-01bc-4202-9bcd-d793fa0134ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:41.788077 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fcf3f-01bc-4202-9bcd-d793fa0134ae None admin] RBAC: Adding query filter params (interface=public, service_id=a28e730c8db54233816d7ceb4407cfa4, region_id=RegionOne) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:41.788386 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fcf3f-01bc-4202-9bcd-d793fa0134ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:41.790246 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079fcf3f-01bc-4202-9bcd-d793fa0134ae None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:41.795296 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 654/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Jul 20 19:14:41 2022] GET /identity/v3/endpoints?service_id=a28e730c8db54233816d7ceb4407cfa4&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:41.800963 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e59153-c0d8-4197-82fd-9d87fe9120bd None admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:41.880902 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:41.898651 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e59153-c0d8-4197-82fd-9d87fe9120bd None admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:41.933220 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3457b2-415a-43f9-a9f7-70b2e3efee4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:41.933883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3457b2-415a-43f9-a9f7-70b2e3efee4e None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:41.934167 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3457b2-415a-43f9-a9f7-70b2e3efee4e None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:41.934473 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3457b2-415a-43f9-a9f7-70b2e3efee4e None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:41.935157 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3457b2-415a-43f9-a9f7-70b2e3efee4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:41.936534 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3457b2-415a-43f9-a9f7-70b2e3efee4e None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:41.943316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 647/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Jul 20 19:14:41 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:14:44.013372 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6f531-51a8-4934-85d6-35e9de144a64 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:44.014005 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6f531-51a8-4934-85d6-35e9de144a64 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:44.014120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6f531-51a8-4934-85d6-35e9de144a64 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:44.015576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 655/1302] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:14:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:14:44.021988 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfa765-7bea-4675-8886-10b4d1371033 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:44.022445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfa765-7bea-4675-8886-10b4d1371033 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:44.023313 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfa765-7bea-4675-8886-10b4d1371033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:44.042408 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-04cfa765-7bea-4675-8886-10b4d1371033 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:14:44.043616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-04cfa765-7bea-4675-8886-10b4d1371033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:14:44.123516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 648/1303] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:14:44 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 19:14:44.146935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6f531-51a8-4934-85d6-35e9de144a64 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:44.242470 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:44.249488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6f531-51a8-4934-85d6-35e9de144a64 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:44.283733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afddda4-d27b-44a6-b3b7-0fbe2daf889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:44.284462 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afddda4-d27b-44a6-b3b7-0fbe2daf889e None admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:44.284748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afddda4-d27b-44a6-b3b7-0fbe2daf889e None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:44.285024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afddda4-d27b-44a6-b3b7-0fbe2daf889e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:44.285675 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afddda4-d27b-44a6-b3b7-0fbe2daf889e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:44.287076 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afddda4-d27b-44a6-b3b7-0fbe2daf889e None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:44.299779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application [None req-3afddda4-d27b-44a6-b3b7-0fbe2daf889e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:14:44.299779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:44.299779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 19:14:44.299779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 19:14:44.299779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 19:14:44.299779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 19:14:44.299779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 19:14:44.299779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:14:44.299779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:14:44.299779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:44.299779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 19:14:44.299779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:44.299779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 19:14:44.299779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 19:14:44.299779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 19:14:44.299779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 19:14:44.299779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 19:14:44.301459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 19:14:44.301459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 19:14:44.301459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 19:14:44.301459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 19:14:44.301459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 19:14:44.301459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 19:14:44.301459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 19:14:44.301459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 19:14:44.301459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 19:14:44.301459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 19:14:44.301459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 19:14:44.301459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 19:14:44.301459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 19:14:44.301459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 19:14:44.301459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 19:14:44.301459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 19:14:44.302900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 19:14:44.302900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application with Lock( Jul 20 19:14:44.302900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 19:14:44.302900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self._enter() Jul 20 19:14:44.302900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 19:14:44.302900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 19:14:44.302900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 19:14:44.302900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application return self.creator() Jul 20 19:14:44.302900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 19:14:44.302900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application created_value = creator( Jul 20 19:14:44.302900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 19:14:44.302900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 19:14:44.302900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 19:14:44.302900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: ERROR keystone.server.flask.application Jul 20 19:14:44.302900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 656/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Jul 20 19:14:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 19:14:44.308767 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfa765-7bea-4675-8886-10b4d1371033 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:44.390352 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:44.416306 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfa765-7bea-4675-8886-10b4d1371033 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:44.454374 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1e96d-8a40-4043-a402-e70c9b227309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:44.455179 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1e96d-8a40-4043-a402-e70c9b227309 None admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:44.455497 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1e96d-8a40-4043-a402-e70c9b227309 None admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:44.455780 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1e96d-8a40-4043-a402-e70c9b227309 None admin] PATH_INFO: `/v3/services` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:44.456580 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1e96d-8a40-4043-a402-e70c9b227309 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:14:44.456924 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1e96d-8a40-4043-a402-e70c9b227309 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:44.458587 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1e96d-8a40-4043-a402-e70c9b227309 None admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:44.464361 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 649/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Jul 20 19:14:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:14:44.470645 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afddda4-d27b-44a6-b3b7-0fbe2daf889e None admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:14:44.572545 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afddda4-d27b-44a6-b3b7-0fbe2daf889e None admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:14:44.606872 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee188c5-44b2-4cfd-9a5b-173ffc3d3e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:14:44.607530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee188c5-44b2-4cfd-9a5b-173ffc3d3e6c None admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:14:44.607819 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee188c5-44b2-4cfd-9a5b-173ffc3d3e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:14:44.608097 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee188c5-44b2-4cfd-9a5b-173ffc3d3e6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:14:44.608848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee188c5-44b2-4cfd-9a5b-173ffc3d3e6c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:14:44.610212 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee188c5-44b2-4cfd-9a5b-173ffc3d3e6c None admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:14:44.629646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 657/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Jul 20 19:14:44 2022] POST /identity/v3/endpoints => generated 331 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:14:54.461089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=30 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:14:54.625141 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:49.295054 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766a9f4-c3c8-4965-9c8b-9b444051bb7f None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:49.295538 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766a9f4-c3c8-4965-9c8b-9b444051bb7f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:49.295538 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766a9f4-c3c8-4965-9c8b-9b444051bb7f None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:49.297268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 650/1307] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:49.304342 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b36b4-6928-4f70-b284-5ddf38fbc5d9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:49.304801 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b36b4-6928-4f70-b284-5ddf38fbc5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:49.304801 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b36b4-6928-4f70-b284-5ddf38fbc5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:49.402892 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d27b36b4-6928-4f70-b284-5ddf38fbc5d9 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:49.404120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d27b36b4-6928-4f70-b284-5ddf38fbc5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:49.536061 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 658/1308] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:15:49.586167 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b74d7-020f-410c-b9a8-a7ac216bd222 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:49.586629 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b74d7-020f-410c-b9a8-a7ac216bd222 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:49.586925 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b74d7-020f-410c-b9a8-a7ac216bd222 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:49.588420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 651/1309] 10.222.0.18 () {54 vars in 965 bytes} [Wed Jul 20 19:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:15:49.594561 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e28907-bff3-4569-a7e4-48499d4ba803 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:49.594941 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e28907-bff3-4569-a7e4-48499d4ba803 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:49.595316 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e28907-bff3-4569-a7e4-48499d4ba803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:49.683389 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d1e28907-bff3-4569-a7e4-48499d4ba803 None None] MFA Rules not processed for user `0c7b88e083d04718bf19d982724babd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:49.684530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d1e28907-bff3-4569-a7e4-48499d4ba803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:49.708585 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:49.783456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 659/1310] 10.222.0.18 () {58 vars in 1062 bytes} [Wed Jul 20 19:15:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:15:49.793568 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b74d7-020f-410c-b9a8-a7ac216bd222 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:49.795513 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4b2b74d7-020f-410c-b9a8-a7ac216bd222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:49.956268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b74d7-020f-410c-b9a8-a7ac216bd222 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:50.042092 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a3f99-5b3c-4467-bc36-a9b8bbd64ecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:50.042800 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a3f99-5b3c-4467-bc36-a9b8bbd64ecd service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:50.043092 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a3f99-5b3c-4467-bc36-a9b8bbd64ecd service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:50.043376 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a3f99-5b3c-4467-bc36-a9b8bbd64ecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:50.045055 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-fe5a3f99-5b3c-4467-bc36-a9b8bbd64ecd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:50.112322 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:50.188293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a3f99-5b3c-4467-bc36-a9b8bbd64ecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:50.189714 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a3f99-5b3c-4467-bc36-a9b8bbd64ecd service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:50.215979 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 652/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:15:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:15:52.578931 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161a6ba-ff46-4631-9d91-e0f328c38e39 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:52.579397 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161a6ba-ff46-4631-9d91-e0f328c38e39 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:52.579479 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161a6ba-ff46-4631-9d91-e0f328c38e39 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:52.586411 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd3600-6148-464f-ab6c-d8a9ade0d2fa None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:52.586835 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd3600-6148-464f-ab6c-d8a9ade0d2fa None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:52.586980 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd3600-6148-464f-ab6c-d8a9ade0d2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:52.589719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 660/1312] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:15:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:52.661440 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1dfd3600-6148-464f-ab6c-d8a9ade0d2fa None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:52.662684 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1dfd3600-6148-464f-ab6c-d8a9ade0d2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:52.762477 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 653/1313] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:15:52.801895 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161a6ba-ff46-4631-9d91-e0f328c38e39 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:52.803476 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b161a6ba-ff46-4631-9d91-e0f328c38e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:52.910427 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161a6ba-ff46-4631-9d91-e0f328c38e39 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:52.983032 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:52.985771 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ea5c6-c8e2-4925-9676-f472660ad450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:52.986640 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ea5c6-c8e2-4925-9676-f472660ad450 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:52.987095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ea5c6-c8e2-4925-9676-f472660ad450 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:52.988065 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ea5c6-c8e2-4925-9676-f472660ad450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:52.989794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-309ea5c6-c8e2-4925-9676-f472660ad450 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:53.113158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ea5c6-c8e2-4925-9676-f472660ad450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:53.114616 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ea5c6-c8e2-4925-9676-f472660ad450 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:53.134008 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 661/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:15:55.551301 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6093d-fcc1-4fc5-b1b3-401417fca69e None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:55.551897 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6093d-fcc1-4fc5-b1b3-401417fca69e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:55.551897 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6093d-fcc1-4fc5-b1b3-401417fca69e None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:55.553245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 654/1315] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:15:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:55.558447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69049b06-a907-4301-98da-b2f3a8fc4a9f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:55.558882 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69049b06-a907-4301-98da-b2f3a8fc4a9f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:55.559010 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69049b06-a907-4301-98da-b2f3a8fc4a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:55.626207 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-69049b06-a907-4301-98da-b2f3a8fc4a9f None None] MFA Rules not processed for user `22ebe6448aef4c2db9814012429e92af`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:55.627467 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-69049b06-a907-4301-98da-b2f3a8fc4a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:55.679138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:55.722520 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 662/1316] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:55 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:15:55.762424 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6093d-fcc1-4fc5-b1b3-401417fca69e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:55.763966 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d6a6093d-fcc1-4fc5-b1b3-401417fca69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:55.773945 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:55.868611 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6093d-fcc1-4fc5-b1b3-401417fca69e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:55.943734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55bbd2-a253-4333-9aed-cadea2397198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:55.944384 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55bbd2-a253-4333-9aed-cadea2397198 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:55.944667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55bbd2-a253-4333-9aed-cadea2397198 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:55.944942 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55bbd2-a253-4333-9aed-cadea2397198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:55.946626 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-eb55bbd2-a253-4333-9aed-cadea2397198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:56.013126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:56.064440 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55bbd2-a253-4333-9aed-cadea2397198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:56.066259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55bbd2-a253-4333-9aed-cadea2397198 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:56.085731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 655/1317] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:15:55 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:15:58.712739 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc9eb0-0691-4066-a19b-289836541233 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:58.713312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc9eb0-0691-4066-a19b-289836541233 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:58.713312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc9eb0-0691-4066-a19b-289836541233 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:58.714837 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 663/1318] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:58.720214 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9413dba-9e90-4f3a-b0a2-b566a1efba74 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:58.720609 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9413dba-9e90-4f3a-b0a2-b566a1efba74 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:58.720778 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9413dba-9e90-4f3a-b0a2-b566a1efba74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:58.786717 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c9413dba-9e90-4f3a-b0a2-b566a1efba74 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:58.787964 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c9413dba-9e90-4f3a-b0a2-b566a1efba74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:58.890407 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 656/1319] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:15:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:15:58.946924 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50272cdf-b8df-4c97-bd53-249301eff4e2 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:58.947224 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50272cdf-b8df-4c97-bd53-249301eff4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:58.947494 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50272cdf-b8df-4c97-bd53-249301eff4e2 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:58.948871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 664/1320] 10.222.0.18 () {54 vars in 965 bytes} [Wed Jul 20 19:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:15:58.955022 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9c440-a49e-402d-a33e-ec03e35d0abb None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:58.955315 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9c440-a49e-402d-a33e-ec03e35d0abb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:58.955596 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9c440-a49e-402d-a33e-ec03e35d0abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:58.979848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:59.035817 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-afe9c440-a49e-402d-a33e-ec03e35d0abb None None] MFA Rules not processed for user `0c7b88e083d04718bf19d982724babd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:15:59.037032 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-afe9c440-a49e-402d-a33e-ec03e35d0abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:59.112655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 657/1321] 10.222.0.18 () {58 vars in 1062 bytes} [Wed Jul 20 19:15:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:15:59.121734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50272cdf-b8df-4c97-bd53-249301eff4e2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:15:59.123113 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-50272cdf-b8df-4c97-bd53-249301eff4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:59.231516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50272cdf-b8df-4c97-bd53-249301eff4e2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:15:59.305566 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59be78-132b-4e47-a87c-56f9254e33f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:15:59.306209 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59be78-132b-4e47-a87c-56f9254e33f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:15:59.306522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59be78-132b-4e47-a87c-56f9254e33f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:15:59.306796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59be78-132b-4e47-a87c-56f9254e33f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:15:59.308461 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-de59be78-132b-4e47-a87c-56f9254e33f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:15:59.315741 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:15:59.416422 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59be78-132b-4e47-a87c-56f9254e33f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:15:59.417857 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59be78-132b-4e47-a87c-56f9254e33f7 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:15:59.439308 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 665/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:15:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:02.648355 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19a1d4-36e6-487c-a213-0592d835ecab None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:02.648948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19a1d4-36e6-487c-a213-0592d835ecab None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:02.648948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19a1d4-36e6-487c-a213-0592d835ecab None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:02.650475 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 658/1323] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:16:02.655683 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efe93c-4d78-4ff9-a889-f041215b8cbb None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:02.656174 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efe93c-4d78-4ff9-a889-f041215b8cbb None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:02.656282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34efe93c-4d78-4ff9-a889-f041215b8cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:02.724020 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-34efe93c-4d78-4ff9-a889-f041215b8cbb None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:02.725294 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-34efe93c-4d78-4ff9-a889-f041215b8cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:02.786480 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:02.833475 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 666/1324] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:02.871376 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19a1d4-36e6-487c-a213-0592d835ecab None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:02.873184 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5a19a1d4-36e6-487c-a213-0592d835ecab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:03.021361 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19a1d4-36e6-487c-a213-0592d835ecab None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:03.035557 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:03.101833 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a110a-1c66-4d0c-ba76-621a906a282c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:03.102420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a110a-1c66-4d0c-ba76-621a906a282c service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:03.102702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a110a-1c66-4d0c-ba76-621a906a282c service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:03.102976 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a110a-1c66-4d0c-ba76-621a906a282c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:03.104763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1f3a110a-1c66-4d0c-ba76-621a906a282c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:03.219909 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a110a-1c66-4d0c-ba76-621a906a282c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:03.221861 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a110a-1c66-4d0c-ba76-621a906a282c service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:03.240964 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 659/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:05.386142 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fafac-58cf-4e24-b3b5-accfda6f90f6 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:05.386748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fafac-58cf-4e24-b3b5-accfda6f90f6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:05.386843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fafac-58cf-4e24-b3b5-accfda6f90f6 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:05.388334 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 667/1326] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:05.393714 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eaebc3-1c07-4b4b-9e10-e2c734582f12 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:05.394177 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eaebc3-1c07-4b4b-9e10-e2c734582f12 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:05.394288 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eaebc3-1c07-4b4b-9e10-e2c734582f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:05.444752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:05.464811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-13eaebc3-1c07-4b4b-9e10-e2c734582f12 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:05.466036 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-13eaebc3-1c07-4b4b-9e10-e2c734582f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:05.573247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 660/1327] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:05.611732 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fafac-58cf-4e24-b3b5-accfda6f90f6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:05.614821 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-606fafac-58cf-4e24-b3b5-accfda6f90f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:05.726822 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fafac-58cf-4e24-b3b5-accfda6f90f6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:05.808535 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df66c9-af37-45cd-8b94-6939f11ca7d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:05.809199 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df66c9-af37-45cd-8b94-6939f11ca7d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:05.809482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df66c9-af37-45cd-8b94-6939f11ca7d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:05.809756 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df66c9-af37-45cd-8b94-6939f11ca7d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:05.811519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-50df66c9-af37-45cd-8b94-6939f11ca7d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:05.828638 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:05.934031 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df66c9-af37-45cd-8b94-6939f11ca7d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:05.935505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df66c9-af37-45cd-8b94-6939f11ca7d7 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:05.954688 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 668/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:08.115632 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda52f7-953f-4d5d-8996-5e0c64176bac None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:08.116207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda52f7-953f-4d5d-8996-5e0c64176bac None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:08.116207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda52f7-953f-4d5d-8996-5e0c64176bac None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:08.117608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 661/1329] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:08.122998 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6adc95-1d73-4bc8-8f2d-0cf278cafaf8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:08.123396 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6adc95-1d73-4bc8-8f2d-0cf278cafaf8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:08.123694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6adc95-1d73-4bc8-8f2d-0cf278cafaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:08.194953 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2f6adc95-1d73-4bc8-8f2d-0cf278cafaf8 None None] MFA Rules not processed for user `22ebe6448aef4c2db9814012429e92af`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:08.195950 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2f6adc95-1d73-4bc8-8f2d-0cf278cafaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:08.261489 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:08.297409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 669/1330] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:08 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:16:08.335604 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda52f7-953f-4d5d-8996-5e0c64176bac None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:08.337147 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3fda52f7-953f-4d5d-8996-5e0c64176bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:08.440219 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda52f7-953f-4d5d-8996-5e0c64176bac None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:08.461642 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:08.522470 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c76e1-75be-4854-b7a1-fd5ba01a31b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:08.523413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c76e1-75be-4854-b7a1-fd5ba01a31b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:08.523934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c76e1-75be-4854-b7a1-fd5ba01a31b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:08.524224 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c76e1-75be-4854-b7a1-fd5ba01a31b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:08.525869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9f8c76e1-75be-4854-b7a1-fd5ba01a31b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:08.638143 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c76e1-75be-4854-b7a1-fd5ba01a31b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:08.639677 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c76e1-75be-4854-b7a1-fd5ba01a31b4 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:08.660697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 662/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:11.053141 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4b279-d70c-48d2-8073-4c76c06dd44c None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:11.053760 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4b279-d70c-48d2-8073-4c76c06dd44c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:11.053760 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4b279-d70c-48d2-8073-4c76c06dd44c None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:11.056432 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 670/1332] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:16:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:11.061292 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23bd04-0b17-48d6-ac0f-f6afa15fde87 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:11.061727 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23bd04-0b17-48d6-ac0f-f6afa15fde87 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:11.061840 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23bd04-0b17-48d6-ac0f-f6afa15fde87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:11.123272 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:11.125905 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3c23bd04-0b17-48d6-ac0f-f6afa15fde87 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:11.128307 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3c23bd04-0b17-48d6-ac0f-f6afa15fde87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:11.227935 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 663/1333] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:11.263576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4b279-d70c-48d2-8073-4c76c06dd44c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:11.265110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-06c4b279-d70c-48d2-8073-4c76c06dd44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:11.401236 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4b279-d70c-48d2-8073-4c76c06dd44c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:11.492518 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0395f-eabe-4f8b-9252-c4978767f272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:11.493160 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0395f-eabe-4f8b-9252-c4978767f272 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:11.493437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0395f-eabe-4f8b-9252-c4978767f272 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:11.493709 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0395f-eabe-4f8b-9252-c4978767f272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:11.495370 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bee0395f-eabe-4f8b-9252-c4978767f272 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:11.524502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:11.610068 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0395f-eabe-4f8b-9252-c4978767f272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:11.611532 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0395f-eabe-4f8b-9252-c4978767f272 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:11.629508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 671/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:13.759700 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd47d5-874a-4706-944a-6a5fa4f3138e None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:13.760252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd47d5-874a-4706-944a-6a5fa4f3138e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:13.760252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd47d5-874a-4706-944a-6a5fa4f3138e None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:13.761678 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 664/1335] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:13.766870 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36d562-bf9f-43ae-b658-ab97a3074623 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:13.767290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36d562-bf9f-43ae-b658-ab97a3074623 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:13.767465 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36d562-bf9f-43ae-b658-ab97a3074623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:13.831407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bc36d562-bf9f-43ae-b658-ab97a3074623 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:13.832550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bc36d562-bf9f-43ae-b658-ab97a3074623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:13.905428 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:13.928218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 672/1336] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:13.968478 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd47d5-874a-4706-944a-6a5fa4f3138e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:13.970019 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5afd47d5-874a-4706-944a-6a5fa4f3138e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:14.080645 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd47d5-874a-4706-944a-6a5fa4f3138e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:14.111968 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:14.159922 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca5363-586f-4202-841f-4a1a7c95d8d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:14.160855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca5363-586f-4202-841f-4a1a7c95d8d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:14.161311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca5363-586f-4202-841f-4a1a7c95d8d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:14.161739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca5363-586f-4202-841f-4a1a7c95d8d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:14.164175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-28ca5363-586f-4202-841f-4a1a7c95d8d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:14.279048 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca5363-586f-4202-841f-4a1a7c95d8d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:14.280523 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca5363-586f-4202-841f-4a1a7c95d8d0 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:14.298608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 665/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:16.717281 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628e6ce-0776-4904-97f0-b2df5debabfa None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:16.717849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628e6ce-0776-4904-97f0-b2df5debabfa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:16.717849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628e6ce-0776-4904-97f0-b2df5debabfa None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:16.719228 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 673/1338] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:16.725757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f59fd-6299-4a52-b51a-ddf6bedc012a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:16.726240 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f59fd-6299-4a52-b51a-ddf6bedc012a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:16.726361 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f59fd-6299-4a52-b51a-ddf6bedc012a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:16.793884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-da7f59fd-6299-4a52-b51a-ddf6bedc012a None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:16.795145 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-da7f59fd-6299-4a52-b51a-ddf6bedc012a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:16.804507 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:16.900575 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 666/1339] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:16.945721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628e6ce-0776-4904-97f0-b2df5debabfa None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:16.947411 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7628e6ce-0776-4904-97f0-b2df5debabfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:17.059146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628e6ce-0776-4904-97f0-b2df5debabfa None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:17.137658 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747ab4a-78e2-4c6e-9ffb-cd4f69f538dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:17.138330 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747ab4a-78e2-4c6e-9ffb-cd4f69f538dd service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:17.138614 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747ab4a-78e2-4c6e-9ffb-cd4f69f538dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:17.138888 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747ab4a-78e2-4c6e-9ffb-cd4f69f538dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:17.140560 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8747ab4a-78e2-4c6e-9ffb-cd4f69f538dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:17.181171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:17.260810 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747ab4a-78e2-4c6e-9ffb-cd4f69f538dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:17.262252 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747ab4a-78e2-4c6e-9ffb-cd4f69f538dd service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:17.284216 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 674/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:21.479898 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9f1c9-6ab6-49e8-8d69-7596845753ef None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:21.480419 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9f1c9-6ab6-49e8-8d69-7596845753ef None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:21.480508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9f1c9-6ab6-49e8-8d69-7596845753ef None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:21.482060 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 667/1341] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:21.487756 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d8ff3-ffaa-4cf0-ac32-18d8d5f3ed84 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:21.488224 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d8ff3-ffaa-4cf0-ac32-18d8d5f3ed84 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:21.488322 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d8ff3-ffaa-4cf0-ac32-18d8d5f3ed84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:21.554995 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1b7d8ff3-ffaa-4cf0-ac32-18d8d5f3ed84 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:21.556137 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1b7d8ff3-ffaa-4cf0-ac32-18d8d5f3ed84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:21.644467 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:21.656446 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 675/1342] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:21.696858 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9f1c9-6ab6-49e8-8d69-7596845753ef None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:21.698431 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-04d9f1c9-6ab6-49e8-8d69-7596845753ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:21.803982 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9f1c9-6ab6-49e8-8d69-7596845753ef None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:21.843080 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:21.880760 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d9f6d-f146-45ed-bad6-35a60ad88b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:21.881444 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d9f6d-f146-45ed-bad6-35a60ad88b75 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:21.881728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d9f6d-f146-45ed-bad6-35a60ad88b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:21.882004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d9f6d-f146-45ed-bad6-35a60ad88b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:21.883700 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2e2d9f6d-f146-45ed-bad6-35a60ad88b75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:21.995681 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d9f6d-f146-45ed-bad6-35a60ad88b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:21.997117 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d9f6d-f146-45ed-bad6-35a60ad88b75 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:22.015215 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 668/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:24.840337 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdcf24-c099-4e74-9182-21d1abd6effe None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:24.840849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdcf24-c099-4e74-9182-21d1abd6effe None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:24.840943 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdcf24-c099-4e74-9182-21d1abd6effe None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:24.842345 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 676/1344] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:24.848427 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260070b6-f2ac-44d3-ae57-25213a150668 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:24.848924 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260070b6-f2ac-44d3-ae57-25213a150668 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:24.849133 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260070b6-f2ac-44d3-ae57-25213a150668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:24.914174 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-260070b6-f2ac-44d3-ae57-25213a150668 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:24.915350 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-260070b6-f2ac-44d3-ae57-25213a150668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:24.934050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:25.018414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 669/1345] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:25.057225 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdcf24-c099-4e74-9182-21d1abd6effe None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:25.058775 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-defdcf24-c099-4e74-9182-21d1abd6effe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:25.174711 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdcf24-c099-4e74-9182-21d1abd6effe None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:25.256423 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2860c4d-f54e-4c26-8661-9ce0efb3a950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:25.257068 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2860c4d-f54e-4c26-8661-9ce0efb3a950 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:25.257346 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2860c4d-f54e-4c26-8661-9ce0efb3a950 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:25.257617 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2860c4d-f54e-4c26-8661-9ce0efb3a950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:25.259290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b2860c4d-f54e-4c26-8661-9ce0efb3a950 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:25.303564 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:25.375054 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2860c4d-f54e-4c26-8661-9ce0efb3a950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:25.376590 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2860c4d-f54e-4c26-8661-9ce0efb3a950 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:25.396504 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 677/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:29.704936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badc366-391c-4f1a-a735-b474d8855d03 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:29.705492 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badc366-391c-4f1a-a735-b474d8855d03 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:29.705492 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badc366-391c-4f1a-a735-b474d8855d03 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:29.706912 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 670/1347] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:16:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:29.712379 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe7bcd-a7f3-4756-acc0-4c878c0d85db None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:29.712872 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe7bcd-a7f3-4756-acc0-4c878c0d85db None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:29.712990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe7bcd-a7f3-4756-acc0-4c878c0d85db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:29.783700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-41fe7bcd-a7f3-4756-acc0-4c878c0d85db None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:29.784927 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-41fe7bcd-a7f3-4756-acc0-4c878c0d85db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:29.882763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:29.886293 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 678/1348] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:29.925395 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badc366-391c-4f1a-a735-b474d8855d03 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:29.927109 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3badc366-391c-4f1a-a735-b474d8855d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:30.033652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badc366-391c-4f1a-a735-b474d8855d03 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:30.080515 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:30.106461 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8f917-807d-4c7b-a547-ac0b9cad2483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:30.107108 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8f917-807d-4c7b-a547-ac0b9cad2483 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:30.107393 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8f917-807d-4c7b-a547-ac0b9cad2483 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:30.107670 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8f917-807d-4c7b-a547-ac0b9cad2483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:30.109303 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9ff8f917-807d-4c7b-a547-ac0b9cad2483 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:30.217746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8f917-807d-4c7b-a547-ac0b9cad2483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:30.219171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff8f917-807d-4c7b-a547-ac0b9cad2483 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:30.236978 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 671/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:35.253428 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca939ce-9c59-4387-9cc0-08861f55d113 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:35.253959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca939ce-9c59-4387-9cc0-08861f55d113 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:35.253959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca939ce-9c59-4387-9cc0-08861f55d113 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:35.279400 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 679/1350] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 20 19:16:35 2022] GET /identity => generated 270 bytes in 27 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:35.296176 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc524d8-68cf-4bf9-94d0-a0aa8c8a4a8f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:35.296733 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc524d8-68cf-4bf9-94d0-a0aa8c8a4a8f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:35.296909 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc524d8-68cf-4bf9-94d0-a0aa8c8a4a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:35.411680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-afc524d8-68cf-4bf9-94d0-a0aa8c8a4a8f None None] MFA Rules not processed for user `d310799ac43e42bc9c7810e1296ddb9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:35.413195 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-afc524d8-68cf-4bf9-94d0-a0aa8c8a4a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:35.432181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:35.545453 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 672/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 20 19:16:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:39.624789 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcda21f-c3c7-4416-a5ae-eba4ce6e70ab None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:39.625317 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcda21f-c3c7-4416-a5ae-eba4ce6e70ab None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:39.625317 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcda21f-c3c7-4416-a5ae-eba4ce6e70ab None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:39.627465 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 680/1352] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 20 19:16:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:39.633178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cbe6c-eb78-4561-b55f-0e86593dceb6 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:39.634190 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cbe6c-eb78-4561-b55f-0e86593dceb6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:39.634190 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cbe6c-eb78-4561-b55f-0e86593dceb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:39.749909 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e20cbe6c-eb78-4561-b55f-0e86593dceb6 None None] MFA Rules not processed for user `d310799ac43e42bc9c7810e1296ddb9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:39.751785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e20cbe6c-eb78-4561-b55f-0e86593dceb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:39.858514 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:39.909167 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 673/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 20 19:16:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:41.424290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a2da8-6a9b-49d8-aae8-450412d15e6b None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:41.424828 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a2da8-6a9b-49d8-aae8-450412d15e6b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:41.424828 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a2da8-6a9b-49d8-aae8-450412d15e6b None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:41.426184 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 681/1354] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 20 19:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:41.431489 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc4a67-83c7-40f1-bb17-13a2a05c9b34 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:41.432256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc4a67-83c7-40f1-bb17-13a2a05c9b34 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:41.432768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc4a67-83c7-40f1-bb17-13a2a05c9b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:41.512618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6dbc4a67-83c7-40f1-bb17-13a2a05c9b34 None None] MFA Rules not processed for user `d310799ac43e42bc9c7810e1296ddb9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:41.513822 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6dbc4a67-83c7-40f1-bb17-13a2a05c9b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:41.637007 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 674/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 20 19:16:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:16:45.091382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191b34c-1b8a-4f86-ae01-c922654e5645 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:45.091923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191b34c-1b8a-4f86-ae01-c922654e5645 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:45.091923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191b34c-1b8a-4f86-ae01-c922654e5645 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:45.093828 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 682/1356] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:45.100278 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b38c3-1773-41a4-962a-3056af7288c8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:45.101087 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b38c3-1773-41a4-962a-3056af7288c8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:45.101526 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b38c3-1773-41a4-962a-3056af7288c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:45.149121 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:45.184757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6f4b38c3-1773-41a4-962a-3056af7288c8 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:45.186160 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6f4b38c3-1773-41a4-962a-3056af7288c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:45.300176 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 675/1357] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:45.355869 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d0465-b393-4e31-88ee-b4dd462c2b4a None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:45.356459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d0465-b393-4e31-88ee-b4dd462c2b4a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:45.357050 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d0465-b393-4e31-88ee-b4dd462c2b4a None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:45.359866 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 683/1358] 10.222.0.18 () {54 vars in 962 bytes} [Wed Jul 20 19:16:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:45.371459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570614bc-1b10-440f-8f5c-a7cf84bad436 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:45.372760 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570614bc-1b10-440f-8f5c-a7cf84bad436 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:45.373284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570614bc-1b10-440f-8f5c-a7cf84bad436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:45.470630 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-570614bc-1b10-440f-8f5c-a7cf84bad436 None None] MFA Rules not processed for user `a1f0f6bc94de4645a8c82038ff2bd34a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:45.472234 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-570614bc-1b10-440f-8f5c-a7cf84bad436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:45.529458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:45.616030 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 676/1359] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Jul 20 19:16:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:45.625140 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d0465-b393-4e31-88ee-b4dd462c2b4a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:45.626895 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-637d0465-b393-4e31-88ee-b4dd462c2b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:45.797093 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d0465-b393-4e31-88ee-b4dd462c2b4a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:45.878002 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:45.923523 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234a527-7fa0-4a9f-ada6-52840ec8e155 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:45.924202 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234a527-7fa0-4a9f-ada6-52840ec8e155 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:45.924487 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234a527-7fa0-4a9f-ada6-52840ec8e155 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:45.924761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234a527-7fa0-4a9f-ada6-52840ec8e155 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:45.926526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e234a527-7fa0-4a9f-ada6-52840ec8e155 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:46.024134 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234a527-7fa0-4a9f-ada6-52840ec8e155 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:46.025734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234a527-7fa0-4a9f-ada6-52840ec8e155 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:46.046203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 684/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:48.316268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99271eb0-6818-4c44-a51c-47f65e561f1e None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:48.316985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99271eb0-6818-4c44-a51c-47f65e561f1e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:48.316985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99271eb0-6818-4c44-a51c-47f65e561f1e None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:48.318393 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 677/1361] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:48.323904 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f345b-8abd-4f83-8875-7105a8b97a08 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:48.324452 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f345b-8abd-4f83-8875-7105a8b97a08 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:48.324452 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f345b-8abd-4f83-8875-7105a8b97a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:48.406225 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bf0f345b-8abd-4f83-8875-7105a8b97a08 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:48.407636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bf0f345b-8abd-4f83-8875-7105a8b97a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:48.447526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:48.518578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 685/1362] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:48.565812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99271eb0-6818-4c44-a51c-47f65e561f1e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:48.567613 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-99271eb0-6818-4c44-a51c-47f65e561f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:48.739912 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99271eb0-6818-4c44-a51c-47f65e561f1e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:48.750455 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:48.888749 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31709db-97bb-48ee-909e-c4e7d29c822b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:48.890084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31709db-97bb-48ee-909e-c4e7d29c822b service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:48.890476 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31709db-97bb-48ee-909e-c4e7d29c822b service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:48.890949 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31709db-97bb-48ee-909e-c4e7d29c822b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:48.892718 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c31709db-97bb-48ee-909e-c4e7d29c822b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:48.992373 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31709db-97bb-48ee-909e-c4e7d29c822b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:48.994418 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31709db-97bb-48ee-909e-c4e7d29c822b service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:49.016036 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 678/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:16:51.476459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c009f-1843-42cf-85c8-8675c33d4091 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:51.477019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c009f-1843-42cf-85c8-8675c33d4091 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:51.477019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c009f-1843-42cf-85c8-8675c33d4091 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:51.478480 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 686/1364] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:51.484805 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0ac3b-f546-4985-9090-60b5a338089d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:51.485375 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0ac3b-f546-4985-9090-60b5a338089d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:51.485616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0ac3b-f546-4985-9090-60b5a338089d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:51.503612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:51.571620 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b7c0ac3b-f546-4985-9090-60b5a338089d None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:51.572927 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b7c0ac3b-f546-4985-9090-60b5a338089d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:51.720230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 679/1365] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:51.770918 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d001f-e080-4645-b5b8-5487a00b4bcc None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:51.771458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d001f-e080-4645-b5b8-5487a00b4bcc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:51.771799 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d001f-e080-4645-b5b8-5487a00b4bcc None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:51.773574 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 687/1366] 10.222.0.18 () {54 vars in 962 bytes} [Wed Jul 20 19:16:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:51.780345 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09162a6-be6b-4aaf-a4d2-f98a3efabc21 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:51.780851 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09162a6-be6b-4aaf-a4d2-f98a3efabc21 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:51.781156 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09162a6-be6b-4aaf-a4d2-f98a3efabc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:51.876488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e09162a6-be6b-4aaf-a4d2-f98a3efabc21 None None] MFA Rules not processed for user `a1f0f6bc94de4645a8c82038ff2bd34a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:51.878057 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e09162a6-be6b-4aaf-a4d2-f98a3efabc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:51.922235 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:52.057846 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 680/1367] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Jul 20 19:16:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:52.065579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d001f-e080-4645-b5b8-5487a00b4bcc None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:52.067207 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f18d001f-e080-4645-b5b8-5487a00b4bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:52.236900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d001f-e080-4645-b5b8-5487a00b4bcc None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:52.258734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:52.363304 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3d466-d773-4701-933c-1f630d314110 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:52.364280 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3d466-d773-4701-933c-1f630d314110 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:52.364791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3d466-d773-4701-933c-1f630d314110 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:52.365295 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3d466-d773-4701-933c-1f630d314110 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:52.367652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9da3d466-d773-4701-933c-1f630d314110 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:52.464687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3d466-d773-4701-933c-1f630d314110 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:52.466466 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3d466-d773-4701-933c-1f630d314110 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:52.487050 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 688/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:16:53.577898 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254421da-fc11-4345-b9aa-54232aed374d None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:53.582228 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254421da-fc11-4345-b9aa-54232aed374d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:53.582803 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254421da-fc11-4345-b9aa-54232aed374d None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:53.585788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 681/1369] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:16:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:53.591002 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef96ed-ee14-450a-87b5-bb710867dd53 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:53.591488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef96ed-ee14-450a-87b5-bb710867dd53 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:53.591573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef96ed-ee14-450a-87b5-bb710867dd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:53.625292 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:53.662118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e5ef96ed-ee14-450a-87b5-bb710867dd53 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:53.663360 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e5ef96ed-ee14-450a-87b5-bb710867dd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:53.767429 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 689/1370] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:54.114533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256b990-3001-4bff-a3ac-4bcb11b212a1 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:54.114820 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256b990-3001-4bff-a3ac-4bcb11b212a1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:54.115097 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256b990-3001-4bff-a3ac-4bcb11b212a1 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:54.116975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 682/1371] 10.222.0.18 () {54 vars in 964 bytes} [Wed Jul 20 19:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:54.121496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44415b-1699-44bd-bc0d-25ba8a86b396 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:54.121787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44415b-1699-44bd-bc0d-25ba8a86b396 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:54.122067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44415b-1699-44bd-bc0d-25ba8a86b396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:54.208010 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5d44415b-1699-44bd-bc0d-25ba8a86b396 None None] MFA Rules not processed for user `bd4ce33a2a1248c6a3199265f40e86f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:54.209631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5d44415b-1699-44bd-bc0d-25ba8a86b396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:54.259553 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:54.294002 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 690/1372] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Jul 20 19:16:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:54.301961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256b990-3001-4bff-a3ac-4bcb11b212a1 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:54.303500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c256b990-3001-4bff-a3ac-4bcb11b212a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:54.414143 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256b990-3001-4bff-a3ac-4bcb11b212a1 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:54.459984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:54.496853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34ec25-6f0c-4696-92a3-17758890bb1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:54.497498 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34ec25-6f0c-4696-92a3-17758890bb1d service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:54.497780 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34ec25-6f0c-4696-92a3-17758890bb1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:54.498052 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34ec25-6f0c-4696-92a3-17758890bb1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:54.500262 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cf34ec25-6f0c-4696-92a3-17758890bb1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:54.622552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34ec25-6f0c-4696-92a3-17758890bb1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:54.624570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34ec25-6f0c-4696-92a3-17758890bb1d service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:54.644597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 683/1373] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:54.674202 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24da4e7-dc2e-4ecd-b681-10fa56804e29 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:54.674964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24da4e7-dc2e-4ecd-b681-10fa56804e29 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:54.674964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24da4e7-dc2e-4ecd-b681-10fa56804e29 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:54.676263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 691/1374] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:54.681723 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcb969-9e47-4eaa-ab1d-d3cf7ffb78cb None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:54.681952 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcb969-9e47-4eaa-ab1d-d3cf7ffb78cb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:54.682227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcb969-9e47-4eaa-ab1d-d3cf7ffb78cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:54.759180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-12bcb969-9e47-4eaa-ab1d-d3cf7ffb78cb None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:54.760710 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-12bcb969-9e47-4eaa-ab1d-d3cf7ffb78cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:54.783524 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:54.866932 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 684/1375] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:54.917787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24da4e7-dc2e-4ecd-b681-10fa56804e29 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:54.919808 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b24da4e7-dc2e-4ecd-b681-10fa56804e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:55.129608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24da4e7-dc2e-4ecd-b681-10fa56804e29 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:55.186171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:55.250986 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37314301-f484-42b1-a220-d4386b7499cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:55.251735 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37314301-f484-42b1-a220-d4386b7499cc service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:55.252020 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37314301-f484-42b1-a220-d4386b7499cc service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:55.252298 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37314301-f484-42b1-a220-d4386b7499cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:55.253962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-37314301-f484-42b1-a220-d4386b7499cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:55.352012 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37314301-f484-42b1-a220-d4386b7499cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:55.353603 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37314301-f484-42b1-a220-d4386b7499cc service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:55.371480 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 692/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:16:57.508287 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad2334-2d26-4f6c-b2cd-69947bfa48f2 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:57.508817 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad2334-2d26-4f6c-b2cd-69947bfa48f2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:57.508922 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad2334-2d26-4f6c-b2cd-69947bfa48f2 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:57.510267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 685/1377] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:16:57.515605 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3d979-b214-468a-89da-a6630678683b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:57.516072 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3d979-b214-468a-89da-a6630678683b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:57.516238 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3d979-b214-468a-89da-a6630678683b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:57.586187 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e9c3d979-b214-468a-89da-a6630678683b None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:16:57.587595 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e9c3d979-b214-468a-89da-a6630678683b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:57.594404 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:57.703695 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 693/1378] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:16:57.761149 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad2334-2d26-4f6c-b2cd-69947bfa48f2 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:16:57.762856 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c8ad2334-2d26-4f6c-b2cd-69947bfa48f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:57.913141 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad2334-2d26-4f6c-b2cd-69947bfa48f2 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:16:57.917160 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:16:58.042910 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b38842-a29e-4502-b2b7-8243e8e51fe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:16:58.043484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b38842-a29e-4502-b2b7-8243e8e51fe8 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:16:58.043767 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b38842-a29e-4502-b2b7-8243e8e51fe8 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:16:58.044045 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b38842-a29e-4502-b2b7-8243e8e51fe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:16:58.046343 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f3b38842-a29e-4502-b2b7-8243e8e51fe8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:16:58.163501 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b38842-a29e-4502-b2b7-8243e8e51fe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:16:58.165541 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b38842-a29e-4502-b2b7-8243e8e51fe8 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:16:58.199202 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 686/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:16:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:00.321561 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65056a85-a744-4628-9a71-b4f450faae59 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:00.322556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65056a85-a744-4628-9a71-b4f450faae59 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:00.322556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65056a85-a744-4628-9a71-b4f450faae59 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:00.323788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 694/1380] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:17:00.330268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299379e-ed54-4758-8c23-5f2cc1c00f57 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:00.331034 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299379e-ed54-4758-8c23-5f2cc1c00f57 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:00.331034 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299379e-ed54-4758-8c23-5f2cc1c00f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:00.342183 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:00.404831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7299379e-ed54-4758-8c23-5f2cc1c00f57 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:00.406045 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7299379e-ed54-4758-8c23-5f2cc1c00f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:00.519324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 687/1381] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:00.569504 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65056a85-a744-4628-9a71-b4f450faae59 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:00.572178 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-65056a85-a744-4628-9a71-b4f450faae59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:00.754731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:00.766737 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65056a85-a744-4628-9a71-b4f450faae59 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:00.897872 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b4b7d-8fff-4124-bd49-e82c9ea1d48b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:00.898458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b4b7d-8fff-4124-bd49-e82c9ea1d48b service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:00.898744 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b4b7d-8fff-4124-bd49-e82c9ea1d48b service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:00.899037 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b4b7d-8fff-4124-bd49-e82c9ea1d48b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:00.900682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7f5b4b7d-8fff-4124-bd49-e82c9ea1d48b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:01.034758 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b4b7d-8fff-4124-bd49-e82c9ea1d48b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:01.038184 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b4b7d-8fff-4124-bd49-e82c9ea1d48b service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:01.060097 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:01.078344 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 695/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:03.551326 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8889dd5-8581-49db-8138-37f655719b9c None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:03.552155 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8889dd5-8581-49db-8138-37f655719b9c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:03.552155 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8889dd5-8581-49db-8138-37f655719b9c None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:03.553294 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 688/1383] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:03.559434 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5ac85-63e3-459e-a57c-a90e8c824dd2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:03.559888 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5ac85-63e3-459e-a57c-a90e8c824dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:03.560170 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5ac85-63e3-459e-a57c-a90e8c824dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:03.636234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-02c5ac85-63e3-459e-a57c-a90e8c824dd2 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:03.637761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-02c5ac85-63e3-459e-a57c-a90e8c824dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:03.745298 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 696/1384] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:17:03.791131 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8889dd5-8581-49db-8138-37f655719b9c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:03.793243 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e8889dd5-8581-49db-8138-37f655719b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:03.899736 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:03.966684 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8889dd5-8581-49db-8138-37f655719b9c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:04.094919 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193ab3b-dc69-4514-9659-d2c5b0dce34e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:04.095568 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193ab3b-dc69-4514-9659-d2c5b0dce34e service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:04.095848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193ab3b-dc69-4514-9659-d2c5b0dce34e service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:04.096128 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193ab3b-dc69-4514-9659-d2c5b0dce34e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:04.097884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6193ab3b-dc69-4514-9659-d2c5b0dce34e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:04.155715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:04.199453 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193ab3b-dc69-4514-9659-d2c5b0dce34e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:04.201077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193ab3b-dc69-4514-9659-d2c5b0dce34e service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:04.219591 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 689/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:06.455340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696839f-87e4-4360-95fd-4325ac22466d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:06.455888 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696839f-87e4-4360-95fd-4325ac22466d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:06.455888 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696839f-87e4-4360-95fd-4325ac22466d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:06.457248 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 697/1386] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:06.463185 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca383f-509f-4575-a8da-ff786c25562e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:06.463622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca383f-509f-4575-a8da-ff786c25562e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:06.463738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca383f-509f-4575-a8da-ff786c25562e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:06.537692 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-40ca383f-509f-4575-a8da-ff786c25562e None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:06.539130 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-40ca383f-509f-4575-a8da-ff786c25562e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:06.672349 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 690/1387] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:06.722178 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696839f-87e4-4360-95fd-4325ac22466d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:06.725890 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8696839f-87e4-4360-95fd-4325ac22466d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:06.846427 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:06.919980 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696839f-87e4-4360-95fd-4325ac22466d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:07.066947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c50543-e8db-4f0f-8f5c-230a9aada626 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:07.067951 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c50543-e8db-4f0f-8f5c-230a9aada626 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:07.068373 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c50543-e8db-4f0f-8f5c-230a9aada626 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:07.068662 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c50543-e8db-4f0f-8f5c-230a9aada626 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:07.070903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-66c50543-e8db-4f0f-8f5c-230a9aada626 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:07.120806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:07.186759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c50543-e8db-4f0f-8f5c-230a9aada626 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:07.188446 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c50543-e8db-4f0f-8f5c-230a9aada626 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:07.208729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 698/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:09.484198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d080887-2f62-46e2-8027-dbc8b24d2d7b None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:09.484747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d080887-2f62-46e2-8027-dbc8b24d2d7b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:09.484747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d080887-2f62-46e2-8027-dbc8b24d2d7b None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:09.486136 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 691/1389] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:09.491422 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f96dc-cf2f-457d-b31b-e8d5fc12a70a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:09.491888 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f96dc-cf2f-457d-b31b-e8d5fc12a70a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:09.491988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f96dc-cf2f-457d-b31b-e8d5fc12a70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:09.558904 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0c2f96dc-cf2f-457d-b31b-e8d5fc12a70a None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:09.560179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0c2f96dc-cf2f-457d-b31b-e8d5fc12a70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:09.794713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 699/1390] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:09.832159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d080887-2f62-46e2-8027-dbc8b24d2d7b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:09.833675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5d080887-2f62-46e2-8027-dbc8b24d2d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:09.865749 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:09.983491 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d080887-2f62-46e2-8027-dbc8b24d2d7b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:10.086557 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:10.104201 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c13ff4-56b1-499f-87a3-830a962c600c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:10.104863 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c13ff4-56b1-499f-87a3-830a962c600c service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:10.105147 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c13ff4-56b1-499f-87a3-830a962c600c service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:10.105426 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c13ff4-56b1-499f-87a3-830a962c600c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:10.107135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f8c13ff4-56b1-499f-87a3-830a962c600c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:10.110829 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5b672-6dbd-4191-9a02-dcd7e44303a6 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:10.111142 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5b672-6dbd-4191-9a02-dcd7e44303a6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:10.111421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5b672-6dbd-4191-9a02-dcd7e44303a6 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:10.112843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 700/1391] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:10.121049 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c28375-3018-4c72-b857-b32dc2aad1d7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:10.121535 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c28375-3018-4c72-b857-b32dc2aad1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:10.122019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c28375-3018-4c72-b857-b32dc2aad1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:10.141173 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:10.204076 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d7c28375-3018-4c72-b857-b32dc2aad1d7 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:10.205289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d7c28375-3018-4c72-b857-b32dc2aad1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:10.217113 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c13ff4-56b1-499f-87a3-830a962c600c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:10.218735 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c13ff4-56b1-499f-87a3-830a962c600c service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:10.237046 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 692/1392] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:10.306151 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 701/1393] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:10.366448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b968b1c-e5c0-4188-8423-6429e5583672 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:10.366836 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b968b1c-e5c0-4188-8423-6429e5583672 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:10.367212 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b968b1c-e5c0-4188-8423-6429e5583672 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:10.368774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 693/1394] 10.222.0.18 () {54 vars in 966 bytes} [Wed Jul 20 19:17:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:10.375300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63d89a-40cb-4f90-8c37-31e08574bf57 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:10.375588 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63d89a-40cb-4f90-8c37-31e08574bf57 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:10.375872 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63d89a-40cb-4f90-8c37-31e08574bf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:10.457125 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7e63d89a-40cb-4f90-8c37-31e08574bf57 None None] MFA Rules not processed for user `36f646c526a044e8b5b6e74aa64cf6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:10.458367 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7e63d89a-40cb-4f90-8c37-31e08574bf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:10.504370 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:10.549389 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 702/1395] 10.222.0.18 () {58 vars in 1063 bytes} [Wed Jul 20 19:17:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:10.557020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b968b1c-e5c0-4188-8423-6429e5583672 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:10.558563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2b968b1c-e5c0-4188-8423-6429e5583672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:10.666128 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b968b1c-e5c0-4188-8423-6429e5583672 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:10.680266 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:10.745475 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b47dd3-e8e2-4107-bc58-4e4c2acd62ec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f646c526a044e8b5b6e74aa64cf6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:10.746327 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b47dd3-e8e2-4107-bc58-4e4c2acd62ec service glance] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:10.746721 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b47dd3-e8e2-4107-bc58-4e4c2acd62ec service glance] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:10.747102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b47dd3-e8e2-4107-bc58-4e4c2acd62ec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:10.748926 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b9b47dd3-e8e2-4107-bc58-4e4c2acd62ec service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:10.870262 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b47dd3-e8e2-4107-bc58-4e4c2acd62ec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:10.871986 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b47dd3-e8e2-4107-bc58-4e4c2acd62ec service glance] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:10.906670 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 694/1396] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:11.617956 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5935f-8cb1-4bf0-9ef8-ca42f1eb8eb0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:11.618493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5935f-8cb1-4bf0-9ef8-ca42f1eb8eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:11.618605 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5935f-8cb1-4bf0-9ef8-ca42f1eb8eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:11.684070 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-beb5935f-8cb1-4bf0-9ef8-ca42f1eb8eb0 None None] MFA Rules not processed for user `e78792e617d84a7cbb384ed764c391fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:11.685272 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-beb5935f-8cb1-4bf0-9ef8-ca42f1eb8eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:11.772629 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 703/1397] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 20 19:17:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:11.816675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9590e4-c8db-4195-bb81-f5b5e0045599 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:11.817190 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9590e4-c8db-4195-bb81-f5b5e0045599 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:11.817304 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9590e4-c8db-4195-bb81-f5b5e0045599 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:11.818651 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 695/1398] 10.222.0.18 () {54 vars in 943 bytes} [Wed Jul 20 19:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:11.824833 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a16344-4c51-4b3b-b7d8-c5ae7c73825c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:11.825117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a16344-4c51-4b3b-b7d8-c5ae7c73825c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:11.825391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a16344-4c51-4b3b-b7d8-c5ae7c73825c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:11.888512 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:11.907270 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-64a16344-4c51-4b3b-b7d8-c5ae7c73825c None None] MFA Rules not processed for user `0ebd7c59f0014a3886fa75fb35a40e64`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:11.908478 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-64a16344-4c51-4b3b-b7d8-c5ae7c73825c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:12.016846 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 704/1399] 10.222.0.18 () {58 vars in 1040 bytes} [Wed Jul 20 19:17:11 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:12.026795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9590e4-c8db-4195-bb81-f5b5e0045599 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:12.028329 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4e9590e4-c8db-4195-bb81-f5b5e0045599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:12.074407 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:12.168298 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9590e4-c8db-4195-bb81-f5b5e0045599 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:12.271097 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce40645-e84e-4160-8ed7-a2a5e3b43fc2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebd7c59f0014a3886fa75fb35a40e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:12.272068 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce40645-e84e-4160-8ed7-a2a5e3b43fc2 service swift] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:12.272356 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce40645-e84e-4160-8ed7-a2a5e3b43fc2 service swift] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:12.272637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce40645-e84e-4160-8ed7-a2a5e3b43fc2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:12.274322 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-fce40645-e84e-4160-8ed7-a2a5e3b43fc2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:12.305283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:12.343331 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc487a-0dcb-4a90-b7f1-9182a410184d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:12.343729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc487a-0dcb-4a90-b7f1-9182a410184d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:12.344081 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc487a-0dcb-4a90-b7f1-9182a410184d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:12.345548 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 705/1400] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:17:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:17:12.350567 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52901474-a37d-4c38-9f50-7bd52f66f465 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:12.350855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52901474-a37d-4c38-9f50-7bd52f66f465 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:12.351135 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52901474-a37d-4c38-9f50-7bd52f66f465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:12.361090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce40645-e84e-4160-8ed7-a2a5e3b43fc2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:12.362731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce40645-e84e-4160-8ed7-a2a5e3b43fc2 service swift] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:12.371344 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 696/1401] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 20 19:17:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:17:12.420120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-52901474-a37d-4c38-9f50-7bd52f66f465 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:12.421389 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-52901474-a37d-4c38-9f50-7bd52f66f465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:12.485655 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:12.538354 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 706/1402] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:17:12.580111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce40645-e84e-4160-8ed7-a2a5e3b43fc2 service swift] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:12.581317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-fce40645-e84e-4160-8ed7-a2a5e3b43fc2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:12.686715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce40645-e84e-4160-8ed7-a2a5e3b43fc2 service swift] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:12.761414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:12.813990 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e4aac-99ab-4749-94a4-f872bff4cc93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:12.814792 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e4aac-99ab-4749-94a4-f872bff4cc93 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:12.815079 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e4aac-99ab-4749-94a4-f872bff4cc93 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:12.815359 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e4aac-99ab-4749-94a4-f872bff4cc93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:12.817045 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-875e4aac-99ab-4749-94a4-f872bff4cc93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:12.920455 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e4aac-99ab-4749-94a4-f872bff4cc93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:12.922097 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e4aac-99ab-4749-94a4-f872bff4cc93 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:12.942879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 697/1403] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:15.072010 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba79604-f6a9-4f46-bcc7-059b619140b2 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:15.072625 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba79604-f6a9-4f46-bcc7-059b619140b2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:15.072625 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba79604-f6a9-4f46-bcc7-059b619140b2 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:15.073954 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 707/1404] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:15.079494 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6240720-452f-4005-b5e3-15a11a190355 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:15.079939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6240720-452f-4005-b5e3-15a11a190355 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:15.080133 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6240720-452f-4005-b5e3-15a11a190355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:15.163121 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e6240720-452f-4005-b5e3-15a11a190355 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:15.164495 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e6240720-452f-4005-b5e3-15a11a190355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:15.243683 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:15.334099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 698/1405] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:15.386935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba79604-f6a9-4f46-bcc7-059b619140b2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:15.386935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bba79604-f6a9-4f46-bcc7-059b619140b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:15.560218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba79604-f6a9-4f46-bcc7-059b619140b2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:15.623692 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:15.718454 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ceb9e2-4362-460e-88be-376cee570307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:15.719134 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ceb9e2-4362-460e-88be-376cee570307 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:15.719421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ceb9e2-4362-460e-88be-376cee570307 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:15.719697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ceb9e2-4362-460e-88be-376cee570307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:15.722510 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-22ceb9e2-4362-460e-88be-376cee570307 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:15.840292 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ceb9e2-4362-460e-88be-376cee570307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:15.843102 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ceb9e2-4362-460e-88be-376cee570307 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:15.863571 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 708/1406] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:18.148807 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d826fe-d283-4c34-8e16-fd74e6a1daf6 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:18.149402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d826fe-d283-4c34-8e16-fd74e6a1daf6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:18.149402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d826fe-d283-4c34-8e16-fd74e6a1daf6 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:18.155071 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 699/1407] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:17:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:18.156755 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9dcda-4a24-4cbb-b139-9aca0ff0b9d0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:18.157229 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9dcda-4a24-4cbb-b139-9aca0ff0b9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:18.157365 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9dcda-4a24-4cbb-b139-9aca0ff0b9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:18.223762 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:18.233668 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f4e9dcda-4a24-4cbb-b139-9aca0ff0b9d0 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:18.234922 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f4e9dcda-4a24-4cbb-b139-9aca0ff0b9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:18.382966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 709/1408] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:17:18.413268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d826fe-d283-4c34-8e16-fd74e6a1daf6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:18.415208 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-09d826fe-d283-4c34-8e16-fd74e6a1daf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:18.585897 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d826fe-d283-4c34-8e16-fd74e6a1daf6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:18.604247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:18.719149 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c27d5-b718-4489-b7ff-adb2375116db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:18.719725 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c27d5-b718-4489-b7ff-adb2375116db service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:18.720090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c27d5-b718-4489-b7ff-adb2375116db service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:18.720284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c27d5-b718-4489-b7ff-adb2375116db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:18.721943 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-db0c27d5-b718-4489-b7ff-adb2375116db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:18.824526 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c27d5-b718-4489-b7ff-adb2375116db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:18.826128 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c27d5-b718-4489-b7ff-adb2375116db service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:18.846719 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 700/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:28.365561 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=44 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:28.842813 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:35.011989 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766618d8-7fab-4122-ae07-67bd6b4b57c0 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:35.012542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766618d8-7fab-4122-ae07-67bd6b4b57c0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:35.012542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766618d8-7fab-4122-ae07-67bd6b4b57c0 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:35.013954 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 710/1410] 10.222.0.18 () {54 vars in 918 bytes} [Wed Jul 20 19:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:35.019471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecc1fa-5749-4610-94f4-f607b0fa5ffb None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:35.019897 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecc1fa-5749-4610-94f4-f607b0fa5ffb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:35.020022 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecc1fa-5749-4610-94f4-f607b0fa5ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:35.093560 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c2ecc1fa-5749-4610-94f4-f607b0fa5ffb None None] MFA Rules not processed for user `d310799ac43e42bc9c7810e1296ddb9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:35.094837 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c2ecc1fa-5749-4610-94f4-f607b0fa5ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:35.204139 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 701/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Jul 20 19:17:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:17:35.218052 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99103d70-dbd9-48e2-b352-3add2b5acdc0 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:35.218371 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99103d70-dbd9-48e2-b352-3add2b5acdc0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:35.218655 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99103d70-dbd9-48e2-b352-3add2b5acdc0 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:35.220915 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 711/1412] 10.222.0.18 () {54 vars in 918 bytes} [Wed Jul 20 19:17:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:35.225495 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2368e-08eb-482e-8a5b-ab7265c86df8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:35.225793 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2368e-08eb-482e-8a5b-ab7265c86df8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:35.226066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2368e-08eb-482e-8a5b-ab7265c86df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:35.297608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:35.301444 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7fe2368e-08eb-482e-8a5b-ab7265c86df8 None None] MFA Rules not processed for user `a1f0f6bc94de4645a8c82038ff2bd34a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:35.303170 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7fe2368e-08eb-482e-8a5b-ab7265c86df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:35.416403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 702/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Jul 20 19:17:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:37.946602 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a4ec3-1162-44c9-80b3-7fb67cf09243 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:37.947188 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a4ec3-1162-44c9-80b3-7fb67cf09243 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:37.947188 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a4ec3-1162-44c9-80b3-7fb67cf09243 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:37.948517 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:37.954108 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81706b79-e4aa-466b-acc2-47a11be317e0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:37.954616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81706b79-e4aa-466b-acc2-47a11be317e0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:37.954725 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81706b79-e4aa-466b-acc2-47a11be317e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:38.020082 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-81706b79-e4aa-466b-acc2-47a11be317e0 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:38.021403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-81706b79-e4aa-466b-acc2-47a11be317e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:38.076262 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:38.117906 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:38.169012 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a4ec3-1162-44c9-80b3-7fb67cf09243 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:38.170543 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-909a4ec3-1162-44c9-80b3-7fb67cf09243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:38.314102 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a4ec3-1162-44c9-80b3-7fb67cf09243 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:38.385342 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:38.426043 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f749147-32c0-4c92-814c-dca5396b6880 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:38.426720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f749147-32c0-4c92-814c-dca5396b6880 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:38.427009 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f749147-32c0-4c92-814c-dca5396b6880 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:38.427290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f749147-32c0-4c92-814c-dca5396b6880 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:38.428937 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1f749147-32c0-4c92-814c-dca5396b6880 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:38.516378 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f749147-32c0-4c92-814c-dca5396b6880 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:38.518501 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f749147-32c0-4c92-814c-dca5396b6880 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:38.536973 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 713/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:39.452569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c10826-f6d0-4dd3-836e-9fbba442b9d9 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:39.453193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c10826-f6d0-4dd3-836e-9fbba442b9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:39.453193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c10826-f6d0-4dd3-836e-9fbba442b9d9 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:39.454595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:39.459462 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8db962-52cc-4fb4-8082-49aec10e682a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:39.459967 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8db962-52cc-4fb4-8082-49aec10e682a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:39.460076 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8db962-52cc-4fb4-8082-49aec10e682a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:39.535639 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0b8db962-52cc-4fb4-8082-49aec10e682a None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:39.536868 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0b8db962-52cc-4fb4-8082-49aec10e682a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:39.563451 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:39.636935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:39.787709 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c10826-f6d0-4dd3-836e-9fbba442b9d9 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:39.789229 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-79c10826-f6d0-4dd3-836e-9fbba442b9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:39.934219 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c10826-f6d0-4dd3-836e-9fbba442b9d9 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:39.975040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:40.049384 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0855e999-dbe0-49f4-8e24-7367c2d3b95a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:40.049950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855e999-dbe0-49f4-8e24-7367c2d3b95a service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:40.050238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855e999-dbe0-49f4-8e24-7367c2d3b95a service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:40.050547 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855e999-dbe0-49f4-8e24-7367c2d3b95a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:40.052187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0855e999-dbe0-49f4-8e24-7367c2d3b95a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:40.139301 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855e999-dbe0-49f4-8e24-7367c2d3b95a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:40.140893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0855e999-dbe0-49f4-8e24-7367c2d3b95a service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:40.159949 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 705/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:17:41.046130 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a8583-9b25-4a81-ba23-3343c51f253e None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:41.046723 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a8583-9b25-4a81-ba23-3343c51f253e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:41.046723 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a8583-9b25-4a81-ba23-3343c51f253e None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:41.048108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:41.053042 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c07da3-8d19-43c4-b50d-c7982e598b78 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:41.053447 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c07da3-8d19-43c4-b50d-c7982e598b78 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:41.053630 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c07da3-8d19-43c4-b50d-c7982e598b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:41.106549 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:41.129844 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c3c07da3-8d19-43c4-b50d-c7982e598b78 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:41.131089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c3c07da3-8d19-43c4-b50d-c7982e598b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:41.231402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:41.391500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a8583-9b25-4a81-ba23-3343c51f253e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:41.393995 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1b5a8583-9b25-4a81-ba23-3343c51f253e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:41.539202 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a8583-9b25-4a81-ba23-3343c51f253e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:41.551269 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:41.659157 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6529e6-f501-4da0-b41e-111e80af5152 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:41.659716 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6529e6-f501-4da0-b41e-111e80af5152 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:41.659998 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6529e6-f501-4da0-b41e-111e80af5152 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:41.660272 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6529e6-f501-4da0-b41e-111e80af5152 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:41.662406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9b6529e6-f501-4da0-b41e-111e80af5152 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:41.752426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6529e6-f501-4da0-b41e-111e80af5152 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:41.754016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6529e6-f501-4da0-b41e-111e80af5152 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:41.772225 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 716/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:42.655335 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242424bb-277b-4da7-8580-6f24a6153671 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:42.655892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242424bb-277b-4da7-8580-6f24a6153671 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:42.655892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242424bb-277b-4da7-8580-6f24a6153671 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:42.657257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:42.662707 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8c715-ab5c-4bf0-bfc0-9cdd17a75b14 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:42.663160 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8c715-ab5c-4bf0-bfc0-9cdd17a75b14 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:42.663267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8c715-ab5c-4bf0-bfc0-9cdd17a75b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:42.682287 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:42.738341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-22c8c715-ab5c-4bf0-bfc0-9cdd17a75b14 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:42.739557 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-22c8c715-ab5c-4bf0-bfc0-9cdd17a75b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:42.833394 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:42.984437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242424bb-277b-4da7-8580-6f24a6153671 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:42.986737 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-242424bb-277b-4da7-8580-6f24a6153671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:43.097377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:43.134120 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242424bb-277b-4da7-8580-6f24a6153671 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:43.246811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec72d2-cb94-45e0-b389-74c1aa62bcd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:43.247451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec72d2-cb94-45e0-b389-74c1aa62bcd9 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:43.247750 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec72d2-cb94-45e0-b389-74c1aa62bcd9 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:43.248002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec72d2-cb94-45e0-b389-74c1aa62bcd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:43.249627 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-25ec72d2-cb94-45e0-b389-74c1aa62bcd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:43.325511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:43.339964 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec72d2-cb94-45e0-b389-74c1aa62bcd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:43.341591 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec72d2-cb94-45e0-b389-74c1aa62bcd9 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:43.359965 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 708/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:44.221056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0a835-e82a-4eb4-9692-667c0dfbfbf2 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:44.221634 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0a835-e82a-4eb4-9692-667c0dfbfbf2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:44.221634 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0a835-e82a-4eb4-9692-667c0dfbfbf2 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:44.223020 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:17:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:44.228077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cc651-f216-4dec-b446-5066e3388e89 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:44.228514 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cc651-f216-4dec-b446-5066e3388e89 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:44.228632 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cc651-f216-4dec-b446-5066e3388e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:44.305477 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-804cc651-f216-4dec-b446-5066e3388e89 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:44.306730 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-804cc651-f216-4dec-b446-5066e3388e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:44.402383 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:44.553873 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0a835-e82a-4eb4-9692-667c0dfbfbf2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:44.555334 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b2f0a835-e82a-4eb4-9692-667c0dfbfbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:44.640607 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:44.701868 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0a835-e82a-4eb4-9692-667c0dfbfbf2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:44.811500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519aff5b-46f1-4752-a311-1bed58002d28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:44.812064 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519aff5b-46f1-4752-a311-1bed58002d28 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:44.812344 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519aff5b-46f1-4752-a311-1bed58002d28 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:44.812617 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519aff5b-46f1-4752-a311-1bed58002d28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:44.814261 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-519aff5b-46f1-4752-a311-1bed58002d28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:44.861903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:44.903538 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519aff5b-46f1-4752-a311-1bed58002d28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:44.905129 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519aff5b-46f1-4752-a311-1bed58002d28 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:44.922727 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 719/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:45.734532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede1b47-600a-4b1c-9908-1cb91169408a None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:45.735074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede1b47-600a-4b1c-9908-1cb91169408a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:45.735074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede1b47-600a-4b1c-9908-1cb91169408a None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:45.737021 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:45.741915 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed292b4e-d5a1-4240-b8e4-1b4df0381281 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:45.742408 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed292b4e-d5a1-4240-b8e4-1b4df0381281 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:45.742509 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed292b4e-d5a1-4240-b8e4-1b4df0381281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:45.820683 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ed292b4e-d5a1-4240-b8e4-1b4df0381281 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:45.821898 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ed292b4e-d5a1-4240-b8e4-1b4df0381281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:45.916074 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:46.067514 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede1b47-600a-4b1c-9908-1cb91169408a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:46.069016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0ede1b47-600a-4b1c-9908-1cb91169408a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:46.117650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:46.214838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede1b47-600a-4b1c-9908-1cb91169408a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:46.329276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cdf14-30c4-4fa6-8bf3-39090f34c747 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:46.329953 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cdf14-30c4-4fa6-8bf3-39090f34c747 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:46.330238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cdf14-30c4-4fa6-8bf3-39090f34c747 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:46.330544 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cdf14-30c4-4fa6-8bf3-39090f34c747 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:46.332200 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d12cdf14-30c4-4fa6-8bf3-39090f34c747 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:46.339682 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:46.421429 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cdf14-30c4-4fa6-8bf3-39090f34c747 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:46.423049 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cdf14-30c4-4fa6-8bf3-39090f34c747 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:46.441149 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 711/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:47.272957 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069de861-9154-49cb-ab23-7940333c5445 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:47.273570 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069de861-9154-49cb-ab23-7940333c5445 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:47.273570 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069de861-9154-49cb-ab23-7940333c5445 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:47.275214 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:47.280058 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3b23c-4bc0-4b2b-bbc8-986ed96fb8cd None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:47.280511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3b23c-4bc0-4b2b-bbc8-986ed96fb8cd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:47.280620 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3b23c-4bc0-4b2b-bbc8-986ed96fb8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:47.373115 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-28b3b23c-4bc0-4b2b-bbc8-986ed96fb8cd None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:47.374473 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-28b3b23c-4bc0-4b2b-bbc8-986ed96fb8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:47.441490 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:47.470233 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:47.619314 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069de861-9154-49cb-ab23-7940333c5445 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:47.620858 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-069de861-9154-49cb-ab23-7940333c5445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:47.638262 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:47.765452 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069de861-9154-49cb-ab23-7940333c5445 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:47.850872 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:47.880673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b307ac-f007-448b-985f-93441e2387ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:47.881344 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b307ac-f007-448b-985f-93441e2387ae service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:47.881624 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b307ac-f007-448b-985f-93441e2387ae service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:47.881899 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b307ac-f007-448b-985f-93441e2387ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:47.883562 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-13b307ac-f007-448b-985f-93441e2387ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:47.970416 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b307ac-f007-448b-985f-93441e2387ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:47.972482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b307ac-f007-448b-985f-93441e2387ae service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:47.990617 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 722/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:48.804920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac45f34-0a66-4a7b-9eca-6f2c4388ab07 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:48.805482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac45f34-0a66-4a7b-9eca-6f2c4388ab07 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:48.805482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac45f34-0a66-4a7b-9eca-6f2c4388ab07 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:48.806875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:48.811865 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81546ae5-1b39-4008-803f-b24bcc2b9489 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:48.812313 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81546ae5-1b39-4008-803f-b24bcc2b9489 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:48.812422 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81546ae5-1b39-4008-803f-b24bcc2b9489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:48.886850 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-81546ae5-1b39-4008-803f-b24bcc2b9489 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:48.888063 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-81546ae5-1b39-4008-803f-b24bcc2b9489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:48.929304 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:48.983754 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:17:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:49.134733 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac45f34-0a66-4a7b-9eca-6f2c4388ab07 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:49.136257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8ac45f34-0a66-4a7b-9eca-6f2c4388ab07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:49.285458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac45f34-0a66-4a7b-9eca-6f2c4388ab07 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:49.339998 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:49.400711 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0080092-784c-4f10-b2a5-e60f067c55fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:49.401358 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0080092-784c-4f10-b2a5-e60f067c55fb service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:49.401645 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0080092-784c-4f10-b2a5-e60f067c55fb service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:49.401919 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0080092-784c-4f10-b2a5-e60f067c55fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:49.403605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e0080092-784c-4f10-b2a5-e60f067c55fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:49.495200 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0080092-784c-4f10-b2a5-e60f067c55fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:49.496812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0080092-784c-4f10-b2a5-e60f067c55fb service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:49.514707 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 714/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:50.320145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d73f7-7b4a-46e8-aada-8e7ab346e6b2 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:50.320724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d73f7-7b4a-46e8-aada-8e7ab346e6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:50.320724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d73f7-7b4a-46e8-aada-8e7ab346e6b2 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:50.322085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:50.326999 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88749a-ae6f-428e-90fe-d9235fba1f20 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:50.327450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88749a-ae6f-428e-90fe-d9235fba1f20 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:50.327562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88749a-ae6f-428e-90fe-d9235fba1f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:50.403214 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9f88749a-ae6f-428e-90fe-d9235fba1f20 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:50.404443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9f88749a-ae6f-428e-90fe-d9235fba1f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:50.406484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:50.501884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:50.652362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d73f7-7b4a-46e8-aada-8e7ab346e6b2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:50.653906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-223d73f7-7b4a-46e8-aada-8e7ab346e6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:50.801494 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d73f7-7b4a-46e8-aada-8e7ab346e6b2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:50.827505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:50.916545 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e4ebb-f7fc-4bbc-ad4f-5b73df516648 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:50.917206 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e4ebb-f7fc-4bbc-ad4f-5b73df516648 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:50.917498 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e4ebb-f7fc-4bbc-ad4f-5b73df516648 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:50.917772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e4ebb-f7fc-4bbc-ad4f-5b73df516648 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:50.919460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-945e4ebb-f7fc-4bbc-ad4f-5b73df516648 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:51.011285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e4ebb-f7fc-4bbc-ad4f-5b73df516648 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:51.012873 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e4ebb-f7fc-4bbc-ad4f-5b73df516648 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:51.034827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 725/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:52.995099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa342c5-6cec-4a56-8dcc-b6beb57629fa None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:52.995658 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa342c5-6cec-4a56-8dcc-b6beb57629fa None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:52.995658 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa342c5-6cec-4a56-8dcc-b6beb57629fa None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:52.997033 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:53.002208 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8762ce1-4309-4f17-b7ab-2d4b9be3f48a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:53.002699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8762ce1-4309-4f17-b7ab-2d4b9be3f48a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:53.002816 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8762ce1-4309-4f17-b7ab-2d4b9be3f48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:53.043337 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:53.092671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e8762ce1-4309-4f17-b7ab-2d4b9be3f48a None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:53.095310 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e8762ce1-4309-4f17-b7ab-2d4b9be3f48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:53.191617 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:53.230725 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa342c5-6cec-4a56-8dcc-b6beb57629fa None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:53.232272 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bfa342c5-6cec-4a56-8dcc-b6beb57629fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:53.341021 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa342c5-6cec-4a56-8dcc-b6beb57629fa None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:53.372502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:53.416871 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3a076-e9eb-449d-b9b6-7a79269b3a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:53.417522 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3a076-e9eb-449d-b9b6-7a79269b3a5a service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:53.417809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3a076-e9eb-449d-b9b6-7a79269b3a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:53.418089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3a076-e9eb-449d-b9b6-7a79269b3a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:53.419782 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-35a3a076-e9eb-449d-b9b6-7a79269b3a5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:53.527363 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3a076-e9eb-449d-b9b6-7a79269b3a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:53.528807 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3a076-e9eb-449d-b9b6-7a79269b3a5a service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:53.546544 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 717/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:55.738389 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233042e-f59e-4649-93a5-66c4ba517e96 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:55.738928 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233042e-f59e-4649-93a5-66c4ba517e96 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:55.738928 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233042e-f59e-4649-93a5-66c4ba517e96 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:55.740323 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:17:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:55.746657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671051d4-1238-427e-888e-aab62a7a0408 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:55.747150 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671051d4-1238-427e-888e-aab62a7a0408 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:55.747259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671051d4-1238-427e-888e-aab62a7a0408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:55.810554 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-671051d4-1238-427e-888e-aab62a7a0408 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:55.811762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-671051d4-1238-427e-888e-aab62a7a0408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:55.824077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:55.907988 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:55.946037 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233042e-f59e-4649-93a5-66c4ba517e96 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:55.947637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2233042e-f59e-4649-93a5-66c4ba517e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:56.049853 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233042e-f59e-4649-93a5-66c4ba517e96 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:56.063745 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:56.124576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8eff9a-08ed-4ec0-9b93-7a81e7f1e56d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:56.125215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8eff9a-08ed-4ec0-9b93-7a81e7f1e56d service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:56.125495 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8eff9a-08ed-4ec0-9b93-7a81e7f1e56d service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:56.125766 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8eff9a-08ed-4ec0-9b93-7a81e7f1e56d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:56.127945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7b8eff9a-08ed-4ec0-9b93-7a81e7f1e56d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:56.236996 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8eff9a-08ed-4ec0-9b93-7a81e7f1e56d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:56.238443 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8eff9a-08ed-4ec0-9b93-7a81e7f1e56d service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:56.257305 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 728/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:17:58.637483 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65cbad-d289-440c-972e-6a8bc3fe89fb None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:58.638031 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65cbad-d289-440c-972e-6a8bc3fe89fb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:58.638031 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65cbad-d289-440c-972e-6a8bc3fe89fb None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:58.639461 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:17:58.644879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108622d7-73e3-48a5-a48b-77ffad5634b0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:58.645276 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108622d7-73e3-48a5-a48b-77ffad5634b0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:58.645430 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108622d7-73e3-48a5-a48b-77ffad5634b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:58.692092 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:58.710220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-108622d7-73e3-48a5-a48b-77ffad5634b0 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:17:58.711466 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-108622d7-73e3-48a5-a48b-77ffad5634b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:58.808674 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:17:58.848346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65cbad-d289-440c-972e-6a8bc3fe89fb None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:17:58.849882 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-fe65cbad-d289-440c-972e-6a8bc3fe89fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:58.951487 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65cbad-d289-440c-972e-6a8bc3fe89fb None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:17:58.994840 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:17:59.029084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230b331-f50f-45d1-8371-79046090ecb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:17:59.029732 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230b331-f50f-45d1-8371-79046090ecb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:17:59.030013 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230b331-f50f-45d1-8371-79046090ecb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:17:59.030288 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230b331-f50f-45d1-8371-79046090ecb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:17:59.031962 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6230b331-f50f-45d1-8371-79046090ecb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:17:59.140620 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230b331-f50f-45d1-8371-79046090ecb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:17:59.141985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230b331-f50f-45d1-8371-79046090ecb8 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:17:59.161305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 720/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:17:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:01.311959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325c422-6266-4665-89af-04b2dc879295 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:01.312560 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325c422-6266-4665-89af-04b2dc879295 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:01.312560 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325c422-6266-4665-89af-04b2dc879295 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:01.313873 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:01.319648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719e756-cd7c-42c5-be60-05465e0c712a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:01.320114 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719e756-cd7c-42c5-be60-05465e0c712a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:01.320224 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719e756-cd7c-42c5-be60-05465e0c712a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:01.388592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d719e756-cd7c-42c5-be60-05465e0c712a None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:01.389817 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d719e756-cd7c-42c5-be60-05465e0c712a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:01.410991 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:01.486115 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:01.526859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325c422-6266-4665-89af-04b2dc879295 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:01.528386 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b325c422-6266-4665-89af-04b2dc879295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:01.632869 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325c422-6266-4665-89af-04b2dc879295 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:01.653208 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:01.706492 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f469dbe-8984-456f-9f4a-35a8a63ab762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:01.707136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f469dbe-8984-456f-9f4a-35a8a63ab762 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:01.707417 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f469dbe-8984-456f-9f4a-35a8a63ab762 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:01.707695 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f469dbe-8984-456f-9f4a-35a8a63ab762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:01.709341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2f469dbe-8984-456f-9f4a-35a8a63ab762 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:01.817430 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f469dbe-8984-456f-9f4a-35a8a63ab762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:01.818906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f469dbe-8984-456f-9f4a-35a8a63ab762 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:01.836980 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 731/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:04.001253 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf62e69-bb0e-45fc-97a4-36ab310e384c None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:04.001825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf62e69-bb0e-45fc-97a4-36ab310e384c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:04.001825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf62e69-bb0e-45fc-97a4-36ab310e384c None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:04.003763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:04.008980 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd18293-f771-406d-b9bc-403d65fd48be None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:04.009430 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd18293-f771-406d-b9bc-403d65fd48be None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:04.009539 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd18293-f771-406d-b9bc-403d65fd48be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:04.072039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:04.075658 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6bd18293-f771-406d-b9bc-403d65fd48be None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:04.076923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6bd18293-f771-406d-b9bc-403d65fd48be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:04.174308 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:04.212203 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf62e69-bb0e-45fc-97a4-36ab310e384c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:04.213729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9cf62e69-bb0e-45fc-97a4-36ab310e384c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:04.317663 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf62e69-bb0e-45fc-97a4-36ab310e384c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:04.365707 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:04.390608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18218f3e-fc19-4579-aead-2684884810ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:04.391252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18218f3e-fc19-4579-aead-2684884810ce service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:04.391536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18218f3e-fc19-4579-aead-2684884810ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:04.391809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18218f3e-fc19-4579-aead-2684884810ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:04.393467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-18218f3e-fc19-4579-aead-2684884810ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:04.500174 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18218f3e-fc19-4579-aead-2684884810ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:04.501617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18218f3e-fc19-4579-aead-2684884810ce service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:04.519336 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 723/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:06.603788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6898aa5-2b55-451e-9859-69febc0b3a18 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:06.604388 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6898aa5-2b55-451e-9859-69febc0b3a18 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:06.604388 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6898aa5-2b55-451e-9859-69febc0b3a18 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:06.605879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:18:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:06.614446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2355d0-fa62-4c6b-971b-80546f37f3b5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:06.614969 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2355d0-fa62-4c6b-971b-80546f37f3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:06.615076 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2355d0-fa62-4c6b-971b-80546f37f3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:06.679952 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7f2355d0-fa62-4c6b-971b-80546f37f3b5 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:06.681185 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7f2355d0-fa62-4c6b-971b-80546f37f3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:06.709745 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:06.776313 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:06.815643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6898aa5-2b55-451e-9859-69febc0b3a18 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:06.817166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e6898aa5-2b55-451e-9859-69febc0b3a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:06.919615 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6898aa5-2b55-451e-9859-69febc0b3a18 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:06.947881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:06.994813 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ff499-5d6d-42ac-be2d-6c5ec712af24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:06.995469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff499-5d6d-42ac-be2d-6c5ec712af24 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:06.995755 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff499-5d6d-42ac-be2d-6c5ec712af24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:06.996065 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff499-5d6d-42ac-be2d-6c5ec712af24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:06.997717 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bb1ff499-5d6d-42ac-be2d-6c5ec712af24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:07.110075 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ff499-5d6d-42ac-be2d-6c5ec712af24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:07.111555 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ff499-5d6d-42ac-be2d-6c5ec712af24 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:07.129741 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 734/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:18:09.218468 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e1dcf-fa5d-4419-9035-38ef6a21502f None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:09.219021 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e1dcf-fa5d-4419-9035-38ef6a21502f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:09.219021 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e1dcf-fa5d-4419-9035-38ef6a21502f None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:09.220436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:09.226357 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf11c9-c90b-433d-b259-8cf25560e8c4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:09.226795 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf11c9-c90b-433d-b259-8cf25560e8c4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:09.226905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf11c9-c90b-433d-b259-8cf25560e8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:09.290294 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-93cf11c9-c90b-433d-b259-8cf25560e8c4 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:09.291535 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-93cf11c9-c90b-433d-b259-8cf25560e8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:09.300310 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:09.389198 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:09.427150 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e1dcf-fa5d-4419-9035-38ef6a21502f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:09.428739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6e5e1dcf-fa5d-4419-9035-38ef6a21502f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:09.532177 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e1dcf-fa5d-4419-9035-38ef6a21502f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:09.587558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:09.605766 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4ded9-1ff3-415b-b8c3-606ef4eea445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:09.606449 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4ded9-1ff3-415b-b8c3-606ef4eea445 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:09.606740 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4ded9-1ff3-415b-b8c3-606ef4eea445 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:09.607024 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4ded9-1ff3-415b-b8c3-606ef4eea445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:09.608676 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4db4ded9-1ff3-415b-b8c3-606ef4eea445 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:09.717502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4ded9-1ff3-415b-b8c3-606ef4eea445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:09.718984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4ded9-1ff3-415b-b8c3-606ef4eea445 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:09.737118 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 726/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:11.825355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4438ca9-d4cb-4970-83da-77f14b9a835c None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:11.825923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4438ca9-d4cb-4970-83da-77f14b9a835c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:11.825923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4438ca9-d4cb-4970-83da-77f14b9a835c None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:11.827344 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:11.833398 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cadc3-1f75-4f21-8997-eb9c7f0d5f38 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:11.833790 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cadc3-1f75-4f21-8997-eb9c7f0d5f38 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:11.833884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cadc3-1f75-4f21-8997-eb9c7f0d5f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:11.897661 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-571cadc3-1f75-4f21-8997-eb9c7f0d5f38 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:11.898890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-571cadc3-1f75-4f21-8997-eb9c7f0d5f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:11.936598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:11.994726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:12.032834 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4438ca9-d4cb-4970-83da-77f14b9a835c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:12.034399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c4438ca9-d4cb-4970-83da-77f14b9a835c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:12.138324 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4438ca9-d4cb-4970-83da-77f14b9a835c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:12.175949 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:12.211819 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec37c6-f4e5-4011-9798-1d5600e4bc3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:12.212463 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec37c6-f4e5-4011-9798-1d5600e4bc3e service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:12.212747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec37c6-f4e5-4011-9798-1d5600e4bc3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:12.213024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec37c6-f4e5-4011-9798-1d5600e4bc3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:12.214707 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9eec37c6-f4e5-4011-9798-1d5600e4bc3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:12.321149 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec37c6-f4e5-4011-9798-1d5600e4bc3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:12.322655 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec37c6-f4e5-4011-9798-1d5600e4bc3e service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:12.341023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 737/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:14.432289 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2e0e9-0f84-4c20-bc1d-0befb4c78323 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:14.432874 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2e0e9-0f84-4c20-bc1d-0befb4c78323 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:14.432986 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2e0e9-0f84-4c20-bc1d-0befb4c78323 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:14.434315 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:14.439582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5de46-cea7-4363-a3a8-00e7720f4440 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:14.439991 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5de46-cea7-4363-a3a8-00e7720f4440 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:14.440147 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5de46-cea7-4363-a3a8-00e7720f4440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:14.504499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-47a5de46-cea7-4363-a3a8-00e7720f4440 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:14.505717 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-47a5de46-cea7-4363-a3a8-00e7720f4440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:14.524000 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:14.603425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:14.640031 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2e0e9-0f84-4c20-bc1d-0befb4c78323 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:14.641566 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-23a2e0e9-0f84-4c20-bc1d-0befb4c78323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:14.746791 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2e0e9-0f84-4c20-bc1d-0befb4c78323 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:14.812423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:14.819723 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566f968-1a38-4c53-9f64-c2e5f6e43d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:14.820373 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566f968-1a38-4c53-9f64-c2e5f6e43d2c service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:14.820658 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566f968-1a38-4c53-9f64-c2e5f6e43d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:14.820933 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566f968-1a38-4c53-9f64-c2e5f6e43d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:14.822614 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e566f968-1a38-4c53-9f64-c2e5f6e43d2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:14.929878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566f968-1a38-4c53-9f64-c2e5f6e43d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:14.931342 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566f968-1a38-4c53-9f64-c2e5f6e43d2c service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:14.949412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 729/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:17.021957 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51225e7-1f6f-48b3-9d77-de9b5b7cd6b0 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:17.022643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51225e7-1f6f-48b3-9d77-de9b5b7cd6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:17.022643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51225e7-1f6f-48b3-9d77-de9b5b7cd6b0 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:17.024263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:17.030126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74173180-10d2-4c3b-990b-4e65b7da15c3 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:17.030609 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74173180-10d2-4c3b-990b-4e65b7da15c3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:17.030819 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74173180-10d2-4c3b-990b-4e65b7da15c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:17.095075 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-74173180-10d2-4c3b-990b-4e65b7da15c3 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:17.096283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-74173180-10d2-4c3b-990b-4e65b7da15c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:17.143998 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:17.193213 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:17.230269 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51225e7-1f6f-48b3-9d77-de9b5b7cd6b0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:17.231876 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c51225e7-1f6f-48b3-9d77-de9b5b7cd6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:17.334453 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51225e7-1f6f-48b3-9d77-de9b5b7cd6b0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:17.381681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:17.407102 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3700b80-addf-42a3-a48b-82d44eb8619e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:17.407739 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3700b80-addf-42a3-a48b-82d44eb8619e service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:17.408021 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3700b80-addf-42a3-a48b-82d44eb8619e service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:17.408294 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3700b80-addf-42a3-a48b-82d44eb8619e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:17.410590 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c3700b80-addf-42a3-a48b-82d44eb8619e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:17.522028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3700b80-addf-42a3-a48b-82d44eb8619e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:17.523494 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3700b80-addf-42a3-a48b-82d44eb8619e service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:17.544868 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 740/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:27.191784 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=22 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:27.542446 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=66 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:37.424158 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91784ff3-08f4-4592-97d6-410de0f56bfc None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:37.424705 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91784ff3-08f4-4592-97d6-410de0f56bfc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:37.424705 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91784ff3-08f4-4592-97d6-410de0f56bfc None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:37.427122 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 731/1471] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:18:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:37.432867 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b1024-48dc-4209-bc19-c34b6c861581 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:37.433351 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b1024-48dc-4209-bc19-c34b6c861581 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:37.433454 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b1024-48dc-4209-bc19-c34b6c861581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:37.496885 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8b0b1024-48dc-4209-bc19-c34b6c861581 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:37.498103 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8b0b1024-48dc-4209-bc19-c34b6c861581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:37.594097 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 741/1472] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:37.678522 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee7b8b-6439-42c3-8ac5-36ee31081948 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:37.678751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee7b8b-6439-42c3-8ac5-36ee31081948 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:37.679031 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee7b8b-6439-42c3-8ac5-36ee31081948 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:37.680401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 732/1473] 10.222.0.18 () {54 vars in 966 bytes} [Wed Jul 20 19:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:37.685265 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84707f75-731f-4b67-a88c-47ede0628c93 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:37.685558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84707f75-731f-4b67-a88c-47ede0628c93 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:37.685835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84707f75-731f-4b67-a88c-47ede0628c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:37.772019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-84707f75-731f-4b67-a88c-47ede0628c93 None None] MFA Rules not processed for user `36f646c526a044e8b5b6e74aa64cf6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:37.774070 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-84707f75-731f-4b67-a88c-47ede0628c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:37.803252 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:37.858742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 742/1474] 10.222.0.18 () {58 vars in 1063 bytes} [Wed Jul 20 19:18:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:37.866664 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee7b8b-6439-42c3-8ac5-36ee31081948 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:37.868175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9cee7b8b-6439-42c3-8ac5-36ee31081948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:37.970215 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee7b8b-6439-42c3-8ac5-36ee31081948 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:38.043898 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb305fec-ed5e-4c07-873b-a54f8c723b7e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f646c526a044e8b5b6e74aa64cf6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:38.044544 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb305fec-ed5e-4c07-873b-a54f8c723b7e service glance] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:38.044830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb305fec-ed5e-4c07-873b-a54f8c723b7e service glance] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:38.045105 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb305fec-ed5e-4c07-873b-a54f8c723b7e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:38.046789 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bb305fec-ed5e-4c07-873b-a54f8c723b7e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:38.103440 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:38.158549 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb305fec-ed5e-4c07-873b-a54f8c723b7e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:38.160518 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb305fec-ed5e-4c07-873b-a54f8c723b7e service glance] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:38.179573 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 733/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:40.296209 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8af709-b089-4466-9db9-f474e9b34517 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:40.296805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8af709-b089-4466-9db9-f474e9b34517 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:40.296805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8af709-b089-4466-9db9-f474e9b34517 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:40.298157 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 743/1476] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:40.303445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783dac6-2041-4931-bc22-9d4db4f1d969 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:40.303873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783dac6-2041-4931-bc22-9d4db4f1d969 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:40.304007 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783dac6-2041-4931-bc22-9d4db4f1d969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:40.369628 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3783dac6-2041-4931-bc22-9d4db4f1d969 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:40.370962 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3783dac6-2041-4931-bc22-9d4db4f1d969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:40.467161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 734/1477] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:40.491246 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8af709-b089-4466-9db9-f474e9b34517 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:40.492777 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ac8af709-b089-4466-9db9-f474e9b34517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:40.616030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8af709-b089-4466-9db9-f474e9b34517 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:40.663859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:40.708604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48aa0d-5ba8-4608-a2cd-80bf497bfb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:40.709269 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48aa0d-5ba8-4608-a2cd-80bf497bfb7b admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:40.709565 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48aa0d-5ba8-4608-a2cd-80bf497bfb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:40.709858 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48aa0d-5ba8-4608-a2cd-80bf497bfb7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:40.710587 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48aa0d-5ba8-4608-a2cd-80bf497bfb7b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:40.712311 dv-cinder-819149-14-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-1a48aa0d-5ba8-4608-a2cd-80bf497bfb7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:18:40.712311 dv-cinder-819149-14-smb devstack@keystone.service[80234]: warnings.warn(msg) Jul 20 19:18:40.712311 dv-cinder-819149-14-smb devstack@keystone.service[80234]: Jul 20 19:18:40.713456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48aa0d-5ba8-4608-a2cd-80bf497bfb7b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:40.732984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 744/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Jul 20 19:18:40 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:18:42.798223 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc18ff-4fbb-4b84-94fd-1d84623cd1d4 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:42.798776 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc18ff-4fbb-4b84-94fd-1d84623cd1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:42.798892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc18ff-4fbb-4b84-94fd-1d84623cd1d4 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:42.800248 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 735/1479] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:42.806116 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46893453-2d08-4f66-a50d-cd81e2c92906 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:42.806593 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46893453-2d08-4f66-a50d-cd81e2c92906 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:42.806701 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46893453-2d08-4f66-a50d-cd81e2c92906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:42.870372 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-46893453-2d08-4f66-a50d-cd81e2c92906 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:42.871503 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-46893453-2d08-4f66-a50d-cd81e2c92906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:42.967508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 745/1480] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:43.013293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc18ff-4fbb-4b84-94fd-1d84623cd1d4 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:43.014887 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-53fc18ff-4fbb-4b84-94fd-1d84623cd1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:43.025501 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:43.159954 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc18ff-4fbb-4b84-94fd-1d84623cd1d4 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:43.238223 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:43.271371 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6e1ab-9c0e-4974-a29b-faa725e5a351 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:43.272021 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6e1ab-9c0e-4974-a29b-faa725e5a351 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:43.272305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6e1ab-9c0e-4974-a29b-faa725e5a351 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:43.272583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6e1ab-9c0e-4974-a29b-faa725e5a351 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:43.274516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d6d6e1ab-9c0e-4974-a29b-faa725e5a351 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:43.362441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6e1ab-9c0e-4974-a29b-faa725e5a351 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:43.364067 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6e1ab-9c0e-4974-a29b-faa725e5a351 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:43.382153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 736/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:18:45.696288 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898baed4-1515-4830-954b-e6e3792f513d None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:45.696825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898baed4-1515-4830-954b-e6e3792f513d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:45.696953 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898baed4-1515-4830-954b-e6e3792f513d None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:45.698252 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 746/1482] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:45.703744 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e08db9-5d72-4f58-a16c-7f3c26bd878b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:45.704182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e08db9-5d72-4f58-a16c-7f3c26bd878b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:45.704316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e08db9-5d72-4f58-a16c-7f3c26bd878b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:45.770826 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-37e08db9-5d72-4f58-a16c-7f3c26bd878b None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:45.772070 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-37e08db9-5d72-4f58-a16c-7f3c26bd878b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:45.818158 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:45.868650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 737/1483] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:45.905780 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898baed4-1515-4830-954b-e6e3792f513d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:45.907345 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-898baed4-1515-4830-954b-e6e3792f513d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:45.931475 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:46.009974 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898baed4-1515-4830-954b-e6e3792f513d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:46.085204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfc4d8-45f0-482e-afa4-27f29f96d735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:46.086108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfc4d8-45f0-482e-afa4-27f29f96d735 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:46.086243 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfc4d8-45f0-482e-afa4-27f29f96d735 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:46.086501 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfc4d8-45f0-482e-afa4-27f29f96d735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:46.088151 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9bdfc4d8-45f0-482e-afa4-27f29f96d735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:46.161608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:46.197795 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfc4d8-45f0-482e-afa4-27f29f96d735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:46.199269 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfc4d8-45f0-482e-afa4-27f29f96d735 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:46.217979 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 747/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:48.336550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eb5a2-b254-41a5-921f-b6ce0d0611c3 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:48.337149 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eb5a2-b254-41a5-921f-b6ce0d0611c3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:48.337149 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eb5a2-b254-41a5-921f-b6ce0d0611c3 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:48.338539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 738/1485] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:48.343704 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5fb22-bcee-4682-9f24-93d7df3776f6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:48.344155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5fb22-bcee-4682-9f24-93d7df3776f6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:48.344267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5fb22-bcee-4682-9f24-93d7df3776f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:48.411831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4db5fb22-bcee-4682-9f24-93d7df3776f6 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:48.413039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4db5fb22-bcee-4682-9f24-93d7df3776f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:48.508743 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 748/1486] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:48.546773 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eb5a2-b254-41a5-921f-b6ce0d0611c3 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:48.548513 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-185eb5a2-b254-41a5-921f-b6ce0d0611c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:48.651458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eb5a2-b254-41a5-921f-b6ce0d0611c3 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:48.722448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:48.724616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b78a61-54aa-4f18-a601-72909681cfde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:48.725351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b78a61-54aa-4f18-a601-72909681cfde service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:48.725731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b78a61-54aa-4f18-a601-72909681cfde service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:48.726199 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b78a61-54aa-4f18-a601-72909681cfde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:48.728231 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-20b78a61-54aa-4f18-a601-72909681cfde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:48.835585 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b78a61-54aa-4f18-a601-72909681cfde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:48.836949 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b78a61-54aa-4f18-a601-72909681cfde service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:48.855142 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 739/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:50.985758 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cef5b-f02f-429d-835e-047d3668b3be None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:50.986288 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cef5b-f02f-429d-835e-047d3668b3be None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:50.986288 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cef5b-f02f-429d-835e-047d3668b3be None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:50.987717 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 749/1488] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:50.993712 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bab60-92f3-495a-a3e3-6d903bf13f68 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:50.994124 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bab60-92f3-495a-a3e3-6d903bf13f68 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:50.994267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bab60-92f3-495a-a3e3-6d903bf13f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:51.059084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-038bab60-92f3-495a-a3e3-6d903bf13f68 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:51.060314 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-038bab60-92f3-495a-a3e3-6d903bf13f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:51.111922 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:51.157054 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 740/1489] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:51.200146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cef5b-f02f-429d-835e-047d3668b3be None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:51.201713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0f9cef5b-f02f-429d-835e-047d3668b3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:51.237446 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:51.308245 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cef5b-f02f-429d-835e-047d3668b3be None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:51.383129 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd745f2-9b90-44ac-a30f-a9f86684dbe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:51.383693 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd745f2-9b90-44ac-a30f-a9f86684dbe3 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:51.383981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd745f2-9b90-44ac-a30f-a9f86684dbe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:51.384264 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd745f2-9b90-44ac-a30f-a9f86684dbe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:51.385918 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-abd745f2-9b90-44ac-a30f-a9f86684dbe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:51.464558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:51.495537 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd745f2-9b90-44ac-a30f-a9f86684dbe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:51.496974 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd745f2-9b90-44ac-a30f-a9f86684dbe3 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:51.515569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 750/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:18:53.785560 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e04d6e-d4fe-4855-842b-5e4cbba8f807 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:53.786139 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e04d6e-d4fe-4855-842b-5e4cbba8f807 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:53.786139 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e04d6e-d4fe-4855-842b-5e4cbba8f807 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:53.787547 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 741/1491] 10.222.0.18 () {54 vars in 926 bytes} [Wed Jul 20 19:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:18:53.793043 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798919c-5052-4aad-ac6c-7b93b82ddc7f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:53.793456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798919c-5052-4aad-ac6c-7b93b82ddc7f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:53.793607 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798919c-5052-4aad-ac6c-7b93b82ddc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:53.857922 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6798919c-5052-4aad-ac6c-7b93b82ddc7f None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:18:53.859104 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6798919c-5052-4aad-ac6c-7b93b82ddc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:53.963079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 751/1492] 10.222.0.18 () {58 vars in 1023 bytes} [Wed Jul 20 19:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:18:54.003350 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e04d6e-d4fe-4855-842b-5e4cbba8f807 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:18:54.004964 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-01e04d6e-d4fe-4855-842b-5e4cbba8f807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:54.108647 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e04d6e-d4fe-4855-842b-5e4cbba8f807 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:18:54.185281 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137c359-3926-43c3-8e98-cfe38ec7649b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:18:54.186165 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137c359-3926-43c3-8e98-cfe38ec7649b service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:18:54.186618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137c359-3926-43c3-8e98-cfe38ec7649b service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:18:54.186873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137c359-3926-43c3-8e98-cfe38ec7649b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:18:54.189179 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5137c359-3926-43c3-8e98-cfe38ec7649b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:18:54.198628 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:18:54.305575 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137c359-3926-43c3-8e98-cfe38ec7649b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:18:54.307191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137c359-3926-43c3-8e98-cfe38ec7649b service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:18:54.325102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 742/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:18:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:19:03.961221 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=82 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:19:04.322655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=50 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:22.215591 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ad336-60b2-4431-aadd-f2a73c903c59 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:22.216369 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ad336-60b2-4431-aadd-f2a73c903c59 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:22.216369 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ad336-60b2-4431-aadd-f2a73c903c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:22.291257 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-873ad336-60b2-4431-aadd-f2a73c903c59 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:20:22.292502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-873ad336-60b2-4431-aadd-f2a73c903c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:22.390011 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 752/1494] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:20:22.398050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6570f-5ca4-40bf-81e0-0f73f53a94c1 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:22.398592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6570f-5ca4-40bf-81e0-0f73f53a94c1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:22.398697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6570f-5ca4-40bf-81e0-0f73f53a94c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:22.472217 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-61e6570f-5ca4-40bf-81e0-0f73f53a94c1 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:20:22.473445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-61e6570f-5ca4-40bf-81e0-0f73f53a94c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:22.569617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 743/1495] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:20:22.574397 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ad336-60b2-4431-aadd-f2a73c903c59 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:20:22.575574 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-873ad336-60b2-4431-aadd-f2a73c903c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:22.587636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ad336-60b2-4431-aadd-f2a73c903c59 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:20:22.648824 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:22.682329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbb644-2937-4a1d-835c-d6829c331969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:20:22.682997 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbb644-2937-4a1d-835c-d6829c331969 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:22.683277 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbb644-2937-4a1d-835c-d6829c331969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:22.683550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbb644-2937-4a1d-835c-d6829c331969 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:22.684270 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbb644-2937-4a1d-835c-d6829c331969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:20:22.684571 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbb644-2937-4a1d-835c-d6829c331969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:20:22.685580 dv-cinder-819149-14-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-62cbb644-2937-4a1d-835c-d6829c331969 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:20:22.685580 dv-cinder-819149-14-smb devstack@keystone.service[80234]: warnings.warn(msg) Jul 20 19:20:22.685580 dv-cinder-819149-14-smb devstack@keystone.service[80234]: Jul 20 19:20:22.686489 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbb644-2937-4a1d-835c-d6829c331969 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:20:22.697396 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 753/1496] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:20:22.705622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6570f-5ca4-40bf-81e0-0f73f53a94c1 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:20:22.714649 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6570f-5ca4-40bf-81e0-0f73f53a94c1 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:20:22.777454 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:22.813465 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d08fe-f593-4373-962c-320f43b3bc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:20:22.814124 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d08fe-f593-4373-962c-320f43b3bc3c admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:22.814440 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d08fe-f593-4373-962c-320f43b3bc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:22.814716 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d08fe-f593-4373-962c-320f43b3bc3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:22.815396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d08fe-f593-4373-962c-320f43b3bc3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:20:22.817167 dv-cinder-819149-14-smb devstack@keystone.service[80233]: WARNING py.warnings [None req-902d08fe-f593-4373-962c-320f43b3bc3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:20:22.817167 dv-cinder-819149-14-smb devstack@keystone.service[80233]: warnings.warn(msg) Jul 20 19:20:22.817167 dv-cinder-819149-14-smb devstack@keystone.service[80233]: Jul 20 19:20:22.818996 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d08fe-f593-4373-962c-320f43b3bc3c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:20:22.873388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 744/1497] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:20:22 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:20:22.877667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbb644-2937-4a1d-835c-d6829c331969 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:20:22.879219 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-62cbb644-2937-4a1d-835c-d6829c331969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:22.915271 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbb644-2937-4a1d-835c-d6829c331969 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:20:23.013188 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60674e11-8db2-4b44-8373-cdfc0e350633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:20:23.013857 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60674e11-8db2-4b44-8373-cdfc0e350633 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:23.014139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60674e11-8db2-4b44-8373-cdfc0e350633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:23.014445 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60674e11-8db2-4b44-8373-cdfc0e350633 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:23.015186 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60674e11-8db2-4b44-8373-cdfc0e350633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:20:23.016145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-60674e11-8db2-4b44-8373-cdfc0e350633 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:20:23.016145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: warnings.warn(msg) Jul 20 19:20:23.016145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: Jul 20 19:20:23.017345 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60674e11-8db2-4b44-8373-cdfc0e350633 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:20:23.058540 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 754/1498] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:20:22 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:20:23.062638 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d08fe-f593-4373-962c-320f43b3bc3c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:20:23.064135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-902d08fe-f593-4373-962c-320f43b3bc3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:23.125428 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d08fe-f593-4373-962c-320f43b3bc3c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:20:23.208521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:23.219525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22339f19-1083-42d3-8c14-d184632cf91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:20:23.220187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22339f19-1083-42d3-8c14-d184632cf91a admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:23.220467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22339f19-1083-42d3-8c14-d184632cf91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:23.220740 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22339f19-1083-42d3-8c14-d184632cf91a admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:23.221456 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22339f19-1083-42d3-8c14-d184632cf91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:20:23.222495 dv-cinder-819149-14-smb devstack@keystone.service[80233]: WARNING py.warnings [None req-22339f19-1083-42d3-8c14-d184632cf91a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:20:23.222495 dv-cinder-819149-14-smb devstack@keystone.service[80233]: warnings.warn(msg) Jul 20 19:20:23.222495 dv-cinder-819149-14-smb devstack@keystone.service[80233]: Jul 20 19:20:23.223366 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22339f19-1083-42d3-8c14-d184632cf91a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:20:23.235971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 745/1499] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:20:23.240032 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60674e11-8db2-4b44-8373-cdfc0e350633 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:20:23.242133 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-60674e11-8db2-4b44-8373-cdfc0e350633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:23.253810 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60674e11-8db2-4b44-8373-cdfc0e350633 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:20:23.278750 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:23.358255 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda0bfe-1c84-4141-b3bb-9df13918b14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:20:23.358975 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda0bfe-1c84-4141-b3bb-9df13918b14b admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:23.359261 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda0bfe-1c84-4141-b3bb-9df13918b14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:23.359542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda0bfe-1c84-4141-b3bb-9df13918b14b admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:23.360298 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda0bfe-1c84-4141-b3bb-9df13918b14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:20:23.361341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-bfda0bfe-1c84-4141-b3bb-9df13918b14b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:20:23.361341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: warnings.warn(msg) Jul 20 19:20:23.361341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: Jul 20 19:20:23.362293 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda0bfe-1c84-4141-b3bb-9df13918b14b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:20:23.384170 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 755/1500] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:20:23.388616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22339f19-1083-42d3-8c14-d184632cf91a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:20:23.390188 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-22339f19-1083-42d3-8c14-d184632cf91a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:23.424686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22339f19-1083-42d3-8c14-d184632cf91a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:20:23.517734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd28ab-8d2a-4e6e-94bb-a02a93c9042d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:20:23.518653 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd28ab-8d2a-4e6e-94bb-a02a93c9042d admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:23.518939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd28ab-8d2a-4e6e-94bb-a02a93c9042d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:23.519215 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd28ab-8d2a-4e6e-94bb-a02a93c9042d admin admin] PATH_INFO: `/v3/projects/751217566bef48d8afd407b4db5b5d80/users/fd7fb72165f04b789cc63b9a9829a62f/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:23.542037 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd28ab-8d2a-4e6e-94bb-a02a93c9042d admin admin] RBAC: Authorizing `identity:create_grant(project_id=751217566bef48d8afd407b4db5b5d80, user_id=fd7fb72165f04b789cc63b9a9829a62f, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:20:23.543038 dv-cinder-819149-14-smb devstack@keystone.service[80233]: WARNING py.warnings [None req-36bd28ab-8d2a-4e6e-94bb-a02a93c9042d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:20:23.543038 dv-cinder-819149-14-smb devstack@keystone.service[80233]: warnings.warn(msg) Jul 20 19:20:23.543038 dv-cinder-819149-14-smb devstack@keystone.service[80233]: Jul 20 19:20:23.545025 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd28ab-8d2a-4e6e-94bb-a02a93c9042d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:20:23.570236 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 746/1501] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:20:23 2022] PUT /identity/v3/projects/751217566bef48d8afd407b4db5b5d80/users/fd7fb72165f04b789cc63b9a9829a62f/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:20:23.582619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432b1e6-9c29-4da8-a3da-a861377f06df None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:23.582914 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432b1e6-9c29-4da8-a3da-a861377f06df None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:23.583201 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432b1e6-9c29-4da8-a3da-a861377f06df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:23.638817 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3432b1e6-9c29-4da8-a3da-a861377f06df None None] MFA Rules not processed for user `fd7fb72165f04b789cc63b9a9829a62f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:20:23.640064 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3432b1e6-9c29-4da8-a3da-a861377f06df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:23.741405 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 756/1502] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:20:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:20:23.754609 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf565684-ab15-440d-bba7-e7e85801fa94 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:23.754903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf565684-ab15-440d-bba7-e7e85801fa94 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:23.755212 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf565684-ab15-440d-bba7-e7e85801fa94 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:23.756640 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 747/1503] 10.222.0.18 () {54 vars in 964 bytes} [Wed Jul 20 19:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:20:23.761425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1d3b2-2c52-46b9-a345-5a445790cf5d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:23.761714 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1d3b2-2c52-46b9-a345-5a445790cf5d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:23.761991 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1d3b2-2c52-46b9-a345-5a445790cf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:23.793362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:23.839602 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0ce1d3b2-2c52-46b9-a345-5a445790cf5d None None] MFA Rules not processed for user `bd4ce33a2a1248c6a3199265f40e86f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:20:23.840807 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0ce1d3b2-2c52-46b9-a345-5a445790cf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:23.915240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 757/1504] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Jul 20 19:20:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:20:23.922851 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf565684-ab15-440d-bba7-e7e85801fa94 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:20:23.924397 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bf565684-ab15-440d-bba7-e7e85801fa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:23.974544 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:24.030210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf565684-ab15-440d-bba7-e7e85801fa94 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:20:24.222119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4234b-7734-48a7-a209-01442d3311df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:20:24.222815 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4234b-7734-48a7-a209-01442d3311df service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:24.223100 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4234b-7734-48a7-a209-01442d3311df service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:24.223379 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4234b-7734-48a7-a209-01442d3311df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:24.225049 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-eda4234b-7734-48a7-a209-01442d3311df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:24.323578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4234b-7734-48a7-a209-01442d3311df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:20:24.325029 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4234b-7734-48a7-a209-01442d3311df service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:20:24.328578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:24.344046 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 748/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:20:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:20:24.386727 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa5aad-9b07-4ab3-9202-af51010af5ae None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:24.387171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa5aad-9b07-4ab3-9202-af51010af5ae None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:24.387288 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa5aad-9b07-4ab3-9202-af51010af5ae None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:24.388546 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 758/1506] 10.222.0.18 () {52 vars in 829 bytes} [Wed Jul 20 19:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:20:24.392045 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4234b-7734-48a7-a209-01442d3311df service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:20:24.393255 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-eda4234b-7734-48a7-a209-01442d3311df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:24.490192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4234b-7734-48a7-a209-01442d3311df service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:20:24.583836 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9607c-ee10-4802-9fe4-fe487e0770ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:20:24.584722 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9607c-ee10-4802-9fe4-fe487e0770ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:24.585006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9607c-ee10-4802-9fe4-fe487e0770ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:24.585284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9607c-ee10-4802-9fe4-fe487e0770ff admin admin] PATH_INFO: `/v3/users/fd7fb72165f04b789cc63b9a9829a62f` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:24.598726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e9607c-ee10-4802-9fe4-fe487e0770ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd7fb72165f04b789cc63b9a9829a62f)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:20:24.600264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: WARNING py.warnings [None req-a3e9607c-ee10-4802-9fe4-fe487e0770ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:20:24.600264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: warnings.warn(msg) Jul 20 19:20:24.600264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: Jul 20 19:20:24.601480 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e9607c-ee10-4802-9fe4-fe487e0770ff admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:20:24.611447 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:24.666238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a3e9607c-ee10-4802-9fe4-fe487e0770ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd7fb72165f04b789cc63b9a9829a62f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:20:24.680515 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a3e9607c-ee10-4802-9fe4-fe487e0770ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd7fb72165f04b789cc63b9a9829a62f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:20:24.689971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a3e9607c-ee10-4802-9fe4-fe487e0770ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd7fb72165f04b789cc63b9a9829a62f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:20:24.690572 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a3e9607c-ee10-4802-9fe4-fe487e0770ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd7fb72165f04b789cc63b9a9829a62f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:20:24.690982 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a3e9607c-ee10-4802-9fe4-fe487e0770ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd7fb72165f04b789cc63b9a9829a62f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:20:24.714569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 749/1507] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:20:24 2022] DELETE /identity/v3/users/fd7fb72165f04b789cc63b9a9829a62f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:20:24.719023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354143a-f11b-43ec-aec4-485585d0507e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:24.719381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354143a-f11b-43ec-aec4-485585d0507e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:24.719730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354143a-f11b-43ec-aec4-485585d0507e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:24.776488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d354143a-f11b-43ec-aec4-485585d0507e None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:20:24.777702 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d354143a-f11b-43ec-aec4-485585d0507e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:24.852034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:24.864630 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 759/1508] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:20:24.875507 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9607c-ee10-4802-9fe4-fe487e0770ff admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:20:24.876719 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a3e9607c-ee10-4802-9fe4-fe487e0770ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:24.975690 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9607c-ee10-4802-9fe4-fe487e0770ff admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:20:25.035692 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:25.056569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b05998-3334-414b-bd4b-d9b5cb23fc93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:20:25.057226 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b05998-3334-414b-bd4b-d9b5cb23fc93 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:25.057509 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b05998-3334-414b-bd4b-d9b5cb23fc93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:25.057783 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b05998-3334-414b-bd4b-d9b5cb23fc93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:25.059472 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-68b05998-3334-414b-bd4b-d9b5cb23fc93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:25.166671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b05998-3334-414b-bd4b-d9b5cb23fc93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:20:25.168112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b05998-3334-414b-bd4b-d9b5cb23fc93 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:20:25.188425 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 750/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:20:25.560194 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354143a-f11b-43ec-aec4-485585d0507e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:20:25.561414 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d354143a-f11b-43ec-aec4-485585d0507e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:20:25.573101 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354143a-f11b-43ec-aec4-485585d0507e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:20:25.679432 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c53685-a0d7-46a9-9982-235856b9b2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:20:25.680245 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c53685-a0d7-46a9-9982-235856b9b2b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:20:25.680527 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c53685-a0d7-46a9-9982-235856b9b2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:20:25.680796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c53685-a0d7-46a9-9982-235856b9b2b4 admin admin] PATH_INFO: `/v3/projects/751217566bef48d8afd407b4db5b5d80` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:20:25.690980 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c53685-a0d7-46a9-9982-235856b9b2b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=751217566bef48d8afd407b4db5b5d80)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:20:25.692001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-f2c53685-a0d7-46a9-9982-235856b9b2b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:20:25.692001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: warnings.warn(msg) Jul 20 19:20:25.692001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: Jul 20 19:20:25.693184 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c53685-a0d7-46a9-9982-235856b9b2b4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:20:25.753499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f2c53685-a0d7-46a9-9982-235856b9b2b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '751217566bef48d8afd407b4db5b5d80', 'request_id': 'req-f2c53685-a0d7-46a9-9982-235856b9b2b4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:20:25.767453 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f2c53685-a0d7-46a9-9982-235856b9b2b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '751217566bef48d8afd407b4db5b5d80', 'request_id': 'req-f2c53685-a0d7-46a9-9982-235856b9b2b4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:20:25.777803 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f2c53685-a0d7-46a9-9982-235856b9b2b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '751217566bef48d8afd407b4db5b5d80', 'request_id': 'req-f2c53685-a0d7-46a9-9982-235856b9b2b4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:20:25.801979 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f2c53685-a0d7-46a9-9982-235856b9b2b4 admin admin] The token cache is being invalidate because project 751217566bef48d8afd407b4db5b5d80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:20:25.802264 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f2c53685-a0d7-46a9-9982-235856b9b2b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:20:25.802949 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f2c53685-a0d7-46a9-9982-235856b9b2b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:20:25.804551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 760/1510] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:20:25 2022] DELETE /identity/v3/projects/751217566bef48d8afd407b4db5b5d80 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:20:35.185804 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=62 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:20:35.800002 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:22:18.785828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017bb53-e643-4387-bd2e-8818f31e2f3b None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:18.786970 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017bb53-e643-4387-bd2e-8818f31e2f3b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:18.786970 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017bb53-e643-4387-bd2e-8818f31e2f3b None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:18.788419 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:22:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:22:18.793589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfab50-ec35-4520-8337-da345ea511af None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:18.794022 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfab50-ec35-4520-8337-da345ea511af None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:18.794157 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfab50-ec35-4520-8337-da345ea511af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:18.875093 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-67cfab50-ec35-4520-8337-da345ea511af None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:22:18.876253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-67cfab50-ec35-4520-8337-da345ea511af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:22:18.979394 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:22:19.142439 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017bb53-e643-4387-bd2e-8818f31e2f3b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:22:19.144583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e017bb53-e643-4387-bd2e-8818f31e2f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:22:19.264731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017bb53-e643-4387-bd2e-8818f31e2f3b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:22:19.270207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615fa9b-e1b4-43d6-9d08-883c24f71871 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:22:19.271408 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615fa9b-e1b4-43d6-9d08-883c24f71871 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:19.271695 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615fa9b-e1b4-43d6-9d08-883c24f71871 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:19.271976 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615fa9b-e1b4-43d6-9d08-883c24f71871 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:19.280243 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615fa9b-e1b4-43d6-9d08-883c24f71871 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:22:19.281837 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615fa9b-e1b4-43d6-9d08-883c24f71871 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:22:19.292163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 752/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:22:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:22:20.135254 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d8754-763e-4d0c-884d-601b252c12ca None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:20.135828 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d8754-763e-4d0c-884d-601b252c12ca None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:20.135828 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d8754-763e-4d0c-884d-601b252c12ca None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:20.137221 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:22:20.142631 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d872d-37f1-470a-a272-65af9978ea7e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:20.143215 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d872d-37f1-470a-a272-65af9978ea7e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:20.143500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d872d-37f1-470a-a272-65af9978ea7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:20.161937 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ee7d872d-37f1-470a-a272-65af9978ea7e None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:22:20.163167 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ee7d872d-37f1-470a-a272-65af9978ea7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:22:20.171144 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 753/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:22:20.321988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d8754-763e-4d0c-884d-601b252c12ca None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:22:20.338714 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d8754-763e-4d0c-884d-601b252c12ca None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:22:20.344288 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b9bf3-ed64-4a5c-8b9d-d30ed311c3e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:22:20.344929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b9bf3-ed64-4a5c-8b9d-d30ed311c3e5 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:20.345217 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b9bf3-ed64-4a5c-8b9d-d30ed311c3e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:20.345500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b9bf3-ed64-4a5c-8b9d-d30ed311c3e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:20.354805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b9bf3-ed64-4a5c-8b9d-d30ed311c3e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:22:20.357329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b9bf3-ed64-4a5c-8b9d-d30ed311c3e5 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:22:20.368499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 763/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:22:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:22:21.036700 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f8f03-0ed5-4672-82f1-00eda65bb08c None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:21.036984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f8f03-0ed5-4672-82f1-00eda65bb08c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:21.037259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f8f03-0ed5-4672-82f1-00eda65bb08c None None] PATH_INFO: `/v3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:21.038747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 754/1517] 10.222.0.88 () {54 vars in 925 bytes} [Wed Jul 20 19:22:21 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:22:21.044964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844aec8-ac8b-4dc9-b541-194bc6f11d24 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:21.045257 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844aec8-ac8b-4dc9-b541-194bc6f11d24 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:21.045537 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844aec8-ac8b-4dc9-b541-194bc6f11d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:21.106061 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1844aec8-ac8b-4dc9-b541-194bc6f11d24 None None] MFA Rules not processed for user `d310799ac43e42bc9c7810e1296ddb9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:22:21.107245 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1844aec8-ac8b-4dc9-b541-194bc6f11d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:22:21.124150 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:22:21.178549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 764/1518] 10.222.0.88 () {58 vars in 1015 bytes} [Wed Jul 20 19:22:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:22:30.156759 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=56 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:22:31.175162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=23 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:22:31.426590 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df69b9-9b68-43ab-9fd0-a727f36c3222 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:31.427146 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df69b9-9b68-43ab-9fd0-a727f36c3222 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:31.427146 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df69b9-9b68-43ab-9fd0-a727f36c3222 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:31.428454 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 755/1519] 10.222.0.18 () {54 vars in 961 bytes} [Wed Jul 20 19:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:22:31.433813 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9d058-6e83-47a9-9154-abdb5fb372be None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:31.434179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9d058-6e83-47a9-9154-abdb5fb372be None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:31.434496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9d058-6e83-47a9-9154-abdb5fb372be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:31.453075 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-14d9d058-6e83-47a9-9154-abdb5fb372be None None] MFA Rules not processed for user `d310799ac43e42bc9c7810e1296ddb9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:22:31.454265 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-14d9d058-6e83-47a9-9154-abdb5fb372be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:22:31.463631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 765/1520] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Jul 20 19:22:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:22:31.470941 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df69b9-9b68-43ab-9fd0-a727f36c3222 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:22:31.490331 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df69b9-9b68-43ab-9fd0-a727f36c3222 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:22:31.496977 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e97232-1b6e-40a5-838a-24c379638ac9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd310799ac43e42bc9c7810e1296ddb9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:22:31.497632 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e97232-1b6e-40a5-838a-24c379638ac9 service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:31.497923 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e97232-1b6e-40a5-838a-24c379638ac9 service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:31.498205 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e97232-1b6e-40a5-838a-24c379638ac9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:31.507200 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e97232-1b6e-40a5-838a-24c379638ac9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:22:31.508794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e97232-1b6e-40a5-838a-24c379638ac9 service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:22:31.518456 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 756/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:22:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:22:31.642458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1c8ea-a93e-48bf-8107-74efefff6867 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:31.642736 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1c8ea-a93e-48bf-8107-74efefff6867 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:31.643010 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1c8ea-a93e-48bf-8107-74efefff6867 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:31.644392 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 766/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:22:31.649428 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08886ea-9785-4968-8bf6-ab2c5b7f3666 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:31.649723 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08886ea-9785-4968-8bf6-ab2c5b7f3666 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:31.650008 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08886ea-9785-4968-8bf6-ab2c5b7f3666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:31.669026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d08886ea-9785-4968-8bf6-ab2c5b7f3666 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:22:31.670273 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d08886ea-9785-4968-8bf6-ab2c5b7f3666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:22:31.679259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 757/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:22:31.840724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1c8ea-a93e-48bf-8107-74efefff6867 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:22:31.862050 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1c8ea-a93e-48bf-8107-74efefff6867 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:22:31.864853 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1a319-ca4e-420a-b49c-47a06572d2cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:22:31.865547 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1a319-ca4e-420a-b49c-47a06572d2cf service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:31.865857 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1a319-ca4e-420a-b49c-47a06572d2cf service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:31.866114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1a319-ca4e-420a-b49c-47a06572d2cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:31.876468 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1a319-ca4e-420a-b49c-47a06572d2cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:22:31.878078 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1a319-ca4e-420a-b49c-47a06572d2cf service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:22:31.889184 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 767/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:22:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:22:32.736333 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24f214-1dd7-44c2-9ad1-cc7acec1b21f None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:32.736875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24f214-1dd7-44c2-9ad1-cc7acec1b21f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:32.737006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24f214-1dd7-44c2-9ad1-cc7acec1b21f None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:32.738328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 758/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 19:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:22:32.743769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fe094-76fd-44d4-9a7b-9e4df9168252 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:32.744186 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fe094-76fd-44d4-9a7b-9e4df9168252 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:32.744323 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fe094-76fd-44d4-9a7b-9e4df9168252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:32.762488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7f4fe094-76fd-44d4-9a7b-9e4df9168252 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:22:32.763695 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7f4fe094-76fd-44d4-9a7b-9e4df9168252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:22:32.771942 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 768/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 19:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:22:32.924042 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24f214-1dd7-44c2-9ad1-cc7acec1b21f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:22:32.939579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24f214-1dd7-44c2-9ad1-cc7acec1b21f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:22:32.945685 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd12c3-db4f-4b08-be91-d14d1545757c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:22:32.946347 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd12c3-db4f-4b08-be91-d14d1545757c service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:32.946638 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd12c3-db4f-4b08-be91-d14d1545757c service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:32.946918 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd12c3-db4f-4b08-be91-d14d1545757c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:32.955736 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd12c3-db4f-4b08-be91-d14d1545757c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:22:32.957312 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd12c3-db4f-4b08-be91-d14d1545757c service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:22:32.967026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 759/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:22:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:22:37.379238 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce67d6e-9653-4c18-92b5-618f9871e6e0 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:37.379798 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce67d6e-9653-4c18-92b5-618f9871e6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:37.379798 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce67d6e-9653-4c18-92b5-618f9871e6e0 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:37.381231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 769/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:22:37.386637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ba6e6-85b1-41ce-b1f4-08c4f8426519 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:37.387056 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ba6e6-85b1-41ce-b1f4-08c4f8426519 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:37.387202 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ba6e6-85b1-41ce-b1f4-08c4f8426519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:37.405220 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e92ba6e6-85b1-41ce-b1f4-08c4f8426519 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:22:37.406453 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e92ba6e6-85b1-41ce-b1f4-08c4f8426519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:22:37.415262 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 760/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:22:37.487895 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce67d6e-9653-4c18-92b5-618f9871e6e0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:22:37.490114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cce67d6e-9653-4c18-92b5-618f9871e6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:22:37.568127 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce67d6e-9653-4c18-92b5-618f9871e6e0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:22:37.571677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b1a66-8ad2-4729-8aa0-31501e63d72d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:22:37.572320 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b1a66-8ad2-4729-8aa0-31501e63d72d service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:37.572607 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b1a66-8ad2-4729-8aa0-31501e63d72d service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:37.572886 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b1a66-8ad2-4729-8aa0-31501e63d72d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:37.582594 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b1a66-8ad2-4729-8aa0-31501e63d72d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:22:37.583519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b1a66-8ad2-4729-8aa0-31501e63d72d service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:22:37.593037 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 770/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:22:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:22:39.638449 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffe1a3-983c-4113-ba47-8b9384ae323a None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:39.638958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffe1a3-983c-4113-ba47-8b9384ae323a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:39.639054 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ffe1a3-983c-4113-ba47-8b9384ae323a None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:39.640455 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 761/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:22:39.646112 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd6c5f-a9ca-459f-b36e-93a752761695 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:39.646608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd6c5f-a9ca-459f-b36e-93a752761695 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:39.646865 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd6c5f-a9ca-459f-b36e-93a752761695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:39.664945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-dcbd6c5f-a9ca-459f-b36e-93a752761695 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:22:39.666144 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dcbd6c5f-a9ca-459f-b36e-93a752761695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:22:39.674125 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 771/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:22:39.711555 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffe1a3-983c-4113-ba47-8b9384ae323a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:22:39.722340 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ffe1a3-983c-4113-ba47-8b9384ae323a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:22:39.725900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21aa621-2d02-40ce-a984-74a446b12505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:22:39.726575 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21aa621-2d02-40ce-a984-74a446b12505 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:39.726864 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21aa621-2d02-40ce-a984-74a446b12505 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:39.727146 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21aa621-2d02-40ce-a984-74a446b12505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:39.736033 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21aa621-2d02-40ce-a984-74a446b12505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:22:39.737457 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21aa621-2d02-40ce-a984-74a446b12505 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:22:39.746843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 762/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:22:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:22:43.587862 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854034b-0406-4a3e-93be-6af186fee12c None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:43.588295 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854034b-0406-4a3e-93be-6af186fee12c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:43.588444 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854034b-0406-4a3e-93be-6af186fee12c None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:43.589881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 772/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:22:43.595130 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef02c0d-6926-466c-9f19-f83ce5f6b2a4 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:43.595518 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef02c0d-6926-466c-9f19-f83ce5f6b2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:43.595684 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef02c0d-6926-466c-9f19-f83ce5f6b2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:43.614556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1ef02c0d-6926-466c-9f19-f83ce5f6b2a4 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:22:43.615754 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1ef02c0d-6926-466c-9f19-f83ce5f6b2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:22:43.623523 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 763/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:22:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:22:43.927113 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854034b-0406-4a3e-93be-6af186fee12c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:22:43.928893 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b854034b-0406-4a3e-93be-6af186fee12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:22:44.008679 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854034b-0406-4a3e-93be-6af186fee12c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:22:44.012227 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964bb7d5-dc0b-4432-ba39-959bac688e69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:22:44.012865 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bb7d5-dc0b-4432-ba39-959bac688e69 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:44.013149 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bb7d5-dc0b-4432-ba39-959bac688e69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:44.013427 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bb7d5-dc0b-4432-ba39-959bac688e69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:44.022956 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964bb7d5-dc0b-4432-ba39-959bac688e69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:22:44.024382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964bb7d5-dc0b-4432-ba39-959bac688e69 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:22:44.033642 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 773/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:22:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:22:46.110362 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1369312-d83d-498e-bcb6-5de25adecbfa None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:46.110897 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1369312-d83d-498e-bcb6-5de25adecbfa None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:46.110897 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1369312-d83d-498e-bcb6-5de25adecbfa None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:46.112272 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 764/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 19:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:22:46.118044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92ec59-8073-43d3-8fd4-5d8a93d70190 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:46.118518 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92ec59-8073-43d3-8fd4-5d8a93d70190 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:46.118677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92ec59-8073-43d3-8fd4-5d8a93d70190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:46.137555 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-da92ec59-8073-43d3-8fd4-5d8a93d70190 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:22:46.138798 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-da92ec59-8073-43d3-8fd4-5d8a93d70190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:22:46.146668 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 774/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 19:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:22:46.454210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1369312-d83d-498e-bcb6-5de25adecbfa None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:22:46.455995 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a1369312-d83d-498e-bcb6-5de25adecbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:22:46.474574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1369312-d83d-498e-bcb6-5de25adecbfa None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:22:46.478413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e4be0-18c1-43d4-bd44-5f536ccbaeb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:22:46.479090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e4be0-18c1-43d4-bd44-5f536ccbaeb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:22:46.479378 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e4be0-18c1-43d4-bd44-5f536ccbaeb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:22:46.479656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e4be0-18c1-43d4-bd44-5f536ccbaeb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:22:46.490167 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e4be0-18c1-43d4-bd44-5f536ccbaeb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:22:46.491725 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e4be0-18c1-43d4-bd44-5f536ccbaeb5 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:22:46.502173 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 765/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:22:56.132509 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=88 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:22:56.497502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=33 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:32.247092 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b9f9a-bd38-4589-a21d-7ef0df2d9c1d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:32.247779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b9f9a-bd38-4589-a21d-7ef0df2d9c1d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:32.247779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b9f9a-bd38-4589-a21d-7ef0df2d9c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:32.274796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-af0b9f9a-bd38-4589-a21d-7ef0df2d9c1d None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:32.276192 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-af0b9f9a-bd38-4589-a21d-7ef0df2d9c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:32.289576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 775/1540] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:32.299543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e9a74-8544-4630-95c2-1428290ddbec None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:32.300639 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e9a74-8544-4630-95c2-1428290ddbec None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:32.301161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e9a74-8544-4630-95c2-1428290ddbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:32.329834 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1c9e9a74-8544-4630-95c2-1428290ddbec None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:32.331112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1c9e9a74-8544-4630-95c2-1428290ddbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:32.340379 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5702f45-f5e5-4bed-ac42-6d83bb50a46a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:32.340982 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5702f45-f5e5-4bed-ac42-6d83bb50a46a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:32.341369 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5702f45-f5e5-4bed-ac42-6d83bb50a46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:32.346991 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 766/1541] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:32.353354 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e9a74-8544-4630-95c2-1428290ddbec None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:32.367120 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e9a74-8544-4630-95c2-1428290ddbec None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:32.371139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b5702f45-f5e5-4bed-ac42-6d83bb50a46a None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:32.372374 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b5702f45-f5e5-4bed-ac42-6d83bb50a46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:32.379488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b0f39-c262-43b0-91c9-dcfbc08dccbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:32.380289 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b0f39-c262-43b0-91c9-dcfbc08dccbb admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:32.380571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b0f39-c262-43b0-91c9-dcfbc08dccbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:32.380851 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b0f39-c262-43b0-91c9-dcfbc08dccbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:32.381586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b0f39-c262-43b0-91c9-dcfbc08dccbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:24:32.381897 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b0f39-c262-43b0-91c9-dcfbc08dccbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:32.382971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: WARNING py.warnings [None req-ad0b0f39-c262-43b0-91c9-dcfbc08dccbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:24:32.382971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: warnings.warn(msg) Jul 20 19:24:32.382971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: Jul 20 19:24:32.383878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b0f39-c262-43b0-91c9-dcfbc08dccbb admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:32.395955 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 776/1542] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:24:32.403879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 767/1543] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:24:32.406909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323fdf3-3fca-4945-b05b-03274a3b24d5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:32.407207 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323fdf3-3fca-4945-b05b-03274a3b24d5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:32.407491 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323fdf3-3fca-4945-b05b-03274a3b24d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:32.412449 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b0f39-c262-43b0-91c9-dcfbc08dccbb admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:32.428982 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b0f39-c262-43b0-91c9-dcfbc08dccbb admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:32.440893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80355ee-6f5b-41e4-befc-a8ba11ed1356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:32.441576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80355ee-6f5b-41e4-befc-a8ba11ed1356 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:32.441861 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80355ee-6f5b-41e4-befc-a8ba11ed1356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:32.442143 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80355ee-6f5b-41e4-befc-a8ba11ed1356 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:32.442882 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80355ee-6f5b-41e4-befc-a8ba11ed1356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:32.445018 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80355ee-6f5b-41e4-befc-a8ba11ed1356 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:32.447654 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1323fdf3-3fca-4945-b05b-03274a3b24d5 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:32.448904 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1323fdf3-3fca-4945-b05b-03274a3b24d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:32.469384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 777/1544] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:32.475121 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323fdf3-3fca-4945-b05b-03274a3b24d5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:32.489278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323fdf3-3fca-4945-b05b-03274a3b24d5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:32.503278 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 768/1545] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:32 2022] POST /identity/v3/projects => generated 379 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:24:32.504426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65738c-ab9b-4fed-b2ee-351cdbc12238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:32.505109 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65738c-ab9b-4fed-b2ee-351cdbc12238 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:32.505397 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65738c-ab9b-4fed-b2ee-351cdbc12238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:32.505673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65738c-ab9b-4fed-b2ee-351cdbc12238 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:32.506549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65738c-ab9b-4fed-b2ee-351cdbc12238 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:24:32.506861 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65738c-ab9b-4fed-b2ee-351cdbc12238 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:32.507065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80355ee-6f5b-41e4-befc-a8ba11ed1356 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:32.508608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65738c-ab9b-4fed-b2ee-351cdbc12238 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:32.528648 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 778/1546] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:24:32.535390 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65738c-ab9b-4fed-b2ee-351cdbc12238 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:32.560832 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65738c-ab9b-4fed-b2ee-351cdbc12238 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:32.588016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80355ee-6f5b-41e4-befc-a8ba11ed1356 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:32.598984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a77fd5-5b6d-405e-b64d-4cd4a10637ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:32.599672 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a77fd5-5b6d-405e-b64d-4cd4a10637ff admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:32.599959 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a77fd5-5b6d-405e-b64d-4cd4a10637ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:32.600242 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a77fd5-5b6d-405e-b64d-4cd4a10637ff admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:32.600942 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a77fd5-5b6d-405e-b64d-4cd4a10637ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:32.601992 dv-cinder-819149-14-smb devstack@keystone.service[80233]: WARNING py.warnings [None req-53a77fd5-5b6d-405e-b64d-4cd4a10637ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:24:32.601992 dv-cinder-819149-14-smb devstack@keystone.service[80233]: warnings.warn(msg) Jul 20 19:24:32.601992 dv-cinder-819149-14-smb devstack@keystone.service[80233]: Jul 20 19:24:32.603255 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a77fd5-5b6d-405e-b64d-4cd4a10637ff admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:32.655260 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 769/1547] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:32 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:24:32.664064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc087f7-dd5b-4f0a-b0d4-d9b0769e1185 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:32.664354 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc087f7-dd5b-4f0a-b0d4-d9b0769e1185 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:32.664637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc087f7-dd5b-4f0a-b0d4-d9b0769e1185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:32.706185 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa8430-5cca-49df-bf69-cd0b3cbdce41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:32.709031 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa8430-5cca-49df-bf69-cd0b3cbdce41 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:32.709379 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa8430-5cca-49df-bf69-cd0b3cbdce41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:32.709815 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa8430-5cca-49df-bf69-cd0b3cbdce41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:32.711178 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa8430-5cca-49df-bf69-cd0b3cbdce41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:32.712933 dv-cinder-819149-14-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-67fa8430-5cca-49df-bf69-cd0b3cbdce41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:24:32.712933 dv-cinder-819149-14-smb devstack@keystone.service[80234]: warnings.warn(msg) Jul 20 19:24:32.712933 dv-cinder-819149-14-smb devstack@keystone.service[80234]: Jul 20 19:24:32.720952 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1fc087f7-dd5b-4f0a-b0d4-d9b0769e1185 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:32.722209 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1fc087f7-dd5b-4f0a-b0d4-d9b0769e1185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:32.722764 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa8430-5cca-49df-bf69-cd0b3cbdce41 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:32.750622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 770/1548] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:32.751987 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54473895-d4a6-4d5b-a413-e0de75970087 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:32.752250 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54473895-d4a6-4d5b-a413-e0de75970087 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:32.752580 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54473895-d4a6-4d5b-a413-e0de75970087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:32.765052 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 779/1549] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:32 2022] POST /identity/v3/projects => generated 375 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:24:32.765755 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa8430-5cca-49df-bf69-cd0b3cbdce41 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:32.788005 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-54473895-d4a6-4d5b-a413-e0de75970087 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:32.789276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-54473895-d4a6-4d5b-a413-e0de75970087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:32.843775 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa8430-5cca-49df-bf69-cd0b3cbdce41 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:32.849230 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fec46d-37f6-411a-9c14-5404065c0ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:32.849912 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fec46d-37f6-411a-9c14-5404065c0ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:32.850205 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fec46d-37f6-411a-9c14-5404065c0ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:32.850518 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fec46d-37f6-411a-9c14-5404065c0ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:32.851259 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fec46d-37f6-411a-9c14-5404065c0ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:32.852881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fec46d-37f6-411a-9c14-5404065c0ac1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:32.867301 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 780/1550] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:32.867301 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02a846-7d84-4377-837a-ca0fa35fd1ba None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:32.867301 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02a846-7d84-4377-837a-ca0fa35fd1ba None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:32.867301 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02a846-7d84-4377-837a-ca0fa35fd1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:32.870400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 771/1551] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:32.874510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d649b94-d437-4b08-9886-b8213e53d4e6 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:32.874510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d649b94-d437-4b08-9886-b8213e53d4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:32.874510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d649b94-d437-4b08-9886-b8213e53d4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:32.888520 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4c02a846-7d84-4377-837a-ca0fa35fd1ba None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:32.889775 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4c02a846-7d84-4377-837a-ca0fa35fd1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:32.895177 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6d649b94-d437-4b08-9886-b8213e53d4e6 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:32.895177 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6d649b94-d437-4b08-9886-b8213e53d4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:32.908423 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 781/1552] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:32.908841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 772/1553] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:32.908937 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c3ee3-a197-4419-987f-441d7086cc8f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:32.908937 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c3ee3-a197-4419-987f-441d7086cc8f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:32.908937 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c3ee3-a197-4419-987f-441d7086cc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:32.909168 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e0f41-7789-49da-beaf-ebbea0edd7bf None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:32.909168 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e0f41-7789-49da-beaf-ebbea0edd7bf None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:32.909168 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e0f41-7789-49da-beaf-ebbea0edd7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:32.927332 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-db1e0f41-7789-49da-beaf-ebbea0edd7bf None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:32.927888 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-961c3ee3-a197-4419-987f-441d7086cc8f None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:32.928558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-db1e0f41-7789-49da-beaf-ebbea0edd7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:32.929116 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-961c3ee3-a197-4419-987f-441d7086cc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:32.937584 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 782/1554] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:32.939037 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 773/1555] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:32.939263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c3ee3-a197-4419-987f-441d7086cc8f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:32.940646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5822430-01a8-4fb7-8469-3e53f3344669 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:32.940939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5822430-01a8-4fb7-8469-3e53f3344669 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:32.941217 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5822430-01a8-4fb7-8469-3e53f3344669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:32.951229 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c3ee3-a197-4419-987f-441d7086cc8f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:32.956699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32ac42-6bf7-4784-8a61-819c4eab487f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:32.957381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32ac42-6bf7-4784-8a61-819c4eab487f admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:32.957666 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32ac42-6bf7-4784-8a61-819c4eab487f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:32.957945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32ac42-6bf7-4784-8a61-819c4eab487f admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:32.958725 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32ac42-6bf7-4784-8a61-819c4eab487f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:32.960785 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32ac42-6bf7-4784-8a61-819c4eab487f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:32.962138 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b5822430-01a8-4fb7-8469-3e53f3344669 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:32.963382 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b5822430-01a8-4fb7-8469-3e53f3344669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:32.974850 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 774/1556] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:32.975938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5822430-01a8-4fb7-8469-3e53f3344669 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:32.986805 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5822430-01a8-4fb7-8469-3e53f3344669 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:32.991604 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db57a4e-ad98-4495-9935-9e271a826e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:32.994869 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 783/1557] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:32 2022] POST /identity/v3/users => generated 288 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:32.995004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db57a4e-ad98-4495-9935-9e271a826e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:32.995004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db57a4e-ad98-4495-9935-9e271a826e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:32.995004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db57a4e-ad98-4495-9935-9e271a826e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:32.995267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410a4a6-599e-4a24-9a87-fa5b55b636b1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:32.995267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410a4a6-599e-4a24-9a87-fa5b55b636b1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:32.995421 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db57a4e-ad98-4495-9935-9e271a826e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:32.995506 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410a4a6-599e-4a24-9a87-fa5b55b636b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:32.995746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db57a4e-ad98-4495-9935-9e271a826e90 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.006694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 775/1558] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:33.008133 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12a54c-1f67-4aa0-a6d0-a6de937a3c5d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.008427 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12a54c-1f67-4aa0-a6d0-a6de937a3c5d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.008708 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12a54c-1f67-4aa0-a6d0-a6de937a3c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.015248 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:33.015531 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4410a4a6-599e-4a24-9a87-fa5b55b636b1 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:33.017368 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4410a4a6-599e-4a24-9a87-fa5b55b636b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:33.025837 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 784/1559] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:33.027125 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf8999-4b73-46bd-aa24-53533cca3556 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.027410 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf8999-4b73-46bd-aa24-53533cca3556 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.027684 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf8999-4b73-46bd-aa24-53533cca3556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.029095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-aa12a54c-1f67-4aa0-a6d0-a6de937a3c5d None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:33.030477 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-aa12a54c-1f67-4aa0-a6d0-a6de937a3c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:33.039669 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 776/1560] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:33.040540 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12a54c-1f67-4aa0-a6d0-a6de937a3c5d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.049973 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12a54c-1f67-4aa0-a6d0-a6de937a3c5d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.050353 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e5cf8999-4b73-46bd-aa24-53533cca3556 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:33.051600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e5cf8999-4b73-46bd-aa24-53533cca3556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:33.054686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665b375-9fea-406d-a60f-8b7e33ff349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.055334 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665b375-9fea-406d-a60f-8b7e33ff349d admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.055616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665b375-9fea-406d-a60f-8b7e33ff349d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.055898 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665b375-9fea-406d-a60f-8b7e33ff349d admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.056614 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665b375-9fea-406d-a60f-8b7e33ff349d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:24:33.056919 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665b375-9fea-406d-a60f-8b7e33ff349d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.058534 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8665b375-9fea-406d-a60f-8b7e33ff349d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.059395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 785/1561] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:33.060601 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9dad4-5809-44d2-b385-bbc65ebfe577 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.061015 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9dad4-5809-44d2-b385-bbc65ebfe577 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.061296 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9dad4-5809-44d2-b385-bbc65ebfe577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.069270 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:33.077120 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 777/1562] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:24:33.077120 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ff403-4e2e-406b-87cc-64c273177186 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.077120 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ff403-4e2e-406b-87cc-64c273177186 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.077483 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ff403-4e2e-406b-87cc-64c273177186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.083623 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-eff9dad4-5809-44d2-b385-bbc65ebfe577 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:33.084848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-eff9dad4-5809-44d2-b385-bbc65ebfe577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:33.093077 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 786/1563] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:33.093650 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9dad4-5809-44d2-b385-bbc65ebfe577 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.096714 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ac9ff403-4e2e-406b-87cc-64c273177186 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:33.097997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ac9ff403-4e2e-406b-87cc-64c273177186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:33.104052 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9dad4-5809-44d2-b385-bbc65ebfe577 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.106178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 778/1564] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:33.107006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ff403-4e2e-406b-87cc-64c273177186 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.109432 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a292c-3047-41c7-82f2-abedadf2f689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.110102 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a292c-3047-41c7-82f2-abedadf2f689 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.110414 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a292c-3047-41c7-82f2-abedadf2f689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.110692 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a292c-3047-41c7-82f2-abedadf2f689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.111420 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a292c-3047-41c7-82f2-abedadf2f689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.113021 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a292c-3047-41c7-82f2-abedadf2f689 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.116855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ff403-4e2e-406b-87cc-64c273177186 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.121397 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d5686-b2d7-4f8c-aa8d-016f5e49423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.122271 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d5686-b2d7-4f8c-aa8d-016f5e49423e admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.122580 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d5686-b2d7-4f8c-aa8d-016f5e49423e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.122856 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d5686-b2d7-4f8c-aa8d-016f5e49423e admin admin] PATH_INFO: `/v3/projects/f73f103a43004caa8c4cddfa2cd8d51b/users/cfe9fd0569ee499e89184127f4399aba/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.126172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 787/1565] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:33.126172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a292c-3047-41c7-82f2-abedadf2f689 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.136217 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a292c-3047-41c7-82f2-abedadf2f689 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.138258 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d5686-b2d7-4f8c-aa8d-016f5e49423e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f73f103a43004caa8c4cddfa2cd8d51b, user_id=cfe9fd0569ee499e89184127f4399aba, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.140749 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca2983-96f5-4b7b-b1a2-d11ec0b4f040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.140915 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d5686-b2d7-4f8c-aa8d-016f5e49423e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.141962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca2983-96f5-4b7b-b1a2-d11ec0b4f040 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.142246 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca2983-96f5-4b7b-b1a2-d11ec0b4f040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.142634 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca2983-96f5-4b7b-b1a2-d11ec0b4f040 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.143352 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca2983-96f5-4b7b-b1a2-d11ec0b4f040 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:24:33.143655 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca2983-96f5-4b7b-b1a2-d11ec0b4f040 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.145215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca2983-96f5-4b7b-b1a2-d11ec0b4f040 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.155196 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 779/1566] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:33 2022] PUT /identity/v3/projects/f73f103a43004caa8c4cddfa2cd8d51b/users/cfe9fd0569ee499e89184127f4399aba/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:33.156142 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d5686-b2d7-4f8c-aa8d-016f5e49423e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.163074 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 788/1567] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:24:33.164050 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca2983-96f5-4b7b-b1a2-d11ec0b4f040 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.174949 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca2983-96f5-4b7b-b1a2-d11ec0b4f040 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.221574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d5686-b2d7-4f8c-aa8d-016f5e49423e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.226336 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cff5a-9e05-471b-a736-b61d41980e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.227029 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cff5a-9e05-471b-a736-b61d41980e97 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.227347 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cff5a-9e05-471b-a736-b61d41980e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.227717 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cff5a-9e05-471b-a736-b61d41980e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.228452 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cff5a-9e05-471b-a736-b61d41980e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:24:33.229030 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cff5a-9e05-471b-a736-b61d41980e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.230773 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cff5a-9e05-471b-a736-b61d41980e97 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.231906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d058761-5503-4aa2-ad38-5454fe1079b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.232836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d058761-5503-4aa2-ad38-5454fe1079b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.233554 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d058761-5503-4aa2-ad38-5454fe1079b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.233851 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d058761-5503-4aa2-ad38-5454fe1079b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.234624 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d058761-5503-4aa2-ad38-5454fe1079b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:24:33.234985 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d058761-5503-4aa2-ad38-5454fe1079b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.237117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d058761-5503-4aa2-ad38-5454fe1079b8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.243429 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 780/1568] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:24:33.244388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cff5a-9e05-471b-a736-b61d41980e97 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.249995 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 789/1569] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:24:33.250716 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d058761-5503-4aa2-ad38-5454fe1079b8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.260585 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d058761-5503-4aa2-ad38-5454fe1079b8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.261302 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cff5a-9e05-471b-a736-b61d41980e97 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.265465 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556378cc-8734-493a-8a96-aa86f68e3209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.265891 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e33e41-db66-4a0b-89f4-d95926ff44ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.266059 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556378cc-8734-493a-8a96-aa86f68e3209 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.266381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556378cc-8734-493a-8a96-aa86f68e3209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.266679 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e33e41-db66-4a0b-89f4-d95926ff44ce admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.266960 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e33e41-db66-4a0b-89f4-d95926ff44ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.267235 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e33e41-db66-4a0b-89f4-d95926ff44ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.267334 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556378cc-8734-493a-8a96-aa86f68e3209 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.268041 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556378cc-8734-493a-8a96-aa86f68e3209 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:24:33.268151 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e33e41-db66-4a0b-89f4-d95926ff44ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.268482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556378cc-8734-493a-8a96-aa86f68e3209 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.270092 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e33e41-db66-4a0b-89f4-d95926ff44ce admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.270237 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556378cc-8734-493a-8a96-aa86f68e3209 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.283137 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 790/1570] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:24:33.283963 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556378cc-8734-493a-8a96-aa86f68e3209 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.293875 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556378cc-8734-493a-8a96-aa86f68e3209 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.299348 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb57cc6-4c03-49f6-ac25-c3939140505a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.300000 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb57cc6-4c03-49f6-ac25-c3939140505a admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.300295 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb57cc6-4c03-49f6-ac25-c3939140505a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.300606 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb57cc6-4c03-49f6-ac25-c3939140505a admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.301331 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb57cc6-4c03-49f6-ac25-c3939140505a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:24:33.301639 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb57cc6-4c03-49f6-ac25-c3939140505a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.303271 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb57cc6-4c03-49f6-ac25-c3939140505a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.308458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 781/1571] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:33 2022] POST /identity/v3/projects => generated 387 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:33.308458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e33e41-db66-4a0b-89f4-d95926ff44ce admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.315650 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 791/1572] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:24:33.316880 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf2a26-cd12-413f-ba80-ec0369d4d117 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.317186 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf2a26-cd12-413f-ba80-ec0369d4d117 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.317451 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf2a26-cd12-413f-ba80-ec0369d4d117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.340649 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8fbf2a26-cd12-413f-ba80-ec0369d4d117 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:33.341878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8fbf2a26-cd12-413f-ba80-ec0369d4d117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:33.372357 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e33e41-db66-4a0b-89f4-d95926ff44ce admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.378837 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213e096-835c-451c-a49b-700d0ca1f788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.379516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213e096-835c-451c-a49b-700d0ca1f788 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.379878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213e096-835c-451c-a49b-700d0ca1f788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.380390 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213e096-835c-451c-a49b-700d0ca1f788 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.381356 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213e096-835c-451c-a49b-700d0ca1f788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.383006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213e096-835c-451c-a49b-700d0ca1f788 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.393813 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 782/1573] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:33.394839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213e096-835c-451c-a49b-700d0ca1f788 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.404730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 792/1574] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:33.405865 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf2a26-cd12-413f-ba80-ec0369d4d117 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.407496 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213e096-835c-451c-a49b-700d0ca1f788 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.414143 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c37eba-3763-4683-9e1e-2bc458bf32c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.415170 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c37eba-3763-4683-9e1e-2bc458bf32c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.415640 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c37eba-3763-4683-9e1e-2bc458bf32c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.415927 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c37eba-3763-4683-9e1e-2bc458bf32c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.416496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf2a26-cd12-413f-ba80-ec0369d4d117 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.416617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c37eba-3763-4683-9e1e-2bc458bf32c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.418606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c37eba-3763-4683-9e1e-2bc458bf32c8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.421217 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995088f7-176b-4164-8715-14d203902427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.421860 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995088f7-176b-4164-8715-14d203902427 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.422139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995088f7-176b-4164-8715-14d203902427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.422593 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995088f7-176b-4164-8715-14d203902427 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.423281 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995088f7-176b-4164-8715-14d203902427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.425286 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995088f7-176b-4164-8715-14d203902427 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.439206 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:33.448386 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 783/1575] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:33 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:33.449638 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c37eba-3763-4683-9e1e-2bc458bf32c8 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.455007 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 793/1576] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:33 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:33.455692 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995088f7-176b-4164-8715-14d203902427 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.477288 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:33.522072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c37eba-3763-4683-9e1e-2bc458bf32c8 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.527211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995088f7-176b-4164-8715-14d203902427 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.527769 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c672919-36a8-4e41-a6e8-9d6b976ea1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.528442 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c672919-36a8-4e41-a6e8-9d6b976ea1cb admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.528762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c672919-36a8-4e41-a6e8-9d6b976ea1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.529016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c672919-36a8-4e41-a6e8-9d6b976ea1cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.529715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c672919-36a8-4e41-a6e8-9d6b976ea1cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.531679 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c672919-36a8-4e41-a6e8-9d6b976ea1cb admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.531874 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cf4c4-694b-453c-b93f-ac183e2527b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.532542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cf4c4-694b-453c-b93f-ac183e2527b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.532819 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cf4c4-694b-453c-b93f-ac183e2527b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.533195 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cf4c4-694b-453c-b93f-ac183e2527b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.533908 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cf4c4-694b-453c-b93f-ac183e2527b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.535826 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cf4c4-694b-453c-b93f-ac183e2527b5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.563603 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 784/1577] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:33 2022] POST /identity/v3/projects => generated 391 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:33.564880 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c672919-36a8-4e41-a6e8-9d6b976ea1cb admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.570169 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 794/1578] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:33 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:33.571237 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cf4c4-694b-453c-b93f-ac183e2527b5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.637197 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c672919-36a8-4e41-a6e8-9d6b976ea1cb admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.640151 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cf4c4-694b-453c-b93f-ac183e2527b5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.642691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8a828-9e01-41f5-9369-e140e68791d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.643372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8a828-9e01-41f5-9369-e140e68791d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.643683 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8a828-9e01-41f5-9369-e140e68791d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.643961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8a828-9e01-41f5-9369-e140e68791d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.644664 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8a828-9e01-41f5-9369-e140e68791d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.645693 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0165384-0afa-4218-9fb8-22dfa055c530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.646394 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0165384-0afa-4218-9fb8-22dfa055c530 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.646613 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8a828-9e01-41f5-9369-e140e68791d6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.646741 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0165384-0afa-4218-9fb8-22dfa055c530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.646949 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0165384-0afa-4218-9fb8-22dfa055c530 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.647644 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0165384-0afa-4218-9fb8-22dfa055c530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.649552 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0165384-0afa-4218-9fb8-22dfa055c530 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.668638 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 785/1579] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:33 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:33.669454 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8a828-9e01-41f5-9369-e140e68791d6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.679714 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8a828-9e01-41f5-9369-e140e68791d6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.686338 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 795/1580] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:33 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:33.686338 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0165384-0afa-4218-9fb8-22dfa055c530 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.686627 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f72cc-eb60-4bb4-b2f9-6e2db552be3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.686627 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f72cc-eb60-4bb4-b2f9-6e2db552be3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.686627 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f72cc-eb60-4bb4-b2f9-6e2db552be3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.686627 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f72cc-eb60-4bb4-b2f9-6e2db552be3d admin admin] PATH_INFO: `/v3/projects/0a25c7a5ea944e0d9fba70d81f089081/users/1ba1572f4f4c45b19d0212ee1ed4f705/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.702505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f72cc-eb60-4bb4-b2f9-6e2db552be3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a25c7a5ea944e0d9fba70d81f089081, user_id=1ba1572f4f4c45b19d0212ee1ed4f705, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.705667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f72cc-eb60-4bb4-b2f9-6e2db552be3d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.721020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 786/1581] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:33 2022] PUT /identity/v3/projects/0a25c7a5ea944e0d9fba70d81f089081/users/1ba1572f4f4c45b19d0212ee1ed4f705/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:33.721900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f72cc-eb60-4bb4-b2f9-6e2db552be3d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.753317 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0165384-0afa-4218-9fb8-22dfa055c530 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.783870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:33.798399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:33.799398 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f72cc-eb60-4bb4-b2f9-6e2db552be3d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.804888 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbdab4-cce7-4df9-a183-7353f92613ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.805053 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d85a8-875a-4662-8003-ef03ca2591e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.805749 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbdab4-cce7-4df9-a183-7353f92613ca service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.805902 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d85a8-875a-4662-8003-ef03ca2591e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.806039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d85a8-875a-4662-8003-ef03ca2591e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.806294 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbdab4-cce7-4df9-a183-7353f92613ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.806437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d85a8-875a-4662-8003-ef03ca2591e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.806624 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbdab4-cce7-4df9-a183-7353f92613ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.807028 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d85a8-875a-4662-8003-ef03ca2591e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.808980 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6d85a8-875a-4662-8003-ef03ca2591e9 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.815931 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbdab4-cce7-4df9-a183-7353f92613ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.817335 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbdab4-cce7-4df9-a183-7353f92613ca service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.827434 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 796/1582] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:33.828225 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbdab4-cce7-4df9-a183-7353f92613ca service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.833051 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 787/1583] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:33 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:33.833051 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d85a8-875a-4662-8003-ef03ca2591e9 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.838323 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbdab4-cce7-4df9-a183-7353f92613ca service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.843365 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d85a8-875a-4662-8003-ef03ca2591e9 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.843588 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295bfcf-57fb-420e-995a-0d0f4952c96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.844273 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295bfcf-57fb-420e-995a-0d0f4952c96c admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.845120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295bfcf-57fb-420e-995a-0d0f4952c96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.845407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295bfcf-57fb-420e-995a-0d0f4952c96c admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.846105 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295bfcf-57fb-420e-995a-0d0f4952c96c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.848109 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295bfcf-57fb-420e-995a-0d0f4952c96c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.850592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df0c03-5263-4048-af08-c9c559de528c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.851269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df0c03-5263-4048-af08-c9c559de528c admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.851552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df0c03-5263-4048-af08-c9c559de528c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.851826 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df0c03-5263-4048-af08-c9c559de528c admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.852730 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df0c03-5263-4048-af08-c9c559de528c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.855356 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df0c03-5263-4048-af08-c9c559de528c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.875462 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 797/1584] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:33 2022] POST /identity/v3/users => generated 282 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:33.876151 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295bfcf-57fb-420e-995a-0d0f4952c96c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.877591 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 788/1585] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:33 2022] POST /identity/v3/users => generated 296 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:33.878460 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df0c03-5263-4048-af08-c9c559de528c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.891732 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295bfcf-57fb-420e-995a-0d0f4952c96c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.892005 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df0c03-5263-4048-af08-c9c559de528c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.897466 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c749123-ef86-4afb-9598-3ec552fda39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.898198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c749123-ef86-4afb-9598-3ec552fda39d admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.899948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c5433-b665-4330-81f8-96e17035b40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.900177 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c749123-ef86-4afb-9598-3ec552fda39d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.900361 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c749123-ef86-4afb-9598-3ec552fda39d admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.900767 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c5433-b665-4330-81f8-96e17035b40f admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.901043 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c5433-b665-4330-81f8-96e17035b40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.901240 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c749123-ef86-4afb-9598-3ec552fda39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.901431 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c5433-b665-4330-81f8-96e17035b40f admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.901978 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c5433-b665-4330-81f8-96e17035b40f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.903480 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c749123-ef86-4afb-9598-3ec552fda39d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.903919 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c5433-b665-4330-81f8-96e17035b40f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.925721 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 789/1586] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:33.926787 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c749123-ef86-4afb-9598-3ec552fda39d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.930071 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 798/1587] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:33 2022] POST /identity/v3/users => generated 288 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:33.931643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141a96a-e9d9-45ab-9990-8c4006641dd3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.932053 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141a96a-e9d9-45ab-9990-8c4006641dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.932407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141a96a-e9d9-45ab-9990-8c4006641dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.938936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c749123-ef86-4afb-9598-3ec552fda39d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.943717 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1948db-1c9f-4ce2-ad23-0a08dcafa57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.944325 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1948db-1c9f-4ce2-ad23-0a08dcafa57b admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.944611 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1948db-1c9f-4ce2-ad23-0a08dcafa57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.944892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1948db-1c9f-4ce2-ad23-0a08dcafa57b admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.945570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1948db-1c9f-4ce2-ad23-0a08dcafa57b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.947533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1948db-1c9f-4ce2-ad23-0a08dcafa57b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:33.960177 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6141a96a-e9d9-45ab-9990-8c4006641dd3 None None] MFA Rules not processed for user `1ba1572f4f4c45b19d0212ee1ed4f705`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:33.961407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6141a96a-e9d9-45ab-9990-8c4006641dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:33.974739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 790/1588] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:33 2022] POST /identity/v3/users => generated 283 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:33.975621 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1948db-1c9f-4ce2-ad23-0a08dcafa57b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:33.986865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1948db-1c9f-4ce2-ad23-0a08dcafa57b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:33.992248 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e240c-a4cd-4274-bcf4-69ac7996fce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:33.992995 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e240c-a4cd-4274-bcf4-69ac7996fce3 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:33.993397 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e240c-a4cd-4274-bcf4-69ac7996fce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:33.993749 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e240c-a4cd-4274-bcf4-69ac7996fce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:33.994593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e240c-a4cd-4274-bcf4-69ac7996fce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:33.996259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e240c-a4cd-4274-bcf4-69ac7996fce3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:34.010210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 791/1589] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:34.011074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e240c-a4cd-4274-bcf4-69ac7996fce3 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:34.026288 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e240c-a4cd-4274-bcf4-69ac7996fce3 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:34.031907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed533e-40ff-4d8a-a189-69418e5531f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:34.034133 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed533e-40ff-4d8a-a189-69418e5531f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:34.034133 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed533e-40ff-4d8a-a189-69418e5531f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:34.034444 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed533e-40ff-4d8a-a189-69418e5531f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:34.035555 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed533e-40ff-4d8a-a189-69418e5531f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:34.039396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed533e-40ff-4d8a-a189-69418e5531f9 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:34.048756 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 799/1590] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:34.051307 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141a96a-e9d9-45ab-9990-8c4006641dd3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:34.052229 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 792/1591] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:34.053814 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed533e-40ff-4d8a-a189-69418e5531f9 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:34.065909 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed533e-40ff-4d8a-a189-69418e5531f9 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:34.067902 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141a96a-e9d9-45ab-9990-8c4006641dd3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:34.073203 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561e57a-2dff-4262-b221-ea5964c7cff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:34.073920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561e57a-2dff-4262-b221-ea5964c7cff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:34.074208 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561e57a-2dff-4262-b221-ea5964c7cff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:34.074542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561e57a-2dff-4262-b221-ea5964c7cff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:34.075246 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561e57a-2dff-4262-b221-ea5964c7cff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:34.076880 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561e57a-2dff-4262-b221-ea5964c7cff6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:34.080935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c7ece-799c-41c4-b537-13f671005386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:34.081751 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c7ece-799c-41c4-b537-13f671005386 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:34.082095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c7ece-799c-41c4-b537-13f671005386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:34.082426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c7ece-799c-41c4-b537-13f671005386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:34.083122 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c7ece-799c-41c4-b537-13f671005386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:34.084738 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c7ece-799c-41c4-b537-13f671005386 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:34.101697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 793/1592] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:34.101697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561e57a-2dff-4262-b221-ea5964c7cff6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:34.107015 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 800/1593] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:34.107783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c7ece-799c-41c4-b537-13f671005386 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:34.110484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561e57a-2dff-4262-b221-ea5964c7cff6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:34.115945 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb07284-2b81-4a4f-a945-1463aaf59d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:34.116616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb07284-2b81-4a4f-a945-1463aaf59d02 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:34.116924 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb07284-2b81-4a4f-a945-1463aaf59d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:34.117178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb07284-2b81-4a4f-a945-1463aaf59d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:34.117900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb07284-2b81-4a4f-a945-1463aaf59d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:34.118579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c7ece-799c-41c4-b537-13f671005386 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:34.119572 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb07284-2b81-4a4f-a945-1463aaf59d02 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:34.123785 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0f4ab-9ce6-4fb7-95ef-c8d74bb5cf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:34.124685 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0f4ab-9ce6-4fb7-95ef-c8d74bb5cf1b admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:34.124804 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0f4ab-9ce6-4fb7-95ef-c8d74bb5cf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:34.125369 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0f4ab-9ce6-4fb7-95ef-c8d74bb5cf1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:34.126643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0f4ab-9ce6-4fb7-95ef-c8d74bb5cf1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:34.128371 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0f4ab-9ce6-4fb7-95ef-c8d74bb5cf1b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:34.131304 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 794/1594] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:34.132044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb07284-2b81-4a4f-a945-1463aaf59d02 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:34.142844 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb07284-2b81-4a4f-a945-1463aaf59d02 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:34.146223 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 801/1595] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:34.146223 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0f4ab-9ce6-4fb7-95ef-c8d74bb5cf1b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:34.151512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40df7e-3895-4b92-98a1-8dc868aa196b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:34.152349 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40df7e-3895-4b92-98a1-8dc868aa196b admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:34.152738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40df7e-3895-4b92-98a1-8dc868aa196b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:34.153359 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40df7e-3895-4b92-98a1-8dc868aa196b admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:34.153878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40df7e-3895-4b92-98a1-8dc868aa196b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:34.156107 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40df7e-3895-4b92-98a1-8dc868aa196b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:34.157427 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0f4ab-9ce6-4fb7-95ef-c8d74bb5cf1b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:34.162839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e4dfa-0ef0-4894-8938-f60af1507b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:34.163582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e4dfa-0ef0-4894-8938-f60af1507b4c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:34.163941 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e4dfa-0ef0-4894-8938-f60af1507b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:34.164269 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e4dfa-0ef0-4894-8938-f60af1507b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:34.168229 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e4dfa-0ef0-4894-8938-f60af1507b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:34.168479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 795/1596] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:34.169888 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cfb74-7420-450f-9b44-9787e75aece9 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:34.170184 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cfb74-7420-450f-9b44-9787e75aece9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:34.170641 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cfb74-7420-450f-9b44-9787e75aece9 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:34.172422 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 796/1597] 10.222.0.18 () {54 vars in 962 bytes} [Wed Jul 20 19:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:24:34.173609 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cfb74-7420-450f-9b44-9787e75aece9 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:34.178747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e4dfa-0ef0-4894-8938-f60af1507b4c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:34.192899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cfb74-7420-450f-9b44-9787e75aece9 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:34.194216 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 802/1598] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:34.195558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e4dfa-0ef0-4894-8938-f60af1507b4c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:34.205384 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54826dcc-7db3-4d9e-9c7e-81940c5a0645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:34.206469 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54826dcc-7db3-4d9e-9c7e-81940c5a0645 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:34.206752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54826dcc-7db3-4d9e-9c7e-81940c5a0645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:34.207038 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54826dcc-7db3-4d9e-9c7e-81940c5a0645 admin admin] PATH_INFO: `/v3/projects/c5da7099d61d49a194ef4940292d213c/users/31bfcbd417344e5cadf0f2e6f504fafb/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:34.207917 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e4dfa-0ef0-4894-8938-f60af1507b4c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:34.214059 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4491c-91d8-4e9e-aa73-1524fe8294fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:34.214770 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4491c-91d8-4e9e-aa73-1524fe8294fd admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:34.215055 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4491c-91d8-4e9e-aa73-1524fe8294fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:34.215332 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4491c-91d8-4e9e-aa73-1524fe8294fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:34.216065 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4491c-91d8-4e9e-aa73-1524fe8294fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:34.217694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4491c-91d8-4e9e-aa73-1524fe8294fd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:34.230856 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54826dcc-7db3-4d9e-9c7e-81940c5a0645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5da7099d61d49a194ef4940292d213c, user_id=31bfcbd417344e5cadf0f2e6f504fafb, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:34.234567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54826dcc-7db3-4d9e-9c7e-81940c5a0645 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:34.236687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 803/1599] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:34.237778 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4491c-91d8-4e9e-aa73-1524fe8294fd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:34.258574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 797/1600] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:34 2022] PUT /identity/v3/projects/c5da7099d61d49a194ef4940292d213c/users/31bfcbd417344e5cadf0f2e6f504fafb/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:34.260114 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54826dcc-7db3-4d9e-9c7e-81940c5a0645 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:34.262785 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4491c-91d8-4e9e-aa73-1524fe8294fd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:34.350984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076f783-07e0-4e02-83b9-ff69aafdad40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:34.351643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076f783-07e0-4e02-83b9-ff69aafdad40 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:34.351936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076f783-07e0-4e02-83b9-ff69aafdad40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:34.352311 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076f783-07e0-4e02-83b9-ff69aafdad40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:34.353114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076f783-07e0-4e02-83b9-ff69aafdad40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:34.354874 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54826dcc-7db3-4d9e-9c7e-81940c5a0645 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:34.355372 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076f783-07e0-4e02-83b9-ff69aafdad40 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:34.357007 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:34.360987 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a288d6-c66d-4c01-93f0-e665e1762499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:34.361937 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a288d6-c66d-4c01-93f0-e665e1762499 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:34.362102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a288d6-c66d-4c01-93f0-e665e1762499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:34.362788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a288d6-c66d-4c01-93f0-e665e1762499 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:34.363299 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a288d6-c66d-4c01-93f0-e665e1762499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:34.364971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a288d6-c66d-4c01-93f0-e665e1762499 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:34.369812 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 804/1601] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:34.371246 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076f783-07e0-4e02-83b9-ff69aafdad40 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:34.377794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 798/1602] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:34.380117 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b2cb0-47c5-4024-be08-743f813ea2bc None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:34.380496 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b2cb0-47c5-4024-be08-743f813ea2bc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:34.380878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b2cb0-47c5-4024-be08-743f813ea2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:34.385877 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076f783-07e0-4e02-83b9-ff69aafdad40 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:34.392015 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030582bf-c766-404f-bbc4-b73ec39bb65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:34.392918 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030582bf-c766-404f-bbc4-b73ec39bb65e admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:34.393204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030582bf-c766-404f-bbc4-b73ec39bb65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:34.393480 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030582bf-c766-404f-bbc4-b73ec39bb65e admin admin] PATH_INFO: `/v3/projects/e3b17103578b4fd09388c38dc59afa5b/users/56849bffaad542419505c8426f179215/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:34.402039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:34.416910 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030582bf-c766-404f-bbc4-b73ec39bb65e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3b17103578b4fd09388c38dc59afa5b, user_id=56849bffaad542419505c8426f179215, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:34.418099 dv-cinder-819149-14-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-030582bf-c766-404f-bbc4-b73ec39bb65e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:24:34.418099 dv-cinder-819149-14-smb devstack@keystone.service[80234]: warnings.warn(msg) Jul 20 19:24:34.418099 dv-cinder-819149-14-smb devstack@keystone.service[80234]: Jul 20 19:24:34.420256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030582bf-c766-404f-bbc4-b73ec39bb65e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:34.432377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a14b2cb0-47c5-4024-be08-743f813ea2bc None None] MFA Rules not processed for user `a1f0f6bc94de4645a8c82038ff2bd34a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:34.433725 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a14b2cb0-47c5-4024-be08-743f813ea2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:34.444748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 805/1603] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:34 2022] PUT /identity/v3/projects/e3b17103578b4fd09388c38dc59afa5b/users/56849bffaad542419505c8426f179215/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:34.444748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030582bf-c766-404f-bbc4-b73ec39bb65e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:34.518981 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 799/1604] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Jul 20 19:24:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:34.519859 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b2cb0-47c5-4024-be08-743f813ea2bc None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:34.523708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030582bf-c766-404f-bbc4-b73ec39bb65e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:34.529067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf4b92-fdaf-4501-998f-545e3bd82bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:34.530096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf4b92-fdaf-4501-998f-545e3bd82bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:34.530461 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf4b92-fdaf-4501-998f-545e3bd82bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:34.530761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf4b92-fdaf-4501-998f-545e3bd82bd7 admin admin] PATH_INFO: `/v3/projects/a5a32487da0c432bbe5e659d55b4f490/users/f8c60dae364740c6983d708ae9b7e411/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:34.532372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b2cb0-47c5-4024-be08-743f813ea2bc None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:34.538523 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea1d27-95f5-4651-9cdd-e58b7cbce6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:34.539407 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea1d27-95f5-4651-9cdd-e58b7cbce6ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:34.539762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea1d27-95f5-4651-9cdd-e58b7cbce6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:34.540112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea1d27-95f5-4651-9cdd-e58b7cbce6ae admin admin] PATH_INFO: `/v3/projects/b97e2ccd86eb4d0083a219f0ba8cdf31/users/551a91b131bc4a16a40b865a0a3fb50d/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:34.557572 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf4b92-fdaf-4501-998f-545e3bd82bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5a32487da0c432bbe5e659d55b4f490, user_id=f8c60dae364740c6983d708ae9b7e411, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:34.557873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea1d27-95f5-4651-9cdd-e58b7cbce6ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97e2ccd86eb4d0083a219f0ba8cdf31, user_id=551a91b131bc4a16a40b865a0a3fb50d, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:34.560501 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea1d27-95f5-4651-9cdd-e58b7cbce6ae admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:34.563831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf4b92-fdaf-4501-998f-545e3bd82bd7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:34.587222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 806/1605] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:34 2022] PUT /identity/v3/projects/a5a32487da0c432bbe5e659d55b4f490/users/f8c60dae364740c6983d708ae9b7e411/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:34.589872 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d026f1-190b-451a-824f-2590a1e610c3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:34.590257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 800/1606] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:34 2022] PUT /identity/v3/projects/b97e2ccd86eb4d0083a219f0ba8cdf31/users/551a91b131bc4a16a40b865a0a3fb50d/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:34.590942 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d026f1-190b-451a-824f-2590a1e610c3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:34.591560 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d026f1-190b-451a-824f-2590a1e610c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:34.591920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea1d27-95f5-4651-9cdd-e58b7cbce6ae admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:34.627165 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-07d026f1-190b-451a-824f-2590a1e610c3 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:34.628729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-07d026f1-190b-451a-824f-2590a1e610c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:34.670862 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea1d27-95f5-4651-9cdd-e58b7cbce6ae admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:34.706400 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 807/1607] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:34.707981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d026f1-190b-451a-824f-2590a1e610c3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:34.722654 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d026f1-190b-451a-824f-2590a1e610c3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:34.729429 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f098de2-e11f-4f72-8cd7-d491b8ef4e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:34.731226 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f098de2-e11f-4f72-8cd7-d491b8ef4e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:34.731686 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f098de2-e11f-4f72-8cd7-d491b8ef4e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:34.732502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f098de2-e11f-4f72-8cd7-d491b8ef4e47 admin admin] PATH_INFO: `/v3/projects/5c15eb5c520e4a2d9c8dba652469cece/users/25d9b889ccfb4c7ca9731fb416ba46e7/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:34.751166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77071e17-d147-4b78-b12e-f2016893a337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:34.752234 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77071e17-d147-4b78-b12e-f2016893a337 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:34.752526 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77071e17-d147-4b78-b12e-f2016893a337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:34.752805 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77071e17-d147-4b78-b12e-f2016893a337 admin admin] PATH_INFO: `/v3/projects/5eeb1824f10d48e0ae90a55946bb94d9/users/4eaf9d8ee17e45c99c415e80e72ef868/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:34.756365 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f098de2-e11f-4f72-8cd7-d491b8ef4e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c15eb5c520e4a2d9c8dba652469cece, user_id=25d9b889ccfb4c7ca9731fb416ba46e7, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:34.760806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f098de2-e11f-4f72-8cd7-d491b8ef4e47 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:34.775082 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77071e17-d147-4b78-b12e-f2016893a337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eeb1824f10d48e0ae90a55946bb94d9, user_id=4eaf9d8ee17e45c99c415e80e72ef868, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:34.777851 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77071e17-d147-4b78-b12e-f2016893a337 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:34.780389 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:34.784340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 808/1608] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:34 2022] PUT /identity/v3/projects/5c15eb5c520e4a2d9c8dba652469cece/users/25d9b889ccfb4c7ca9731fb416ba46e7/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:34.785713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbc408-07ac-4dbe-ac4d-7e05df76ac37 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:34.786057 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbc408-07ac-4dbe-ac4d-7e05df76ac37 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:34.786362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbc408-07ac-4dbe-ac4d-7e05df76ac37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:34.810383 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 801/1609] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:34 2022] PUT /identity/v3/projects/5eeb1824f10d48e0ae90a55946bb94d9/users/4eaf9d8ee17e45c99c415e80e72ef868/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:34.810383 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77071e17-d147-4b78-b12e-f2016893a337 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:34.853435 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6edbc408-07ac-4dbe-ac4d-7e05df76ac37 None None] MFA Rules not processed for user `56849bffaad542419505c8426f179215`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:34.856714 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6edbc408-07ac-4dbe-ac4d-7e05df76ac37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:34.892150 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:34.909025 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77071e17-d147-4b78-b12e-f2016893a337 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:34.916879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f32ba-3d45-496d-80c7-9de8d1517a2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:34.917749 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f32ba-3d45-496d-80c7-9de8d1517a2d service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:34.918608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f32ba-3d45-496d-80c7-9de8d1517a2d service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:34.919522 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f32ba-3d45-496d-80c7-9de8d1517a2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:34.973687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 809/1610] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:34.974506 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdda771-433e-44bc-a58e-c7ccfc9b7273 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:34.974843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdda771-433e-44bc-a58e-c7ccfc9b7273 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:34.975126 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdda771-433e-44bc-a58e-c7ccfc9b7273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:34.995953 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2cdda771-433e-44bc-a58e-c7ccfc9b7273 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:34.998029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2cdda771-433e-44bc-a58e-c7ccfc9b7273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:35.012501 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f32ba-3d45-496d-80c7-9de8d1517a2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:35.014513 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f32ba-3d45-496d-80c7-9de8d1517a2d service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:35.026586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 802/1611] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:35.028513 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fe6a3-7472-43f5-9061-dbe2c9c41972 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:35.028811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fe6a3-7472-43f5-9061-dbe2c9c41972 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:35.029096 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fe6a3-7472-43f5-9061-dbe2c9c41972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:35.073697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d30fe6a3-7472-43f5-9061-dbe2c9c41972 None None] MFA Rules not processed for user `f8c60dae364740c6983d708ae9b7e411`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:35.074973 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d30fe6a3-7472-43f5-9061-dbe2c9c41972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:35.088083 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 810/1612] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:35.088663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdda771-433e-44bc-a58e-c7ccfc9b7273 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:35.090823 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2cdda771-433e-44bc-a58e-c7ccfc9b7273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:35.181904 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdda771-433e-44bc-a58e-c7ccfc9b7273 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:35.187875 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61803bd-e6fd-4e8d-b5cb-2a45e13ab677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:35.188443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 803/1613] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:35 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:35.189695 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61803bd-e6fd-4e8d-b5cb-2a45e13ab677 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:35.190556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61803bd-e6fd-4e8d-b5cb-2a45e13ab677 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:35.191478 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61803bd-e6fd-4e8d-b5cb-2a45e13ab677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:35.194169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929458ec-2cb0-476b-90de-958d4ba65064 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:35.194500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929458ec-2cb0-476b-90de-958d4ba65064 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:35.194785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929458ec-2cb0-476b-90de-958d4ba65064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:35.207624 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61803bd-e6fd-4e8d-b5cb-2a45e13ab677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:35.210957 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61803bd-e6fd-4e8d-b5cb-2a45e13ab677 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:35.232064 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 811/1614] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:35.235234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84af263-628a-4f9f-bd16-19f460c60d7b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:35.235904 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84af263-628a-4f9f-bd16-19f460c60d7b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:35.236393 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84af263-628a-4f9f-bd16-19f460c60d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:35.246812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-929458ec-2cb0-476b-90de-958d4ba65064 None None] MFA Rules not processed for user `25d9b889ccfb4c7ca9731fb416ba46e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:35.248049 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-929458ec-2cb0-476b-90de-958d4ba65064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:35.259401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:35.295875 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e84af263-628a-4f9f-bd16-19f460c60d7b None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:35.295875 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e84af263-628a-4f9f-bd16-19f460c60d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:35.327456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 812/1615] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:35.327456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae645c-a7cd-432e-9d4f-aa7d9c59aa5b None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:35.327980 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae645c-a7cd-432e-9d4f-aa7d9c59aa5b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:35.327980 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae645c-a7cd-432e-9d4f-aa7d9c59aa5b None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:35.330245 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 813/1616] 10.222.0.18 () {54 vars in 962 bytes} [Wed Jul 20 19:24:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:24:35.330999 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae645c-a7cd-432e-9d4f-aa7d9c59aa5b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:35.352008 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 804/1617] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:35.362823 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929458ec-2cb0-476b-90de-958d4ba65064 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:35.373020 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae645c-a7cd-432e-9d4f-aa7d9c59aa5b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:35.376424 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929458ec-2cb0-476b-90de-958d4ba65064 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:35.379365 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4eb2d9-5bd0-4994-9a56-8f0219251f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:35.380363 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4eb2d9-5bd0-4994-9a56-8f0219251f11 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:35.383876 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998405e4-5730-40a8-8557-3308c04039c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:35.384760 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998405e4-5730-40a8-8557-3308c04039c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:35.385173 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998405e4-5730-40a8-8557-3308c04039c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:35.385369 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4eb2d9-5bd0-4994-9a56-8f0219251f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:35.385812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998405e4-5730-40a8-8557-3308c04039c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:35.386561 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998405e4-5730-40a8-8557-3308c04039c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:35.387393 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4eb2d9-5bd0-4994-9a56-8f0219251f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:35.388962 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998405e4-5730-40a8-8557-3308c04039c7 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:35.402896 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4eb2d9-5bd0-4994-9a56-8f0219251f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:35.405055 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4eb2d9-5bd0-4994-9a56-8f0219251f11 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:35.424332 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 814/1618] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:35.426210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 805/1619] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:35 2022] POST /identity/v3/projects => generated 363 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:35.426405 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdb7a9-510f-450f-878f-8f1f1f0bb91e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:35.427462 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdb7a9-510f-450f-878f-8f1f1f0bb91e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:35.427946 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdb7a9-510f-450f-878f-8f1f1f0bb91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:35.431983 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998405e4-5730-40a8-8557-3308c04039c7 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:35.461514 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c4cdb7a9-510f-450f-878f-8f1f1f0bb91e None None] MFA Rules not processed for user `a1f0f6bc94de4645a8c82038ff2bd34a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:35.463790 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c4cdb7a9-510f-450f-878f-8f1f1f0bb91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:35.553283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998405e4-5730-40a8-8557-3308c04039c7 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:35.563574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca08f1-80ae-4bd0-abc8-001b7a5de1b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:35.567517 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca08f1-80ae-4bd0-abc8-001b7a5de1b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:35.567816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca08f1-80ae-4bd0-abc8-001b7a5de1b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:35.568099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca08f1-80ae-4bd0-abc8-001b7a5de1b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:35.572440 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:35.615054 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 815/1620] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Jul 20 19:24:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:35.615538 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdb7a9-510f-450f-878f-8f1f1f0bb91e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:35.673421 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca08f1-80ae-4bd0-abc8-001b7a5de1b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:35.675355 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca08f1-80ae-4bd0-abc8-001b7a5de1b4 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:35.690669 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 806/1621] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:35.692046 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca08f1-80ae-4bd0-abc8-001b7a5de1b4 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:35.706230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca08f1-80ae-4bd0-abc8-001b7a5de1b4 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:35.712306 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bd0b6-8953-4efc-acbd-84c998f8780e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:35.713211 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bd0b6-8953-4efc-acbd-84c998f8780e admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:35.713568 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bd0b6-8953-4efc-acbd-84c998f8780e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:35.713919 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bd0b6-8953-4efc-acbd-84c998f8780e admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:35.715290 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5bd0b6-8953-4efc-acbd-84c998f8780e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:35.717674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5bd0b6-8953-4efc-acbd-84c998f8780e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:35.743650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 807/1622] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:35 2022] POST /identity/v3/users => generated 288 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:35.743650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d1932-9c4e-4516-8695-88403ace0b0a None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:35.743650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d1932-9c4e-4516-8695-88403ace0b0a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:35.743650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d1932-9c4e-4516-8695-88403ace0b0a None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:35.745422 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 808/1623] 10.222.0.18 () {54 vars in 912 bytes} [Wed Jul 20 19:24:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:24:35.746598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d1932-9c4e-4516-8695-88403ace0b0a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:35.754184 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdb7a9-510f-450f-878f-8f1f1f0bb91e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:35.767048 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d1932-9c4e-4516-8695-88403ace0b0a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:35.768002 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7310f1b-8ca4-4ae5-8814-fc5874f482de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:35.768813 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7310f1b-8ca4-4ae5-8814-fc5874f482de service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:35.771732 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7310f1b-8ca4-4ae5-8814-fc5874f482de service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:35.771868 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7310f1b-8ca4-4ae5-8814-fc5874f482de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:35.774110 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5b0e3-2b82-4478-99f3-efaad66f84a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:35.774646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5b0e3-2b82-4478-99f3-efaad66f84a7 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:35.775095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5b0e3-2b82-4478-99f3-efaad66f84a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:35.775537 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5b0e3-2b82-4478-99f3-efaad66f84a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:35.800988 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:35.891833 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5b0e3-2b82-4478-99f3-efaad66f84a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:35.897221 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5b0e3-2b82-4478-99f3-efaad66f84a7 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:35.905972 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7310f1b-8ca4-4ae5-8814-fc5874f482de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:35.909421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7310f1b-8ca4-4ae5-8814-fc5874f482de service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:35.919985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 809/1624] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:35.925286 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5b0e3-2b82-4478-99f3-efaad66f84a7 service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:35.944753 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 816/1625] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:35.946166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72485e97-4aa1-4eb9-b267-465ae8b78447 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:35.946486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72485e97-4aa1-4eb9-b267-465ae8b78447 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:35.949496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72485e97-4aa1-4eb9-b267-465ae8b78447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:35.967376 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5b0e3-2b82-4478-99f3-efaad66f84a7 service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:35.977883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782540b-b889-432e-814f-1851eb3afadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:35.978628 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782540b-b889-432e-814f-1851eb3afadf admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:35.978918 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782540b-b889-432e-814f-1851eb3afadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:35.979194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782540b-b889-432e-814f-1851eb3afadf admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:35.979931 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782540b-b889-432e-814f-1851eb3afadf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:35.986665 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782540b-b889-432e-814f-1851eb3afadf admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:35.997731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-72485e97-4aa1-4eb9-b267-465ae8b78447 None None] MFA Rules not processed for user `a1f0f6bc94de4645a8c82038ff2bd34a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:36.003491 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-72485e97-4aa1-4eb9-b267-465ae8b78447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:36.019037 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 810/1626] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:36.023129 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782540b-b889-432e-814f-1851eb3afadf admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:36.027821 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 817/1627] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 20 19:24:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:36.046393 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72485e97-4aa1-4eb9-b267-465ae8b78447 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:36.058912 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782540b-b889-432e-814f-1851eb3afadf admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:36.061991 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72485e97-4aa1-4eb9-b267-465ae8b78447 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:36.069863 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29e160-2bc2-4dc2-b34c-a8d298d7b6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:36.070839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29e160-2bc2-4dc2-b34c-a8d298d7b6e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:36.071651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac2709-567c-479f-a5f4-478f5cf3bd7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:36.072478 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac2709-567c-479f-a5f4-478f5cf3bd7a service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:36.072862 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29e160-2bc2-4dc2-b34c-a8d298d7b6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:36.073327 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29e160-2bc2-4dc2-b34c-a8d298d7b6e1 admin admin] PATH_INFO: `/v3/projects/178cfc7d9b2e423aa98b4f6f1c615213/users/b830fa36603c42d181329b907c80c2fd/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:36.073733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac2709-567c-479f-a5f4-478f5cf3bd7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:36.074836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac2709-567c-479f-a5f4-478f5cf3bd7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:36.105021 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac2709-567c-479f-a5f4-478f5cf3bd7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:36.109039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac2709-567c-479f-a5f4-478f5cf3bd7a service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:36.118153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29e160-2bc2-4dc2-b34c-a8d298d7b6e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=178cfc7d9b2e423aa98b4f6f1c615213, user_id=b830fa36603c42d181329b907c80c2fd, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:36.129308 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29e160-2bc2-4dc2-b34c-a8d298d7b6e1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:36.209443 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 818/1628] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:36.211019 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 811/1629] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:36 2022] PUT /identity/v3/projects/178cfc7d9b2e423aa98b4f6f1c615213/users/b830fa36603c42d181329b907c80c2fd/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:36.212025 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac2709-567c-479f-a5f4-478f5cf3bd7a service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:36.212025 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac2709-567c-479f-a5f4-478f5cf3bd7a service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:36.330043 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cf58a-8f54-449e-bc3c-707c81132c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:36.330971 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cf58a-8f54-449e-bc3c-707c81132c09 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:36.331263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cf58a-8f54-449e-bc3c-707c81132c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:36.331593 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cf58a-8f54-449e-bc3c-707c81132c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:36.332380 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593cf58a-8f54-449e-bc3c-707c81132c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:36.356330 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593cf58a-8f54-449e-bc3c-707c81132c09 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:36.411086 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 819/1630] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:36.413079 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29e160-2bc2-4dc2-b34c-a8d298d7b6e1 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:36.426836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a23be7-67d2-45d5-ae1a-b0a109507cca None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:36.427132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a23be7-67d2-45d5-ae1a-b0a109507cca None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:36.427416 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a23be7-67d2-45d5-ae1a-b0a109507cca None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:36.428832 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 820/1631] 10.222.0.18 () {54 vars in 912 bytes} [Wed Jul 20 19:24:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:24:36.437042 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29e160-2bc2-4dc2-b34c-a8d298d7b6e1 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:36.444495 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0b481-963d-4d04-ac0b-f1d7eb3f614f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:36.445534 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0b481-963d-4d04-ac0b-f1d7eb3f614f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:36.446752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0b481-963d-4d04-ac0b-f1d7eb3f614f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:36.452459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f2049-47d7-4c70-91d9-dcdffa80f9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:36.455861 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f2049-47d7-4c70-91d9-dcdffa80f9a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:36.456324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f2049-47d7-4c70-91d9-dcdffa80f9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:36.456953 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f2049-47d7-4c70-91d9-dcdffa80f9a1 admin admin] PATH_INFO: `/v3/projects/178cfc7d9b2e423aa98b4f6f1c615213/users/b830fa36603c42d181329b907c80c2fd/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:36.472339 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:36.475485 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f2049-47d7-4c70-91d9-dcdffa80f9a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=178cfc7d9b2e423aa98b4f6f1c615213, user_id=b830fa36603c42d181329b907c80c2fd, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:36.480686 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-54f0b481-963d-4d04-ac0b-f1d7eb3f614f None None] MFA Rules not processed for user `a1f0f6bc94de4645a8c82038ff2bd34a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:36.481926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-54f0b481-963d-4d04-ac0b-f1d7eb3f614f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:36.487669 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f2049-47d7-4c70-91d9-dcdffa80f9a1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:36.525754 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 812/1632] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:36 2022] PUT /identity/v3/projects/178cfc7d9b2e423aa98b4f6f1c615213/users/b830fa36603c42d181329b907c80c2fd/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:24:36.538276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6e082-2913-46f8-a840-05f7cc78b70f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:36.538703 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6e082-2913-46f8-a840-05f7cc78b70f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:36.539215 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6e082-2913-46f8-a840-05f7cc78b70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:36.621663 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-65c6e082-2913-46f8-a840-05f7cc78b70f None None] MFA Rules not processed for user `b830fa36603c42d181329b907c80c2fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:36.623855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-65c6e082-2913-46f8-a840-05f7cc78b70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:36.687749 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 821/1633] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 20 19:24:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:36.704270 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0b481-963d-4d04-ac0b-f1d7eb3f614f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:36.732134 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0b481-963d-4d04-ac0b-f1d7eb3f614f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:36.759630 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 813/1634] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:36 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:24:36.760584 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6e082-2913-46f8-a840-05f7cc78b70f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:36.845475 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6e082-2913-46f8-a840-05f7cc78b70f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:36.852662 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5b9e6-ae67-4b10-b878-184d81a30e68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:36.853593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5b9e6-ae67-4b10-b878-184d81a30e68 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:36.854027 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5b9e6-ae67-4b10-b878-184d81a30e68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:36.854466 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5b9e6-ae67-4b10-b878-184d81a30e68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:36.856214 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82029890-a58f-4ceb-8c10-19dfacf1bdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:36.857136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82029890-a58f-4ceb-8c10-19dfacf1bdad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:36.857428 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82029890-a58f-4ceb-8c10-19dfacf1bdad admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:36.857697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82029890-a58f-4ceb-8c10-19dfacf1bdad admin admin] PATH_INFO: `/v3/users/1ba1572f4f4c45b19d0212ee1ed4f705` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:36.864747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82029890-a58f-4ceb-8c10-19dfacf1bdad admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ba1572f4f4c45b19d0212ee1ed4f705)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:36.865789 dv-cinder-819149-14-smb devstack@keystone.service[80234]: WARNING py.warnings [None req-82029890-a58f-4ceb-8c10-19dfacf1bdad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:24:36.865789 dv-cinder-819149-14-smb devstack@keystone.service[80234]: warnings.warn(msg) Jul 20 19:24:36.865789 dv-cinder-819149-14-smb devstack@keystone.service[80234]: Jul 20 19:24:36.867046 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82029890-a58f-4ceb-8c10-19dfacf1bdad admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:36.876405 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:37.041066 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-82029890-a58f-4ceb-8c10-19dfacf1bdad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ba1572f4f4c45b19d0212ee1ed4f705'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:37.066806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-82029890-a58f-4ceb-8c10-19dfacf1bdad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ba1572f4f4c45b19d0212ee1ed4f705'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:37.076730 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5b9e6-ae67-4b10-b878-184d81a30e68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:37.081127 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5b9e6-ae67-4b10-b878-184d81a30e68 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:37.103763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 814/1635] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:37.104747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5b9e6-ae67-4b10-b878-184d81a30e68 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:37.124038 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-82029890-a58f-4ceb-8c10-19dfacf1bdad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ba1572f4f4c45b19d0212ee1ed4f705'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:37.128715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5b9e6-ae67-4b10-b878-184d81a30e68 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:37.132965 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7614eb6-46b1-48a4-8ef2-79ea2581d992 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:37.133870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7614eb6-46b1-48a4-8ef2-79ea2581d992 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:37.134580 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7614eb6-46b1-48a4-8ef2-79ea2581d992 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:37.135073 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7614eb6-46b1-48a4-8ef2-79ea2581d992 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:37.144063 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-82029890-a58f-4ceb-8c10-19dfacf1bdad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ba1572f4f4c45b19d0212ee1ed4f705'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:37.152168 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-82029890-a58f-4ceb-8c10-19dfacf1bdad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ba1572f4f4c45b19d0212ee1ed4f705'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:37.168235 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 822/1636] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:24:36 2022] DELETE /identity/v3/users/1ba1572f4f4c45b19d0212ee1ed4f705 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:37.173064 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ced031-3388-43eb-87b6-ca837853dce9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:37.173509 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ced031-3388-43eb-87b6-ca837853dce9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:37.173772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ced031-3388-43eb-87b6-ca837853dce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:37.176508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7614eb6-46b1-48a4-8ef2-79ea2581d992 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:37.178064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7614eb6-46b1-48a4-8ef2-79ea2581d992 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:37.195647 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 815/1637] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:37 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:37.218207 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e5ced031-3388-43eb-87b6-ca837853dce9 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:37.221278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e5ced031-3388-43eb-87b6-ca837853dce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:37.261425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:37.421991 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 823/1638] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:37.537816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7614eb6-46b1-48a4-8ef2-79ea2581d992 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:37.558520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7614eb6-46b1-48a4-8ef2-79ea2581d992 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:37.562290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ced031-3388-43eb-87b6-ca837853dce9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:37.566531 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e5ced031-3388-43eb-87b6-ca837853dce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:37.714396 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ced031-3388-43eb-87b6-ca837853dce9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:37.715285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd639a6-cc4f-44ad-822a-0dacb8532d4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:37.715515 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd639a6-cc4f-44ad-822a-0dacb8532d4d service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:37.715851 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd639a6-cc4f-44ad-822a-0dacb8532d4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:37.716146 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd639a6-cc4f-44ad-822a-0dacb8532d4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:37.726807 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347e599-627e-4574-8e87-a711c22daa4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:37.727489 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347e599-627e-4574-8e87-a711c22daa4f service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:37.729671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347e599-627e-4574-8e87-a711c22daa4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:37.732095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6cd639a6-cc4f-44ad-822a-0dacb8532d4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:37.735561 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347e599-627e-4574-8e87-a711c22daa4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:37.759766 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347e599-627e-4574-8e87-a711c22daa4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:37.761863 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347e599-627e-4574-8e87-a711c22daa4f service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:37.799309 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 824/1639] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:24:37.840482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd639a6-cc4f-44ad-822a-0dacb8532d4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:37.842402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd639a6-cc4f-44ad-822a-0dacb8532d4d service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:37.867072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 816/1640] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:37 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:39.330730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347e599-627e-4574-8e87-a711c22daa4f service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:39.332697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d347e599-627e-4574-8e87-a711c22daa4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:39.355494 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347e599-627e-4574-8e87-a711c22daa4f service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:39.408085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82e1a2-1516-4fff-aff2-693c61defc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:39.410447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82e1a2-1516-4fff-aff2-693c61defc3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:39.414955 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82e1a2-1516-4fff-aff2-693c61defc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:39.416926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82e1a2-1516-4fff-aff2-693c61defc3c admin admin] PATH_INFO: `/v3/projects/0a25c7a5ea944e0d9fba70d81f089081` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:39.420417 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82e1a2-1516-4fff-aff2-693c61defc3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a25c7a5ea944e0d9fba70d81f089081)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:39.427359 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82e1a2-1516-4fff-aff2-693c61defc3c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:39.563592 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0c82e1a2-1516-4fff-aff2-693c61defc3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a25c7a5ea944e0d9fba70d81f089081', 'request_id': 'req-0c82e1a2-1516-4fff-aff2-693c61defc3c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:39.572199 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0c82e1a2-1516-4fff-aff2-693c61defc3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a25c7a5ea944e0d9fba70d81f089081', 'request_id': 'req-0c82e1a2-1516-4fff-aff2-693c61defc3c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:39.589160 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0c82e1a2-1516-4fff-aff2-693c61defc3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a25c7a5ea944e0d9fba70d81f089081', 'request_id': 'req-0c82e1a2-1516-4fff-aff2-693c61defc3c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:39.603892 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0c82e1a2-1516-4fff-aff2-693c61defc3c admin admin] The token cache is being invalidate because project 0a25c7a5ea944e0d9fba70d81f089081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:24:39.605143 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0c82e1a2-1516-4fff-aff2-693c61defc3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:39.606989 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0c82e1a2-1516-4fff-aff2-693c61defc3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:39.614350 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 825/1641] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:24:39 2022] DELETE /identity/v3/projects/0a25c7a5ea944e0d9fba70d81f089081 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:39.614750 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd9777-a32c-4630-a699-0f9a8d4d7a74 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:39.615579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd9777-a32c-4630-a699-0f9a8d4d7a74 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:39.615866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd9777-a32c-4630-a699-0f9a8d4d7a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:39.638185 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-cacd9777-a32c-4630-a699-0f9a8d4d7a74 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:39.640577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cacd9777-a32c-4630-a699-0f9a8d4d7a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:39.723875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:39.805960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4b4fd-68f6-4576-8c55-361b3645723d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:39.806316 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4b4fd-68f6-4576-8c55-361b3645723d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:39.806621 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4b4fd-68f6-4576-8c55-361b3645723d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:39.814294 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 817/1642] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:39.844219 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-06a4b4fd-68f6-4576-8c55-361b3645723d None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:39.854710 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-06a4b4fd-68f6-4576-8c55-361b3645723d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:39.872099 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 826/1643] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:39.877345 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd9777-a32c-4630-a699-0f9a8d4d7a74 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:39.891393 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd9777-a32c-4630-a699-0f9a8d4d7a74 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:39.903106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56d172-5646-4211-8bcb-319813f9a5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:39.903937 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56d172-5646-4211-8bcb-319813f9a5ef admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:39.905353 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56d172-5646-4211-8bcb-319813f9a5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:39.905737 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56d172-5646-4211-8bcb-319813f9a5ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:39.910060 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56d172-5646-4211-8bcb-319813f9a5ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:24:39.911223 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56d172-5646-4211-8bcb-319813f9a5ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:39.916404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56d172-5646-4211-8bcb-319813f9a5ef admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:39.950884 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4b4fd-68f6-4576-8c55-361b3645723d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:39.951069 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 818/1644] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:24:39.963364 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4b4fd-68f6-4576-8c55-361b3645723d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:39.976476 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafade14-d90f-4091-88af-6767ab89a63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:39.977194 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafade14-d90f-4091-88af-6767ab89a63c admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:39.977481 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafade14-d90f-4091-88af-6767ab89a63c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:39.977815 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafade14-d90f-4091-88af-6767ab89a63c admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:39.978557 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafade14-d90f-4091-88af-6767ab89a63c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:39.980519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafade14-d90f-4091-88af-6767ab89a63c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:40.060357 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 827/1645] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:39 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:40.065314 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56d172-5646-4211-8bcb-319813f9a5ef admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:40.079366 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56d172-5646-4211-8bcb-319813f9a5ef admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:40.310177 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302777b-029d-4954-ae11-f2b1d5fb10d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:40.312251 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302777b-029d-4954-ae11-f2b1d5fb10d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:40.313377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302777b-029d-4954-ae11-f2b1d5fb10d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:40.313855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302777b-029d-4954-ae11-f2b1d5fb10d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:40.316530 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f302777b-029d-4954-ae11-f2b1d5fb10d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:40.323946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f302777b-029d-4954-ae11-f2b1d5fb10d8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:40.380859 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 819/1646] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:40 2022] POST /identity/v3/users => generated 283 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:40.383843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafade14-d90f-4091-88af-6767ab89a63c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:40.404958 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafade14-d90f-4091-88af-6767ab89a63c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:40.428079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8016c-853d-4373-a54f-dcb22ae696a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:40.430957 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8016c-853d-4373-a54f-dcb22ae696a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:40.431238 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8016c-853d-4373-a54f-dcb22ae696a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:40.431524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8016c-853d-4373-a54f-dcb22ae696a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:40.432285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8016c-853d-4373-a54f-dcb22ae696a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:40.435787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8016c-853d-4373-a54f-dcb22ae696a5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:40.467227 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 828/1647] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:40.470454 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302777b-029d-4954-ae11-f2b1d5fb10d8 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:40.516588 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302777b-029d-4954-ae11-f2b1d5fb10d8 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:40.551987 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810a278-114c-46c0-9f6a-f49a1426d3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:40.552826 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810a278-114c-46c0-9f6a-f49a1426d3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:40.553206 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810a278-114c-46c0-9f6a-f49a1426d3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:40.554248 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810a278-114c-46c0-9f6a-f49a1426d3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:40.555375 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810a278-114c-46c0-9f6a-f49a1426d3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:40.562643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810a278-114c-46c0-9f6a-f49a1426d3b1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:40.608124 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 820/1648] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:40.610900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8016c-853d-4373-a54f-dcb22ae696a5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:40.625990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:40.629580 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8016c-853d-4373-a54f-dcb22ae696a5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:40.641513 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac5f55-3c01-4d49-aea4-74bdade34e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:40.643946 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac5f55-3c01-4d49-aea4-74bdade34e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:40.646163 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac5f55-3c01-4d49-aea4-74bdade34e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:40.646653 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac5f55-3c01-4d49-aea4-74bdade34e43 admin admin] PATH_INFO: `/v3/projects/4f4c31dc409a45578e5d2340c616aa11/users/3595bd307395475a88c49af75bfca64b/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:40.677478 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac5f55-3c01-4d49-aea4-74bdade34e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f4c31dc409a45578e5d2340c616aa11, user_id=3595bd307395475a88c49af75bfca64b, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:40.685571 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac5f55-3c01-4d49-aea4-74bdade34e43 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:40.718685 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 829/1649] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:40 2022] PUT /identity/v3/projects/4f4c31dc409a45578e5d2340c616aa11/users/3595bd307395475a88c49af75bfca64b/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:40.723996 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f43f9a-fa64-4e56-8055-5063c1f7396c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:40.724500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f43f9a-fa64-4e56-8055-5063c1f7396c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:40.724673 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f43f9a-fa64-4e56-8055-5063c1f7396c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:40.786797 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-72f43f9a-fa64-4e56-8055-5063c1f7396c None None] MFA Rules not processed for user `3595bd307395475a88c49af75bfca64b`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:40.792023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-72f43f9a-fa64-4e56-8055-5063c1f7396c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:41.033547 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 821/1650] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:41.037318 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac5f55-3c01-4d49-aea4-74bdade34e43 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:41.164797 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac5f55-3c01-4d49-aea4-74bdade34e43 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:41.169761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b758d-3725-44cd-9f4b-3cf2aa033226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:41.170682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b758d-3725-44cd-9f4b-3cf2aa033226 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:41.170969 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b758d-3725-44cd-9f4b-3cf2aa033226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:41.171248 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b758d-3725-44cd-9f4b-3cf2aa033226 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:41.172429 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b758d-3725-44cd-9f4b-3cf2aa033226 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:41.174550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b758d-3725-44cd-9f4b-3cf2aa033226 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:41.236551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f43f9a-fa64-4e56-8055-5063c1f7396c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:41.239982 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 830/1651] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:41 2022] POST /identity/v3/projects => generated 365 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:41.254106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f43f9a-fa64-4e56-8055-5063c1f7396c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:41.343223 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:41.391510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bde96-aa35-48c9-b9ab-26028a136b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:41.394100 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bde96-aa35-48c9-b9ab-26028a136b85 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:41.394950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bde96-aa35-48c9-b9ab-26028a136b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:41.396033 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bde96-aa35-48c9-b9ab-26028a136b85 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:41.398241 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bde96-aa35-48c9-b9ab-26028a136b85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:41.401998 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bde96-aa35-48c9-b9ab-26028a136b85 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:41.445434 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 822/1652] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:41 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:41.449968 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b758d-3725-44cd-9f4b-3cf2aa033226 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:41.475065 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b758d-3725-44cd-9f4b-3cf2aa033226 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:41.512357 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b8f81-534c-410a-8169-0c2ceff4ebdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:41.513926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b8f81-534c-410a-8169-0c2ceff4ebdf admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:41.517642 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b8f81-534c-410a-8169-0c2ceff4ebdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:41.518235 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b8f81-534c-410a-8169-0c2ceff4ebdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:41.519238 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b8f81-534c-410a-8169-0c2ceff4ebdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:41.527084 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b8f81-534c-410a-8169-0c2ceff4ebdf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:41.572488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bde96-aa35-48c9-b9ab-26028a136b85 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:41.576495 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 831/1653] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:41.598262 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bde96-aa35-48c9-b9ab-26028a136b85 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:41.618420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761297e-39a7-4779-a2f1-2d3caf3a2253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:41.636071 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761297e-39a7-4779-a2f1-2d3caf3a2253 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:41.638445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761297e-39a7-4779-a2f1-2d3caf3a2253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:41.638445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761297e-39a7-4779-a2f1-2d3caf3a2253 admin admin] PATH_INFO: `/v3/projects/cc1ef9b479e44539bfc6cbe96826b68e/users/2a364424e2dc422da25b347d13ff8847/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:41.674419 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761297e-39a7-4779-a2f1-2d3caf3a2253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1ef9b479e44539bfc6cbe96826b68e, user_id=2a364424e2dc422da25b347d13ff8847, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:41.681274 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761297e-39a7-4779-a2f1-2d3caf3a2253 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:41.708252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 823/1654] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:41 2022] PUT /identity/v3/projects/cc1ef9b479e44539bfc6cbe96826b68e/users/2a364424e2dc422da25b347d13ff8847/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:41.711651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b8f81-534c-410a-8169-0c2ceff4ebdf admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:41.729972 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b8f81-534c-410a-8169-0c2ceff4ebdf admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:41.881519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7020f-439e-4b11-b6f5-b9f9e640a017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:41.881519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7020f-439e-4b11-b6f5-b9f9e640a017 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:41.881519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7020f-439e-4b11-b6f5-b9f9e640a017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:41.881880 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7020f-439e-4b11-b6f5-b9f9e640a017 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:41.882816 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7020f-439e-4b11-b6f5-b9f9e640a017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:41.884178 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c7020f-439e-4b11-b6f5-b9f9e640a017 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:41.916636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 832/1655] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:41.920582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761297e-39a7-4779-a2f1-2d3caf3a2253 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:41.938798 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761297e-39a7-4779-a2f1-2d3caf3a2253 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:41.950680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cfe3b-6fdd-4eb0-89ee-1583e6ddb5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:41.951626 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cfe3b-6fdd-4eb0-89ee-1583e6ddb5fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:41.956232 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cfe3b-6fdd-4eb0-89ee-1583e6ddb5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:41.956526 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cfe3b-6fdd-4eb0-89ee-1583e6ddb5fe admin admin] PATH_INFO: `/v3/projects/cc1ef9b479e44539bfc6cbe96826b68e/users/2a364424e2dc422da25b347d13ff8847/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:41.959282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cfe3b-6fdd-4eb0-89ee-1583e6ddb5fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1ef9b479e44539bfc6cbe96826b68e, user_id=2a364424e2dc422da25b347d13ff8847, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:41.966480 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cfe3b-6fdd-4eb0-89ee-1583e6ddb5fe admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:41.999805 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 824/1656] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:41 2022] PUT /identity/v3/projects/cc1ef9b479e44539bfc6cbe96826b68e/users/2a364424e2dc422da25b347d13ff8847/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:24:42.020776 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a1ac9-ee27-4145-9fa6-d2e83aa227b3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:42.021106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a1ac9-ee27-4145-9fa6-d2e83aa227b3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:42.021393 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a1ac9-ee27-4145-9fa6-d2e83aa227b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:42.086273 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8c3a1ac9-ee27-4145-9fa6-d2e83aa227b3 None None] MFA Rules not processed for user `2a364424e2dc422da25b347d13ff8847`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:42.088049 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8c3a1ac9-ee27-4145-9fa6-d2e83aa227b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:42.163981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:42.208057 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 833/1657] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:42.310731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cfe3b-6fdd-4eb0-89ee-1583e6ddb5fe admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:42.314226 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-014cfe3b-6fdd-4eb0-89ee-1583e6ddb5fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:42.550067 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cfe3b-6fdd-4eb0-89ee-1583e6ddb5fe admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:42.560907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353d04f-2579-4bc9-bf28-a2fa8913cb77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:42.561719 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353d04f-2579-4bc9-bf28-a2fa8913cb77 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:42.564155 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353d04f-2579-4bc9-bf28-a2fa8913cb77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:42.564155 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353d04f-2579-4bc9-bf28-a2fa8913cb77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:42.608101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353d04f-2579-4bc9-bf28-a2fa8913cb77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:42.612504 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353d04f-2579-4bc9-bf28-a2fa8913cb77 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:42.658690 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 825/1658] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:44.214019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad715ef3-3e96-442d-bcf2-da663a7594fc None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:44.214590 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad715ef3-3e96-442d-bcf2-da663a7594fc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:44.217023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad715ef3-3e96-442d-bcf2-da663a7594fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:44.374940 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ad715ef3-3e96-442d-bcf2-da663a7594fc None None] MFA Rules not processed for user `cfe9fd0569ee499e89184127f4399aba`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:44.376946 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ad715ef3-3e96-442d-bcf2-da663a7594fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:44.595439 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353d04f-2579-4bc9-bf28-a2fa8913cb77 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:44.742357 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 834/1659] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 527 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:44.752591 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044bfe1-63ca-4d2a-8557-ecb7692ce800 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:44.752925 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044bfe1-63ca-4d2a-8557-ecb7692ce800 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:44.753263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044bfe1-63ca-4d2a-8557-ecb7692ce800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:44.826653 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c044bfe1-63ca-4d2a-8557-ecb7692ce800 None None] MFA Rules not processed for user `cfe9fd0569ee499e89184127f4399aba`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:44.828305 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c044bfe1-63ca-4d2a-8557-ecb7692ce800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:44.842237 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 835/1660] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:44.846032 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353d04f-2579-4bc9-bf28-a2fa8913cb77 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:44.860211 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc3f14-bb87-48bc-8f2d-133fc6247745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:44.861115 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc3f14-bb87-48bc-8f2d-133fc6247745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:44.862571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc3f14-bb87-48bc-8f2d-133fc6247745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:44.862571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc3f14-bb87-48bc-8f2d-133fc6247745 admin admin] PATH_INFO: `/v3/users/3595bd307395475a88c49af75bfca64b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:44.867593 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044bfe1-63ca-4d2a-8557-ecb7692ce800 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:44.869067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c044bfe1-63ca-4d2a-8557-ecb7692ce800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:44.871399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc3f14-bb87-48bc-8f2d-133fc6247745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3595bd307395475a88c49af75bfca64b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:44.884283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc3f14-bb87-48bc-8f2d-133fc6247745 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:44.982539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:45.026682 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6dbc3f14-bb87-48bc-8f2d-133fc6247745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3595bd307395475a88c49af75bfca64b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:45.049755 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6dbc3f14-bb87-48bc-8f2d-133fc6247745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3595bd307395475a88c49af75bfca64b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:45.073157 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6dbc3f14-bb87-48bc-8f2d-133fc6247745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3595bd307395475a88c49af75bfca64b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:45.075400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6dbc3f14-bb87-48bc-8f2d-133fc6247745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3595bd307395475a88c49af75bfca64b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:45.076654 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6dbc3f14-bb87-48bc-8f2d-133fc6247745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3595bd307395475a88c49af75bfca64b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:45.142963 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 826/1661] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:24:44 2022] DELETE /identity/v3/users/3595bd307395475a88c49af75bfca64b => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:45.146578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc3f14-bb87-48bc-8f2d-133fc6247745 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:45.156023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044bfe1-63ca-4d2a-8557-ecb7692ce800 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:45.156415 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6dbc3f14-bb87-48bc-8f2d-133fc6247745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:45.347062 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:45.381479 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae7858-8e6e-431a-be09-abf896a81fbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:45.382455 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae7858-8e6e-431a-be09-abf896a81fbd service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:45.385612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae7858-8e6e-431a-be09-abf896a81fbd service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:45.386211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae7858-8e6e-431a-be09-abf896a81fbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:45.391172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-16ae7858-8e6e-431a-be09-abf896a81fbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:45.425747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc3f14-bb87-48bc-8f2d-133fc6247745 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:45.425747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d5102-e445-4681-b779-1e8387a2b982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:45.428597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d5102-e445-4681-b779-1e8387a2b982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:45.435889 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d5102-e445-4681-b779-1e8387a2b982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:45.436216 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d5102-e445-4681-b779-1e8387a2b982 admin admin] PATH_INFO: `/v3/users/56849bffaad542419505c8426f179215` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:45.442260 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d5102-e445-4681-b779-1e8387a2b982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56849bffaad542419505c8426f179215)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:45.448734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d5102-e445-4681-b779-1e8387a2b982 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:45.587802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae7858-8e6e-431a-be09-abf896a81fbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:45.590224 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae7858-8e6e-431a-be09-abf896a81fbd service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:45.592074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-148d5102-e445-4681-b779-1e8387a2b982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56849bffaad542419505c8426f179215'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:45.608344 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 836/1662] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 741 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:45.610640 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155bd3b-5fbe-4d4c-815e-469db1d28602 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:45.611083 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155bd3b-5fbe-4d4c-815e-469db1d28602 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:45.611527 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155bd3b-5fbe-4d4c-815e-469db1d28602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:45.623827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-148d5102-e445-4681-b779-1e8387a2b982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56849bffaad542419505c8426f179215'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:45.638015 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5155bd3b-5fbe-4d4c-815e-469db1d28602 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:45.639509 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5155bd3b-5fbe-4d4c-815e-469db1d28602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:45.648889 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 837/1663] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:45.649811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-148d5102-e445-4681-b779-1e8387a2b982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56849bffaad542419505c8426f179215'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:45.652236 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-148d5102-e445-4681-b779-1e8387a2b982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56849bffaad542419505c8426f179215'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:45.653201 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-148d5102-e445-4681-b779-1e8387a2b982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56849bffaad542419505c8426f179215'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:45.684010 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155bd3b-5fbe-4d4c-815e-469db1d28602 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:45.685933 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5155bd3b-5fbe-4d4c-815e-469db1d28602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:45.735797 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 827/1664] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:24:45 2022] DELETE /identity/v3/users/56849bffaad542419505c8426f179215 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:45.740777 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c2ff0-a766-4d80-8b8a-db30ea16e619 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:45.741122 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c2ff0-a766-4d80-8b8a-db30ea16e619 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:45.741416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c2ff0-a766-4d80-8b8a-db30ea16e619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:45.820682 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9d6c2ff0-a766-4d80-8b8a-db30ea16e619 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:45.824523 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9d6c2ff0-a766-4d80-8b8a-db30ea16e619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:45.915495 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:45.948434 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155bd3b-5fbe-4d4c-815e-469db1d28602 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:46.035935 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 828/1665] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:46.105915 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c2ff0-a766-4d80-8b8a-db30ea16e619 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:46.106152 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf750f5-377d-44a0-8bf1-08b4a8914daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:46.107357 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9d6c2ff0-a766-4d80-8b8a-db30ea16e619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:46.108335 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf750f5-377d-44a0-8bf1-08b4a8914daf service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:46.108684 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf750f5-377d-44a0-8bf1-08b4a8914daf service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:46.108904 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf750f5-377d-44a0-8bf1-08b4a8914daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:46.116137 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-daf750f5-377d-44a0-8bf1-08b4a8914daf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:46.126543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c2ff0-a766-4d80-8b8a-db30ea16e619 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:46.146377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8c991-7a7d-4002-b6f7-0cbbd094e61d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:46.147065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8c991-7a7d-4002-b6f7-0cbbd094e61d service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:46.147340 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8c991-7a7d-4002-b6f7-0cbbd094e61d service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:46.147620 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8c991-7a7d-4002-b6f7-0cbbd094e61d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:46.153056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf750f5-377d-44a0-8bf1-08b4a8914daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:46.154550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf750f5-377d-44a0-8bf1-08b4a8914daf service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:46.184155 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a8c991-7a7d-4002-b6f7-0cbbd094e61d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:46.185726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a8c991-7a7d-4002-b6f7-0cbbd094e61d service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:46.198608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 838/1666] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:24:46.223178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 829/1667] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:47.312608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf750f5-377d-44a0-8bf1-08b4a8914daf service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.314140 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-daf750f5-377d-44a0-8bf1-08b4a8914daf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:47.341902 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf750f5-377d-44a0-8bf1-08b4a8914daf service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.363734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d67d9-0e08-46b8-b7c3-1bc8eff7d3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.364644 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d67d9-0e08-46b8-b7c3-1bc8eff7d3bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.365042 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d67d9-0e08-46b8-b7c3-1bc8eff7d3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.365329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d67d9-0e08-46b8-b7c3-1bc8eff7d3bb admin admin] PATH_INFO: `/v3/users/f8c60dae364740c6983d708ae9b7e411` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.367444 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d67d9-0e08-46b8-b7c3-1bc8eff7d3bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c60dae364740c6983d708ae9b7e411)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:47.371842 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d67d9-0e08-46b8-b7c3-1bc8eff7d3bb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:47.488566 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:47.500581 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fe1d67d9-0e08-46b8-b7c3-1bc8eff7d3bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c60dae364740c6983d708ae9b7e411'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:47.514537 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0e75f-0417-4d4b-9eb6-2bb7b98a6b54 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.514984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0e75f-0417-4d4b-9eb6-2bb7b98a6b54 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.515620 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0e75f-0417-4d4b-9eb6-2bb7b98a6b54 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.517054 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fe1d67d9-0e08-46b8-b7c3-1bc8eff7d3bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c60dae364740c6983d708ae9b7e411'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:47.518382 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 830/1668] 10.222.0.18 () {54 vars in 912 bytes} [Wed Jul 20 19:24:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 19:24:47.525233 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc3b10-6156-4116-a435-c00628575fc0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.526450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc3b10-6156-4116-a435-c00628575fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.526921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc3b10-6156-4116-a435-c00628575fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.547202 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fe1d67d9-0e08-46b8-b7c3-1bc8eff7d3bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c60dae364740c6983d708ae9b7e411'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:47.568516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fe1d67d9-0e08-46b8-b7c3-1bc8eff7d3bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c60dae364740c6983d708ae9b7e411'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:47.568818 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fe1d67d9-0e08-46b8-b7c3-1bc8eff7d3bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c60dae364740c6983d708ae9b7e411'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:47.584656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 839/1669] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:24:47 2022] DELETE /identity/v3/users/f8c60dae364740c6983d708ae9b7e411 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:47.590667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c43d3f-9015-44fd-a8a9-4d233e699de4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.590935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c43d3f-9015-44fd-a8a9-4d233e699de4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.591634 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c43d3f-9015-44fd-a8a9-4d233e699de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.623322 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-bdfc3b10-6156-4116-a435-c00628575fc0 None None] MFA Rules not processed for user `0c7b88e083d04718bf19d982724babd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:47.626852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bdfc3b10-6156-4116-a435-c00628575fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:47.629833 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-26c43d3f-9015-44fd-a8a9-4d233e699de4 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:47.631296 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-26c43d3f-9015-44fd-a8a9-4d233e699de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:47.805478 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 831/1670] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 20 19:24:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:24:47.883660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 840/1671] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:47.917395 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc3b10-6156-4116-a435-c00628575fc0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.921666 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bdfc3b10-6156-4116-a435-c00628575fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:47.939846 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c43d3f-9015-44fd-a8a9-4d233e699de4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:47.941511 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-26c43d3f-9015-44fd-a8a9-4d233e699de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:47.965567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc3b10-6156-4116-a435-c00628575fc0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.967092 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c43d3f-9015-44fd-a8a9-4d233e699de4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:47.983206 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b70964-2389-4358-8c7a-cfc2d1e42df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.987188 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752d443-8837-4c1c-a25e-29167ab6d035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:47.987934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b70964-2389-4358-8c7a-cfc2d1e42df7 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.988613 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752d443-8837-4c1c-a25e-29167ab6d035 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:47.988971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b70964-2389-4358-8c7a-cfc2d1e42df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.989320 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b70964-2389-4358-8c7a-cfc2d1e42df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:47.990193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752d443-8837-4c1c-a25e-29167ab6d035 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:47.990598 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752d443-8837-4c1c-a25e-29167ab6d035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.023394 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752d443-8837-4c1c-a25e-29167ab6d035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:48.025179 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b70964-2389-4358-8c7a-cfc2d1e42df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:48.028939 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752d443-8837-4c1c-a25e-29167ab6d035 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:48.029487 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b70964-2389-4358-8c7a-cfc2d1e42df7 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:48.059259 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 841/1672] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:24:48.076844 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 832/1673] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:48.554102 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08540bcb-3c05-4992-9054-3980f9676db0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:48.554684 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08540bcb-3c05-4992-9054-3980f9676db0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:48.554953 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08540bcb-3c05-4992-9054-3980f9676db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.632097 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-08540bcb-3c05-4992-9054-3980f9676db0 None None] MFA Rules not processed for user `31bfcbd417344e5cadf0f2e6f504fafb`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:48.635024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-08540bcb-3c05-4992-9054-3980f9676db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:48.772516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b70964-2389-4358-8c7a-cfc2d1e42df7 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:48.774124 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c4b70964-2389-4358-8c7a-cfc2d1e42df7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:48.808456 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b70964-2389-4358-8c7a-cfc2d1e42df7 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:48.825577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6403a39-6b16-4309-9d47-b1e288d61404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:48.829270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6403a39-6b16-4309-9d47-b1e288d61404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:48.830155 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6403a39-6b16-4309-9d47-b1e288d61404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:48.830605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6403a39-6b16-4309-9d47-b1e288d61404 admin admin] PATH_INFO: `/v3/users/25d9b889ccfb4c7ca9731fb416ba46e7` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:48.833349 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6403a39-6b16-4309-9d47-b1e288d61404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25d9b889ccfb4c7ca9731fb416ba46e7)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:48.839783 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6403a39-6b16-4309-9d47-b1e288d61404 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:48.847768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 842/1674] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:48.862486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08540bcb-3c05-4992-9054-3980f9676db0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:48.864194 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-08540bcb-3c05-4992-9054-3980f9676db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:48.925410 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a6403a39-6b16-4309-9d47-b1e288d61404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25d9b889ccfb4c7ca9731fb416ba46e7'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:48.935257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a6403a39-6b16-4309-9d47-b1e288d61404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25d9b889ccfb4c7ca9731fb416ba46e7'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:48.947735 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a6403a39-6b16-4309-9d47-b1e288d61404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25d9b889ccfb4c7ca9731fb416ba46e7'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:48.949106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a6403a39-6b16-4309-9d47-b1e288d61404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25d9b889ccfb4c7ca9731fb416ba46e7'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:48.950399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-a6403a39-6b16-4309-9d47-b1e288d61404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25d9b889ccfb4c7ca9731fb416ba46e7'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:48.959320 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:48.992341 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 833/1675] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:24:48 2022] DELETE /identity/v3/users/25d9b889ccfb4c7ca9731fb416ba46e7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:48.993753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6403a39-6b16-4309-9d47-b1e288d61404 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:48.996230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a6403a39-6b16-4309-9d47-b1e288d61404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:49.016483 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:49.044722 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08540bcb-3c05-4992-9054-3980f9676db0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:49.099929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6403a39-6b16-4309-9d47-b1e288d61404 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:49.105926 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abcc10-4e16-47f4-8a21-8768d884ebf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:49.106927 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abcc10-4e16-47f4-8a21-8768d884ebf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:49.107212 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abcc10-4e16-47f4-8a21-8768d884ebf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:49.107487 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abcc10-4e16-47f4-8a21-8768d884ebf2 admin admin] PATH_INFO: `/v3/projects/4f4c31dc409a45578e5d2340c616aa11` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:49.110249 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80abcc10-4e16-47f4-8a21-8768d884ebf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f4c31dc409a45578e5d2340c616aa11)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:49.112021 dv-cinder-819149-14-smb devstack@keystone.service[80233]: WARNING py.warnings [None req-80abcc10-4e16-47f4-8a21-8768d884ebf2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 19:24:49.112021 dv-cinder-819149-14-smb devstack@keystone.service[80233]: warnings.warn(msg) Jul 20 19:24:49.112021 dv-cinder-819149-14-smb devstack@keystone.service[80233]: Jul 20 19:24:49.113475 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80abcc10-4e16-47f4-8a21-8768d884ebf2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:49.218099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-80abcc10-4e16-47f4-8a21-8768d884ebf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f4c31dc409a45578e5d2340c616aa11', 'request_id': 'req-80abcc10-4e16-47f4-8a21-8768d884ebf2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:49.224723 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc69ff-45a8-49de-a5fe-c6413407a9dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:49.225663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc69ff-45a8-49de-a5fe-c6413407a9dc service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:49.226023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc69ff-45a8-49de-a5fe-c6413407a9dc service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:49.226399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc69ff-45a8-49de-a5fe-c6413407a9dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:49.236315 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-edcc69ff-45a8-49de-a5fe-c6413407a9dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:49.253183 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-80abcc10-4e16-47f4-8a21-8768d884ebf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f4c31dc409a45578e5d2340c616aa11', 'request_id': 'req-80abcc10-4e16-47f4-8a21-8768d884ebf2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:49.264715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-80abcc10-4e16-47f4-8a21-8768d884ebf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f4c31dc409a45578e5d2340c616aa11', 'request_id': 'req-80abcc10-4e16-47f4-8a21-8768d884ebf2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:49.294188 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-80abcc10-4e16-47f4-8a21-8768d884ebf2 admin admin] The token cache is being invalidate because project 4f4c31dc409a45578e5d2340c616aa11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:24:49.294745 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-80abcc10-4e16-47f4-8a21-8768d884ebf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:49.295791 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-80abcc10-4e16-47f4-8a21-8768d884ebf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:49.300594 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 834/1676] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:24:48 2022] DELETE /identity/v3/projects/4f4c31dc409a45578e5d2340c616aa11 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:49.304439 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f84f7-2d0e-4adb-9dcb-867c589669a6 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:49.307124 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f84f7-2d0e-4adb-9dcb-867c589669a6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:49.307507 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f84f7-2d0e-4adb-9dcb-867c589669a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:49.371958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1f4f84f7-2d0e-4adb-9dcb-867c589669a6 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:49.374048 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1f4f84f7-2d0e-4adb-9dcb-867c589669a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:49.423372 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc69ff-45a8-49de-a5fe-c6413407a9dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:49.428872 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc69ff-45a8-49de-a5fe-c6413407a9dc service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:49.471239 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 843/1677] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:24:49.487331 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc69ff-45a8-49de-a5fe-c6413407a9dc service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:49.535993 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc69ff-45a8-49de-a5fe-c6413407a9dc service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:49.588963 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 835/1678] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:49.596309 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ba4c3-096d-4d5c-8ef3-ff6f55658f02 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:49.596950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ba4c3-096d-4d5c-8ef3-ff6f55658f02 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:49.597401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ba4c3-096d-4d5c-8ef3-ff6f55658f02 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:49.599318 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 836/1679] 10.222.0.18 () {54 vars in 961 bytes} [Wed Jul 20 19:24:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:24:49.604549 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf482d3-0f63-4eee-b0d0-027d75497ef6 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:49.605020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf482d3-0f63-4eee-b0d0-027d75497ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:49.611629 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf482d3-0f63-4eee-b0d0-027d75497ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:49.676122 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-dcf482d3-0f63-4eee-b0d0-027d75497ef6 None None] MFA Rules not processed for user `d310799ac43e42bc9c7810e1296ddb9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:49.678472 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-dcf482d3-0f63-4eee-b0d0-027d75497ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:49.736615 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc09785-e4f3-4dbd-aefc-caf2c4251ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:49.737565 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc09785-e4f3-4dbd-aefc-caf2c4251ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:49.737794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc09785-e4f3-4dbd-aefc-caf2c4251ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:49.738073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc09785-e4f3-4dbd-aefc-caf2c4251ad2 admin admin] PATH_INFO: `/v3/users/2a364424e2dc422da25b347d13ff8847` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:49.739380 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc09785-e4f3-4dbd-aefc-caf2c4251ad2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a364424e2dc422da25b347d13ff8847)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:49.743162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc09785-e4f3-4dbd-aefc-caf2c4251ad2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:49.786812 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:49.815735 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:49.885300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7dc09785-e4f3-4dbd-aefc-caf2c4251ad2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a364424e2dc422da25b347d13ff8847'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:49.907239 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7dc09785-e4f3-4dbd-aefc-caf2c4251ad2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a364424e2dc422da25b347d13ff8847'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:49.925158 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 837/1680] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Jul 20 19:24:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:24:49.926092 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf482d3-0f63-4eee-b0d0-027d75497ef6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:49.927718 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-dcf482d3-0f63-4eee-b0d0-027d75497ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:49.939771 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7dc09785-e4f3-4dbd-aefc-caf2c4251ad2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a364424e2dc422da25b347d13ff8847'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:49.952034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7dc09785-e4f3-4dbd-aefc-caf2c4251ad2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a364424e2dc422da25b347d13ff8847'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:49.954125 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7dc09785-e4f3-4dbd-aefc-caf2c4251ad2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a364424e2dc422da25b347d13ff8847'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:49.977207 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 844/1681] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:24:49 2022] DELETE /identity/v3/users/2a364424e2dc422da25b347d13ff8847 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:49.977207 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc09785-e4f3-4dbd-aefc-caf2c4251ad2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:49.977459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7dc09785-e4f3-4dbd-aefc-caf2c4251ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:50.096725 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf482d3-0f63-4eee-b0d0-027d75497ef6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:50.149905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc09785-e4f3-4dbd-aefc-caf2c4251ad2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:50.175629 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a81db7-e775-46bf-aaf3-365189a6fda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:50.176948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a81db7-e775-46bf-aaf3-365189a6fda2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:50.177461 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a81db7-e775-46bf-aaf3-365189a6fda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:50.178115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a81db7-e775-46bf-aaf3-365189a6fda2 admin admin] PATH_INFO: `/v3/projects/e3b17103578b4fd09388c38dc59afa5b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:50.179774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a81db7-e775-46bf-aaf3-365189a6fda2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3b17103578b4fd09388c38dc59afa5b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:50.182011 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a81db7-e775-46bf-aaf3-365189a6fda2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:50.244002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5a93f-cc9a-4202-9db4-c2cd1931dd1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:50.245117 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5a93f-cc9a-4202-9db4-c2cd1931dd1a service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:50.245826 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5a93f-cc9a-4202-9db4-c2cd1931dd1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:50.246945 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5a93f-cc9a-4202-9db4-c2cd1931dd1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:50.252974 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-eec5a93f-cc9a-4202-9db4-c2cd1931dd1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:50.278839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5a93f-cc9a-4202-9db4-c2cd1931dd1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:50.281759 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5a93f-cc9a-4202-9db4-c2cd1931dd1a service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:50.292174 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-18a81db7-e775-46bf-aaf3-365189a6fda2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3b17103578b4fd09388c38dc59afa5b', 'request_id': 'req-18a81db7-e775-46bf-aaf3-365189a6fda2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:50.308486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-18a81db7-e775-46bf-aaf3-365189a6fda2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3b17103578b4fd09388c38dc59afa5b', 'request_id': 'req-18a81db7-e775-46bf-aaf3-365189a6fda2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:50.313733 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 838/1682] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:50.315176 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5a93f-cc9a-4202-9db4-c2cd1931dd1a service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:50.318999 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-eec5a93f-cc9a-4202-9db4-c2cd1931dd1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:50.331804 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-18a81db7-e775-46bf-aaf3-365189a6fda2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3b17103578b4fd09388c38dc59afa5b', 'request_id': 'req-18a81db7-e775-46bf-aaf3-365189a6fda2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:50.354434 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-18a81db7-e775-46bf-aaf3-365189a6fda2 admin admin] The token cache is being invalidate because project e3b17103578b4fd09388c38dc59afa5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:24:50.355087 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-18a81db7-e775-46bf-aaf3-365189a6fda2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:50.356572 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-18a81db7-e775-46bf-aaf3-365189a6fda2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:50.360717 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 845/1683] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:24:49 2022] DELETE /identity/v3/projects/e3b17103578b4fd09388c38dc59afa5b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:50.363418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a81db7-e775-46bf-aaf3-365189a6fda2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:50.365373 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-18a81db7-e775-46bf-aaf3-365189a6fda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:50.422360 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:50.487633 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5a93f-cc9a-4202-9db4-c2cd1931dd1a service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:50.510953 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a81db7-e775-46bf-aaf3-365189a6fda2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:50.526929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b17272-dc56-4781-80bd-778a4ecc28c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:50.527830 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b17272-dc56-4781-80bd-778a4ecc28c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:50.528114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b17272-dc56-4781-80bd-778a4ecc28c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:50.528449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b17272-dc56-4781-80bd-778a4ecc28c6 admin admin] PATH_INFO: `/v3/projects/a5a32487da0c432bbe5e659d55b4f490` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:50.532076 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b17272-dc56-4781-80bd-778a4ecc28c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5a32487da0c432bbe5e659d55b4f490)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:50.536354 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b17272-dc56-4781-80bd-778a4ecc28c6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:50.565357 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:50.629088 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bd0c5-98f2-4098-adf6-1aa6572019f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd310799ac43e42bc9c7810e1296ddb9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:50.629476 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bd0c5-98f2-4098-adf6-1aa6572019f3 service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:50.629675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bd0c5-98f2-4098-adf6-1aa6572019f3 service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:50.629975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bd0c5-98f2-4098-adf6-1aa6572019f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:50.635177 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-711bd0c5-98f2-4098-adf6-1aa6572019f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:50.647267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a0b17272-dc56-4781-80bd-778a4ecc28c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5a32487da0c432bbe5e659d55b4f490', 'request_id': 'req-a0b17272-dc56-4781-80bd-778a4ecc28c6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:50.656872 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a0b17272-dc56-4781-80bd-778a4ecc28c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5a32487da0c432bbe5e659d55b4f490', 'request_id': 'req-a0b17272-dc56-4781-80bd-778a4ecc28c6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:50.660891 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711bd0c5-98f2-4098-adf6-1aa6572019f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:50.663751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711bd0c5-98f2-4098-adf6-1aa6572019f3 service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:50.678802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a0b17272-dc56-4781-80bd-778a4ecc28c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5a32487da0c432bbe5e659d55b4f490', 'request_id': 'req-a0b17272-dc56-4781-80bd-778a4ecc28c6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:50.689634 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 839/1684] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:50.692897 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589de3c-8960-4c03-886c-d26d5fa4939f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:50.693183 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589de3c-8960-4c03-886c-d26d5fa4939f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:50.693471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589de3c-8960-4c03-886c-d26d5fa4939f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:50.697082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a0b17272-dc56-4781-80bd-778a4ecc28c6 admin admin] The token cache is being invalidate because project a5a32487da0c432bbe5e659d55b4f490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:24:50.697375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a0b17272-dc56-4781-80bd-778a4ecc28c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:50.698106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a0b17272-dc56-4781-80bd-778a4ecc28c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:50.700434 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 846/1685] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:24:50 2022] DELETE /identity/v3/projects/a5a32487da0c432bbe5e659d55b4f490 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:50.704059 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b17272-dc56-4781-80bd-778a4ecc28c6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:50.705528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a0b17272-dc56-4781-80bd-778a4ecc28c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:50.733130 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5589de3c-8960-4c03-886c-d26d5fa4939f None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:50.736984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5589de3c-8960-4c03-886c-d26d5fa4939f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:50.900756 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b17272-dc56-4781-80bd-778a4ecc28c6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:50.907993 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3de011-1eac-46f5-9538-a7d55da171c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:50.914504 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3de011-1eac-46f5-9538-a7d55da171c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:50.916247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3de011-1eac-46f5-9538-a7d55da171c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:50.916712 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3de011-1eac-46f5-9538-a7d55da171c6 admin admin] PATH_INFO: `/v3/users/b830fa36603c42d181329b907c80c2fd` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:50.918346 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3de011-1eac-46f5-9538-a7d55da171c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b830fa36603c42d181329b907c80c2fd)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:50.920454 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3de011-1eac-46f5-9538-a7d55da171c6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:50.991787 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 840/1686] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:50.997182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589de3c-8960-4c03-886c-d26d5fa4939f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:51.000972 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5589de3c-8960-4c03-886c-d26d5fa4939f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:51.032078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589de3c-8960-4c03-886c-d26d5fa4939f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:51.035928 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eb3de011-1eac-46f5-9538-a7d55da171c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b830fa36603c42d181329b907c80c2fd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:51.041359 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c8c22-e178-4aad-b60f-9f6a89ed72b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:51.042654 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c8c22-e178-4aad-b60f-9f6a89ed72b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:51.043517 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c8c22-e178-4aad-b60f-9f6a89ed72b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:51.044047 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c8c22-e178-4aad-b60f-9f6a89ed72b4 admin admin] PATH_INFO: `/v3/projects/cc1ef9b479e44539bfc6cbe96826b68e` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:51.045801 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:51.050063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c8c22-e178-4aad-b60f-9f6a89ed72b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc1ef9b479e44539bfc6cbe96826b68e)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:51.052876 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eb3de011-1eac-46f5-9538-a7d55da171c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b830fa36603c42d181329b907c80c2fd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:51.053989 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c8c22-e178-4aad-b60f-9f6a89ed72b4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:51.086283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eb3de011-1eac-46f5-9538-a7d55da171c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b830fa36603c42d181329b907c80c2fd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:51.102989 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eb3de011-1eac-46f5-9538-a7d55da171c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b830fa36603c42d181329b907c80c2fd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:51.104151 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eb3de011-1eac-46f5-9538-a7d55da171c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b830fa36603c42d181329b907c80c2fd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:51.122484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 847/1687] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:24:50 2022] DELETE /identity/v3/users/b830fa36603c42d181329b907c80c2fd => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:24:51.127723 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cd49a-d62b-41d3-9d49-c488d9d1bb45 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:51.128290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cd49a-d62b-41d3-9d49-c488d9d1bb45 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:51.128897 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cd49a-d62b-41d3-9d49-c488d9d1bb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:51.166784 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f74c8c22-e178-4aad-b60f-9f6a89ed72b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc1ef9b479e44539bfc6cbe96826b68e', 'request_id': 'req-f74c8c22-e178-4aad-b60f-9f6a89ed72b4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:51.179713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5a4cd49a-d62b-41d3-9d49-c488d9d1bb45 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:51.181124 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5a4cd49a-d62b-41d3-9d49-c488d9d1bb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:51.184426 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f74c8c22-e178-4aad-b60f-9f6a89ed72b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc1ef9b479e44539bfc6cbe96826b68e', 'request_id': 'req-f74c8c22-e178-4aad-b60f-9f6a89ed72b4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:51.209432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f74c8c22-e178-4aad-b60f-9f6a89ed72b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc1ef9b479e44539bfc6cbe96826b68e', 'request_id': 'req-f74c8c22-e178-4aad-b60f-9f6a89ed72b4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:51.251215 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f74c8c22-e178-4aad-b60f-9f6a89ed72b4 admin admin] The token cache is being invalidate because project cc1ef9b479e44539bfc6cbe96826b68e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:24:51.252657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f74c8c22-e178-4aad-b60f-9f6a89ed72b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:51.253874 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f74c8c22-e178-4aad-b60f-9f6a89ed72b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:51.261370 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 841/1688] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:24:50 2022] DELETE /identity/v3/projects/cc1ef9b479e44539bfc6cbe96826b68e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:51.271012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481d386-9cef-40f5-91be-dcfa4e4d4856 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:51.271320 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481d386-9cef-40f5-91be-dcfa4e4d4856 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:51.272924 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481d386-9cef-40f5-91be-dcfa4e4d4856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:51.331505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9481d386-9cef-40f5-91be-dcfa4e4d4856 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:51.338411 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9481d386-9cef-40f5-91be-dcfa4e4d4856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:51.393434 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 848/1689] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:51.399582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cd49a-d62b-41d3-9d49-c488d9d1bb45 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:51.444480 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cd49a-d62b-41d3-9d49-c488d9d1bb45 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:51.457840 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebd4ea-c2a8-408b-b097-b6cb451f50aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:51.458621 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebd4ea-c2a8-408b-b097-b6cb451f50aa admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:51.458918 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebd4ea-c2a8-408b-b097-b6cb451f50aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:51.459201 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebd4ea-c2a8-408b-b097-b6cb451f50aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:51.460010 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebd4ea-c2a8-408b-b097-b6cb451f50aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:24:51.460572 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebd4ea-c2a8-408b-b097-b6cb451f50aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:51.462233 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebd4ea-c2a8-408b-b097-b6cb451f50aa admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:51.488978 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:51.501916 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 849/1690] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:24:51.504326 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebd4ea-c2a8-408b-b097-b6cb451f50aa admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:51.528038 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 842/1691] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:51.529931 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25595ea5-72fc-443b-b0ee-8afb6f9946b5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:51.530434 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25595ea5-72fc-443b-b0ee-8afb6f9946b5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:51.531113 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25595ea5-72fc-443b-b0ee-8afb6f9946b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:51.532352 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebd4ea-c2a8-408b-b097-b6cb451f50aa admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:51.544610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182d372-0eff-4518-baa7-90692c0f6baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:51.545310 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182d372-0eff-4518-baa7-90692c0f6baf admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:51.545755 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182d372-0eff-4518-baa7-90692c0f6baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:51.546036 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182d372-0eff-4518-baa7-90692c0f6baf admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:51.549162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182d372-0eff-4518-baa7-90692c0f6baf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:51.557250 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182d372-0eff-4518-baa7-90692c0f6baf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:51.593657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-25595ea5-72fc-443b-b0ee-8afb6f9946b5 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:51.604898 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-25595ea5-72fc-443b-b0ee-8afb6f9946b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:51.632109 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 850/1692] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:51 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:51.632256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 843/1693] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:51.636343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182d372-0eff-4518-baa7-90692c0f6baf admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:51.636509 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25595ea5-72fc-443b-b0ee-8afb6f9946b5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:51.674184 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25595ea5-72fc-443b-b0ee-8afb6f9946b5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:51.871106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1667129-5fd1-43f6-b1af-42bc564a7c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:51.871802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1667129-5fd1-43f6-b1af-42bc564a7c4b admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:51.872105 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1667129-5fd1-43f6-b1af-42bc564a7c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:51.872374 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1667129-5fd1-43f6-b1af-42bc564a7c4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:51.873397 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1667129-5fd1-43f6-b1af-42bc564a7c4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:24:51.873397 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1667129-5fd1-43f6-b1af-42bc564a7c4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:51.875163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1667129-5fd1-43f6-b1af-42bc564a7c4b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:51.908792 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 844/1694] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:24:51.913048 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1667129-5fd1-43f6-b1af-42bc564a7c4b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:51.952017 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182d372-0eff-4518-baa7-90692c0f6baf admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:51.954444 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1667129-5fd1-43f6-b1af-42bc564a7c4b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:51.973234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5245c-75fb-448a-95a9-90bcfba1aab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:51.974008 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5245c-75fb-448a-95a9-90bcfba1aab8 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:51.974110 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4b4bb-d940-45cf-b989-c4d79b0c10af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:51.974284 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5245c-75fb-448a-95a9-90bcfba1aab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:51.974586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5245c-75fb-448a-95a9-90bcfba1aab8 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:51.974769 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4b4bb-d940-45cf-b989-c4d79b0c10af admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:51.975060 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4b4bb-d940-45cf-b989-c4d79b0c10af admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:51.975286 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5245c-75fb-448a-95a9-90bcfba1aab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:51.975385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4b4bb-d940-45cf-b989-c4d79b0c10af admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:51.976033 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4b4bb-d940-45cf-b989-c4d79b0c10af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:51.977273 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5245c-75fb-448a-95a9-90bcfba1aab8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:51.977983 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4b4bb-d940-45cf-b989-c4d79b0c10af admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:52.070176 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 845/1695] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:51 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:52.071807 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4b4bb-d940-45cf-b989-c4d79b0c10af admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:52.099075 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 851/1696] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:51 2022] POST /identity/v3/users => generated 291 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:52.106889 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5245c-75fb-448a-95a9-90bcfba1aab8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:52.149039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5245c-75fb-448a-95a9-90bcfba1aab8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:52.248830 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:52.347981 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4b4bb-d940-45cf-b989-c4d79b0c10af admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:52.357439 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182bf2c-ef09-4cc3-a861-6e79a58aad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:52.358438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182bf2c-ef09-4cc3-a861-6e79a58aad54 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:52.364272 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182bf2c-ef09-4cc3-a861-6e79a58aad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:52.364578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182bf2c-ef09-4cc3-a861-6e79a58aad54 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:52.365346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182bf2c-ef09-4cc3-a861-6e79a58aad54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:52.367618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182bf2c-ef09-4cc3-a861-6e79a58aad54 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:52.431063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 846/1697] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:52 2022] POST /identity/v3/users => generated 290 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:52.434544 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182bf2c-ef09-4cc3-a861-6e79a58aad54 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:52.452762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6182bf2c-ef09-4cc3-a861-6e79a58aad54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:52.458921 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1134c8c-93af-47c4-bc0d-f060e8ed82de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:52.459691 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1134c8c-93af-47c4-bc0d-f060e8ed82de admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:52.460080 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1134c8c-93af-47c4-bc0d-f060e8ed82de admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:52.461360 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1134c8c-93af-47c4-bc0d-f060e8ed82de admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:52.462118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1134c8c-93af-47c4-bc0d-f060e8ed82de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:52.463770 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1134c8c-93af-47c4-bc0d-f060e8ed82de admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:52.484668 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182bf2c-ef09-4cc3-a861-6e79a58aad54 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:52.493209 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 852/1698] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:52.494153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1134c8c-93af-47c4-bc0d-f060e8ed82de admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:52.503541 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de387686-b2a3-4de8-bc6a-e2fb7aefe371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:52.504441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de387686-b2a3-4de8-bc6a-e2fb7aefe371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:52.504721 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de387686-b2a3-4de8-bc6a-e2fb7aefe371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:52.504995 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de387686-b2a3-4de8-bc6a-e2fb7aefe371 admin admin] PATH_INFO: `/v3/projects/178cfc7d9b2e423aa98b4f6f1c615213` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:52.506534 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de387686-b2a3-4de8-bc6a-e2fb7aefe371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=178cfc7d9b2e423aa98b4f6f1c615213)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:52.508472 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de387686-b2a3-4de8-bc6a-e2fb7aefe371 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:52.542167 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1134c8c-93af-47c4-bc0d-f060e8ed82de admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:52.572446 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794e8bd-236d-433c-92b3-189ab7b22907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:52.574836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794e8bd-236d-433c-92b3-189ab7b22907 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:52.576312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794e8bd-236d-433c-92b3-189ab7b22907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:52.578682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794e8bd-236d-433c-92b3-189ab7b22907 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:52.586783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794e8bd-236d-433c-92b3-189ab7b22907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:52.591334 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794e8bd-236d-433c-92b3-189ab7b22907 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:52.629694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 853/1699] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:52.631029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794e8bd-236d-433c-92b3-189ab7b22907 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:52.661064 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794e8bd-236d-433c-92b3-189ab7b22907 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:52.685497 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:52.707456 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-de387686-b2a3-4de8-bc6a-e2fb7aefe371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '178cfc7d9b2e423aa98b4f6f1c615213', 'request_id': 'req-de387686-b2a3-4de8-bc6a-e2fb7aefe371'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:52.735145 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-de387686-b2a3-4de8-bc6a-e2fb7aefe371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '178cfc7d9b2e423aa98b4f6f1c615213', 'request_id': 'req-de387686-b2a3-4de8-bc6a-e2fb7aefe371'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:52.755386 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-de387686-b2a3-4de8-bc6a-e2fb7aefe371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '178cfc7d9b2e423aa98b4f6f1c615213', 'request_id': 'req-de387686-b2a3-4de8-bc6a-e2fb7aefe371'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:52.783689 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-de387686-b2a3-4de8-bc6a-e2fb7aefe371 admin admin] The token cache is being invalidate because project 178cfc7d9b2e423aa98b4f6f1c615213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:24:52.783689 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-de387686-b2a3-4de8-bc6a-e2fb7aefe371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:52.784748 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-de387686-b2a3-4de8-bc6a-e2fb7aefe371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:52.792319 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 847/1700] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:24:52 2022] DELETE /identity/v3/projects/178cfc7d9b2e423aa98b4f6f1c615213 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:52.793787 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de387686-b2a3-4de8-bc6a-e2fb7aefe371 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:52.798185 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-de387686-b2a3-4de8-bc6a-e2fb7aefe371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:52.876528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f7961-faa1-4dd9-b9ce-76ca33f6a32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:52.881066 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f7961-faa1-4dd9-b9ce-76ca33f6a32c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:52.881066 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f7961-faa1-4dd9-b9ce-76ca33f6a32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:52.881066 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f7961-faa1-4dd9-b9ce-76ca33f6a32c admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:52.881066 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f7961-faa1-4dd9-b9ce-76ca33f6a32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:52.888164 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f7961-faa1-4dd9-b9ce-76ca33f6a32c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:52.917033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 854/1701] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:52.919384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611627b-3c9b-4caa-937f-b0297c74ee66 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:52.920256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611627b-3c9b-4caa-937f-b0297c74ee66 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:52.920793 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611627b-3c9b-4caa-937f-b0297c74ee66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:52.961545 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c611627b-3c9b-4caa-937f-b0297c74ee66 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:52.964201 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c611627b-3c9b-4caa-937f-b0297c74ee66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:52.981045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 855/1702] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:52.982528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611627b-3c9b-4caa-937f-b0297c74ee66 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:52.992038 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c611627b-3c9b-4caa-937f-b0297c74ee66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:53.018543 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611627b-3c9b-4caa-937f-b0297c74ee66 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:53.036791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f2ea26-16c1-48cf-9675-1ab8fc780288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:53.038949 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2ea26-16c1-48cf-9675-1ab8fc780288 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:53.039248 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2ea26-16c1-48cf-9675-1ab8fc780288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:53.039544 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2ea26-16c1-48cf-9675-1ab8fc780288 admin admin] PATH_INFO: `/v3/projects/e63176d25e2348ffada98d98e63554fd/users/6b2dad91f67a4405b97336eb0239fbb5/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:53.083670 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2ea26-16c1-48cf-9675-1ab8fc780288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e63176d25e2348ffada98d98e63554fd, user_id=6b2dad91f67a4405b97336eb0239fbb5, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:53.090288 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f2ea26-16c1-48cf-9675-1ab8fc780288 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:53.124982 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 856/1703] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:52 2022] PUT /identity/v3/projects/e63176d25e2348ffada98d98e63554fd/users/6b2dad91f67a4405b97336eb0239fbb5/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:53.126997 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae297a-682c-4045-9977-f0857507a6ad None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:53.132493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae297a-682c-4045-9977-f0857507a6ad None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:53.132682 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de387686-b2a3-4de8-bc6a-e2fb7aefe371 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:53.133134 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae297a-682c-4045-9977-f0857507a6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:53.191510 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e4ae297a-682c-4045-9977-f0857507a6ad None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:53.200237 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e4ae297a-682c-4045-9977-f0857507a6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:53.279494 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54709300-ee95-4d0b-bf1b-1a607b604ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:53.281390 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54709300-ee95-4d0b-bf1b-1a607b604ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:53.282111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54709300-ee95-4d0b-bf1b-1a607b604ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:53.283684 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54709300-ee95-4d0b-bf1b-1a607b604ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:53.284541 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54709300-ee95-4d0b-bf1b-1a607b604ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:53.288948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54709300-ee95-4d0b-bf1b-1a607b604ce5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:53.320205 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 848/1704] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 527 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:53.322104 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34a516-bb9c-4f9b-ba0b-5c4046c39e12 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:53.325333 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34a516-bb9c-4f9b-ba0b-5c4046c39e12 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:53.325732 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34a516-bb9c-4f9b-ba0b-5c4046c39e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:53.377175 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 857/1705] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:53.379547 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1e34a516-bb9c-4f9b-ba0b-5c4046c39e12 None None] MFA Rules not processed for user `6b2dad91f67a4405b97336eb0239fbb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:53.381797 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1e34a516-bb9c-4f9b-ba0b-5c4046c39e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:53.382594 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae297a-682c-4045-9977-f0857507a6ad None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:53.405851 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae297a-682c-4045-9977-f0857507a6ad None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:53.429372 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a15c64-c91e-4403-ab53-b433e72297dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:53.430361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a15c64-c91e-4403-ab53-b433e72297dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:53.430636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a15c64-c91e-4403-ab53-b433e72297dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:53.430916 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a15c64-c91e-4403-ab53-b433e72297dc admin admin] PATH_INFO: `/v3/projects/5997d6d2766f443d9dd0519a880a64de/users/f456a14b243d4979b951229d695605e1/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:53.479011 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:53.483694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a15c64-c91e-4403-ab53-b433e72297dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5997d6d2766f443d9dd0519a880a64de, user_id=f456a14b243d4979b951229d695605e1, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:53.488174 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a15c64-c91e-4403-ab53-b433e72297dc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:53.514869 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 858/1706] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:53 2022] PUT /identity/v3/projects/5997d6d2766f443d9dd0519a880a64de/users/f456a14b243d4979b951229d695605e1/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:53.515911 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a15c64-c91e-4403-ab53-b433e72297dc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:53.629472 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 849/1707] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:53.634202 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bfdfd-1da6-415b-9ec8-d399c92a6c68 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:53.634527 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bfdfd-1da6-415b-9ec8-d399c92a6c68 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:53.635685 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bfdfd-1da6-415b-9ec8-d399c92a6c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:53.662167 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:53.723602 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-dd9bfdfd-1da6-415b-9ec8-d399c92a6c68 None None] MFA Rules not processed for user `f456a14b243d4979b951229d695605e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:53.725233 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-dd9bfdfd-1da6-415b-9ec8-d399c92a6c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:53.744209 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a15c64-c91e-4403-ab53-b433e72297dc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:53.763209 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e42667-1126-447d-bce0-db3fd09c50cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:53.764255 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e42667-1126-447d-bce0-db3fd09c50cb admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:53.764255 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e42667-1126-447d-bce0-db3fd09c50cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:53.764556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e42667-1126-447d-bce0-db3fd09c50cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:53.765571 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e42667-1126-447d-bce0-db3fd09c50cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:24:53.765884 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e42667-1126-447d-bce0-db3fd09c50cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:53.767985 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e42667-1126-447d-bce0-db3fd09c50cb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:53.800566 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 859/1708] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:24:53.804676 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f7d0a-2405-43f3-8026-2ad21e8041f6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:53.804979 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f7d0a-2405-43f3-8026-2ad21e8041f6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:53.805297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f7d0a-2405-43f3-8026-2ad21e8041f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:53.866917 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-770f7d0a-2405-43f3-8026-2ad21e8041f6 None None] MFA Rules not processed for user `551a91b131bc4a16a40b865a0a3fb50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:53.868483 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-770f7d0a-2405-43f3-8026-2ad21e8041f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:53.909493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 850/1709] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:53.910671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bfdfd-1da6-415b-9ec8-d399c92a6c68 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:53.937240 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bfdfd-1da6-415b-9ec8-d399c92a6c68 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:53.945264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b8670-22cf-4e06-b46a-8e137a36c590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:53.946443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b8670-22cf-4e06-b46a-8e137a36c590 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:53.946932 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b8670-22cf-4e06-b46a-8e137a36c590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:53.947108 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b8670-22cf-4e06-b46a-8e137a36c590 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:53.948202 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b8670-22cf-4e06-b46a-8e137a36c590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:53.950926 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b8670-22cf-4e06-b46a-8e137a36c590 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:53.989527 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 851/1710] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:53 2022] POST /identity/v3/projects => generated 381 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:53.989527 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b8670-22cf-4e06-b46a-8e137a36c590 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:54.004822 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 860/1711] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:54.004822 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f7d0a-2405-43f3-8026-2ad21e8041f6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:54.027942 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f7d0a-2405-43f3-8026-2ad21e8041f6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:54.094947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b8670-22cf-4e06-b46a-8e137a36c590 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:54.102493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569114aa-2ceb-41d0-812b-e2f638f211f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:54.103330 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569114aa-2ceb-41d0-812b-e2f638f211f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:54.103724 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569114aa-2ceb-41d0-812b-e2f638f211f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:54.103999 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569114aa-2ceb-41d0-812b-e2f638f211f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:54.104827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569114aa-2ceb-41d0-812b-e2f638f211f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:54.107037 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569114aa-2ceb-41d0-812b-e2f638f211f0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:54.141041 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90458b-fb6a-40bc-b4d0-69da0a230de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:54.141803 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90458b-fb6a-40bc-b4d0-69da0a230de3 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:54.145964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90458b-fb6a-40bc-b4d0-69da0a230de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:54.145964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90458b-fb6a-40bc-b4d0-69da0a230de3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:54.147174 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90458b-fb6a-40bc-b4d0-69da0a230de3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:54.149819 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90458b-fb6a-40bc-b4d0-69da0a230de3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:54.159234 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 852/1712] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:53 2022] POST /identity/v3/projects => generated 369 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:54.161869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569114aa-2ceb-41d0-812b-e2f638f211f0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:54.199628 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:54.215030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 861/1713] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:53 2022] POST /identity/v3/projects => generated 379 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:54.216467 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64742351-fdcc-422f-8174-274066a95bbe None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:54.216762 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64742351-fdcc-422f-8174-274066a95bbe None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:54.217047 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64742351-fdcc-422f-8174-274066a95bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:54.275581 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-64742351-fdcc-422f-8174-274066a95bbe None None] MFA Rules not processed for user `551a91b131bc4a16a40b865a0a3fb50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:54.276937 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-64742351-fdcc-422f-8174-274066a95bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:54.321013 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:54.334720 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569114aa-2ceb-41d0-812b-e2f638f211f0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:54.418949 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 862/1714] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:54.418949 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64742351-fdcc-422f-8174-274066a95bbe None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:54.425399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-64742351-fdcc-422f-8174-274066a95bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:54.468491 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97f148-1006-4686-bc02-1b4fc8ed1a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:54.468718 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97f148-1006-4686-bc02-1b4fc8ed1a9e admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:54.468976 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97f148-1006-4686-bc02-1b4fc8ed1a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:54.469252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97f148-1006-4686-bc02-1b4fc8ed1a9e admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:54.469956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97f148-1006-4686-bc02-1b4fc8ed1a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:54.471998 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97f148-1006-4686-bc02-1b4fc8ed1a9e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:54.521986 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 853/1715] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:54 2022] POST /identity/v3/users => generated 297 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:54.525770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97f148-1006-4686-bc02-1b4fc8ed1a9e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:54.544874 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97f148-1006-4686-bc02-1b4fc8ed1a9e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:54.552254 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15227b-c6bf-420e-8d9b-a5fe9689ba56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:54.554539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15227b-c6bf-420e-8d9b-a5fe9689ba56 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:54.555774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15227b-c6bf-420e-8d9b-a5fe9689ba56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:54.556528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15227b-c6bf-420e-8d9b-a5fe9689ba56 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:54.558203 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15227b-c6bf-420e-8d9b-a5fe9689ba56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:54.567527 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15227b-c6bf-420e-8d9b-a5fe9689ba56 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:54.581837 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64742351-fdcc-422f-8174-274066a95bbe None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:54.592158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fee4f-5692-43de-8372-4e1f01feba0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:54.593265 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fee4f-5692-43de-8372-4e1f01feba0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:54.593582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fee4f-5692-43de-8372-4e1f01feba0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:54.593865 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fee4f-5692-43de-8372-4e1f01feba0e admin admin] PATH_INFO: `/v3/projects/5c15eb5c520e4a2d9c8dba652469cece` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:54.600123 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fee4f-5692-43de-8372-4e1f01feba0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c15eb5c520e4a2d9c8dba652469cece)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:54.603964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fee4f-5692-43de-8372-4e1f01feba0e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:54.611939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 854/1716] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:54 2022] POST /identity/v3/users => generated 285 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:54.611939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15227b-c6bf-420e-8d9b-a5fe9689ba56 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:54.632141 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15227b-c6bf-420e-8d9b-a5fe9689ba56 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:54.649640 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe3b94-c90a-4a43-a255-ff7b940c180c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:54.650074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe3b94-c90a-4a43-a255-ff7b940c180c admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:54.650388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe3b94-c90a-4a43-a255-ff7b940c180c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:54.650669 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe3b94-c90a-4a43-a255-ff7b940c180c admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:54.651368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe3b94-c90a-4a43-a255-ff7b940c180c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:54.653582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe3b94-c90a-4a43-a255-ff7b940c180c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:54.691461 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 855/1717] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:54 2022] POST /identity/v3/users => generated 296 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:54.695215 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe3b94-c90a-4a43-a255-ff7b940c180c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:54.697493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cb5fee4f-5692-43de-8372-4e1f01feba0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c15eb5c520e4a2d9c8dba652469cece', 'request_id': 'req-cb5fee4f-5692-43de-8372-4e1f01feba0e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:54.701926 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0bbe3b94-c90a-4a43-a255-ff7b940c180c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:54.707874 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cb5fee4f-5692-43de-8372-4e1f01feba0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c15eb5c520e4a2d9c8dba652469cece', 'request_id': 'req-cb5fee4f-5692-43de-8372-4e1f01feba0e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:54.724866 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cb5fee4f-5692-43de-8372-4e1f01feba0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c15eb5c520e4a2d9c8dba652469cece', 'request_id': 'req-cb5fee4f-5692-43de-8372-4e1f01feba0e'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:54.745364 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cb5fee4f-5692-43de-8372-4e1f01feba0e admin admin] The token cache is being invalidate because project 5c15eb5c520e4a2d9c8dba652469cece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:24:54.746162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cb5fee4f-5692-43de-8372-4e1f01feba0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:54.747195 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cb5fee4f-5692-43de-8372-4e1f01feba0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:24:54.749523 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 863/1718] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:24:54 2022] DELETE /identity/v3/projects/5c15eb5c520e4a2d9c8dba652469cece => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:54.751726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fee4f-5692-43de-8372-4e1f01feba0e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:54.755376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cb5fee4f-5692-43de-8372-4e1f01feba0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:54.835413 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:54.864295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe3b94-c90a-4a43-a255-ff7b940c180c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:54.888486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fee4f-5692-43de-8372-4e1f01feba0e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:54.899645 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b590c90-7ce3-423b-a6a9-871caf0ac533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:54.900450 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b590c90-7ce3-423b-a6a9-871caf0ac533 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:54.900765 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b590c90-7ce3-423b-a6a9-871caf0ac533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:54.901280 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b590c90-7ce3-423b-a6a9-871caf0ac533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:54.902203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b590c90-7ce3-423b-a6a9-871caf0ac533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:54.904118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b590c90-7ce3-423b-a6a9-871caf0ac533 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:54.960341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 864/1719] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:54.960341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b590c90-7ce3-423b-a6a9-871caf0ac533 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:54.968026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8b590c90-7ce3-423b-a6a9-871caf0ac533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:55.015542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b590c90-7ce3-423b-a6a9-871caf0ac533 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:55.024529 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:55.042098 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7c1b9-f0d5-4bee-a4b0-35d397219203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:55.047468 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7c1b9-f0d5-4bee-a4b0-35d397219203 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:55.049282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7c1b9-f0d5-4bee-a4b0-35d397219203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:55.049604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7c1b9-f0d5-4bee-a4b0-35d397219203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:55.050506 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7c1b9-f0d5-4bee-a4b0-35d397219203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:55.063489 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7c1b9-f0d5-4bee-a4b0-35d397219203 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:55.065202 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e40b02-6cd9-40fa-b6ac-c6429f4edca6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:55.066021 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e40b02-6cd9-40fa-b6ac-c6429f4edca6 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:55.066171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e40b02-6cd9-40fa-b6ac-c6429f4edca6 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:55.066478 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e40b02-6cd9-40fa-b6ac-c6429f4edca6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:55.072761 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d7e40b02-6cd9-40fa-b6ac-c6429f4edca6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:55.086009 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 865/1720] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:55.100064 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7c1b9-f0d5-4bee-a4b0-35d397219203 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:55.117421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0fa7c1b9-f0d5-4bee-a4b0-35d397219203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:55.141863 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7c1b9-f0d5-4bee-a4b0-35d397219203 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:55.154908 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc268fc-aea4-4d9c-b4be-e0443db72855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:55.155601 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc268fc-aea4-4d9c-b4be-e0443db72855 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:55.156411 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc268fc-aea4-4d9c-b4be-e0443db72855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:55.156698 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc268fc-aea4-4d9c-b4be-e0443db72855 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:55.157447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc268fc-aea4-4d9c-b4be-e0443db72855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:55.159111 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc268fc-aea4-4d9c-b4be-e0443db72855 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:55.188513 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 866/1721] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:55.192113 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b01e3-d8ff-40e7-be01-6c65ee6c093c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:55.194709 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b01e3-d8ff-40e7-be01-6c65ee6c093c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:55.195229 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b01e3-d8ff-40e7-be01-6c65ee6c093c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:55.215152 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e40b02-6cd9-40fa-b6ac-c6429f4edca6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:55.217361 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e40b02-6cd9-40fa-b6ac-c6429f4edca6 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:55.239900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-ca4b01e3-d8ff-40e7-be01-6c65ee6c093c None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:55.241154 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ca4b01e3-d8ff-40e7-be01-6c65ee6c093c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:55.243572 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 856/1722] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:55.248782 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e40b02-6cd9-40fa-b6ac-c6429f4edca6 service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:55.268977 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 867/1723] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:55.268977 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a02a3-50c4-444b-89ed-68729b426add None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:55.270696 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a02a3-50c4-444b-89ed-68729b426add None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:55.272354 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a02a3-50c4-444b-89ed-68729b426add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:55.295519 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e40b02-6cd9-40fa-b6ac-c6429f4edca6 service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:55.321652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03c053-f088-4570-aede-ff1854979eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:55.322637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03c053-f088-4570-aede-ff1854979eab admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:55.326856 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03c053-f088-4570-aede-ff1854979eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:55.327402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03c053-f088-4570-aede-ff1854979eab admin admin] PATH_INFO: `/v3/projects/2ae50e5e3c5d4d5c99060a55b7c16233/users/fbb1d5d64cae48dcaaa9544ea813a5f2/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:55.403067 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03c053-f088-4570-aede-ff1854979eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae50e5e3c5d4d5c99060a55b7c16233, user_id=fbb1d5d64cae48dcaaa9544ea813a5f2, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:55.405777 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03c053-f088-4570-aede-ff1854979eab admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:55.442070 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 857/1724] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:55 2022] PUT /identity/v3/projects/2ae50e5e3c5d4d5c99060a55b7c16233/users/fbb1d5d64cae48dcaaa9544ea813a5f2/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:55.445456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c63a02a3-50c4-444b-89ed-68729b426add None None] MFA Rules not processed for user `e78792e617d84a7cbb384ed764c391fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:55.445747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03c053-f088-4570-aede-ff1854979eab admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:55.449148 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c63a02a3-50c4-444b-89ed-68729b426add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:55.570166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03c053-f088-4570-aede-ff1854979eab admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:55.570389 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 868/1725] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 20 19:24:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:55.571914 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188f535-cd9b-402f-ac60-d7cb313db897 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:55.572216 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188f535-cd9b-402f-ac60-d7cb313db897 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:55.573039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188f535-cd9b-402f-ac60-d7cb313db897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:55.577580 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2bc46-1fa4-4dbb-8c14-b40fea81da4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:55.579008 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2bc46-1fa4-4dbb-8c14-b40fea81da4f admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:55.579437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2bc46-1fa4-4dbb-8c14-b40fea81da4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:55.579437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2bc46-1fa4-4dbb-8c14-b40fea81da4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:55.580583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2bc46-1fa4-4dbb-8c14-b40fea81da4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:55.585463 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2bc46-1fa4-4dbb-8c14-b40fea81da4f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:55.611323 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e188f535-cd9b-402f-ac60-d7cb313db897 None None] MFA Rules not processed for user `4eaf9d8ee17e45c99c415e80e72ef868`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:55.612403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 858/1726] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:55.613741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2bc46-1fa4-4dbb-8c14-b40fea81da4f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:55.616442 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e188f535-cd9b-402f-ac60-d7cb313db897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:55.627848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2bc46-1fa4-4dbb-8c14-b40fea81da4f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:55.639873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8a7f1-dde5-4931-8263-2b4d68871fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:55.641588 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8a7f1-dde5-4931-8263-2b4d68871fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:55.642022 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8a7f1-dde5-4931-8263-2b4d68871fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:55.642901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8a7f1-dde5-4931-8263-2b4d68871fc5 admin admin] PATH_INFO: `/v3/projects/f0dc932c71334e2e927638cb32bf6715/users/e70d3f6a32b6492296b794fa982d3026/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:55.681777 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8a7f1-dde5-4931-8263-2b4d68871fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0dc932c71334e2e927638cb32bf6715, user_id=e70d3f6a32b6492296b794fa982d3026, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:55.684664 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8a7f1-dde5-4931-8263-2b4d68871fc5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:55.712021 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 869/1728] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:55.712202 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 859/1728] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:55 2022] PUT /identity/v3/projects/f0dc932c71334e2e927638cb32bf6715/users/e70d3f6a32b6492296b794fa982d3026/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:55.713200 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8a7f1-dde5-4931-8263-2b4d68871fc5 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:55.713682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c5b50-767c-48b4-8fa9-89aa1ecb3974 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:55.713988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c5b50-767c-48b4-8fa9-89aa1ecb3974 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:55.714275 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c5b50-767c-48b4-8fa9-89aa1ecb3974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:55.723109 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:55.737592 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7b7c5b50-767c-48b4-8fa9-89aa1ecb3974 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:55.739340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7b7c5b50-767c-48b4-8fa9-89aa1ecb3974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:55.790369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:55.818001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8a7f1-dde5-4931-8263-2b4d68871fc5 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:55.823835 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85ef7b-ae84-46c2-887e-aa6f84b0da56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:55.825312 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85ef7b-ae84-46c2-887e-aa6f84b0da56 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:55.825616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85ef7b-ae84-46c2-887e-aa6f84b0da56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:55.825922 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85ef7b-ae84-46c2-887e-aa6f84b0da56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:55.827109 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85ef7b-ae84-46c2-887e-aa6f84b0da56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:55.829454 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85ef7b-ae84-46c2-887e-aa6f84b0da56 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:55.834818 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 870/1729] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:55.836483 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c5b50-767c-48b4-8fa9-89aa1ecb3974 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:55.846092 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 860/1730] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:55.848163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec737947-0e6d-45f0-9656-1188de834cdf None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:55.848356 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec737947-0e6d-45f0-9656-1188de834cdf None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:55.848692 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec737947-0e6d-45f0-9656-1188de834cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:55.851581 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c5b50-767c-48b4-8fa9-89aa1ecb3974 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:55.858291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062a2e3-6b57-4a5b-bbad-b07eb9bfb92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:55.859848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062a2e3-6b57-4a5b-bbad-b07eb9bfb92e admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:55.860279 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062a2e3-6b57-4a5b-bbad-b07eb9bfb92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:55.860740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062a2e3-6b57-4a5b-bbad-b07eb9bfb92e admin admin] PATH_INFO: `/v3/projects/f65b653464b74cbab8d62b3f0967b832/users/72c228c1690a443fb59c65f4782a593f/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:55.883266 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062a2e3-6b57-4a5b-bbad-b07eb9bfb92e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f65b653464b74cbab8d62b3f0967b832, user_id=72c228c1690a443fb59c65f4782a593f, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:55.883766 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ec737947-0e6d-45f0-9656-1188de834cdf None None] MFA Rules not processed for user `31bfcbd417344e5cadf0f2e6f504fafb`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:55.885166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ec737947-0e6d-45f0-9656-1188de834cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:55.886744 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062a2e3-6b57-4a5b-bbad-b07eb9bfb92e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:55.920848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 871/1731] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:55 2022] PUT /identity/v3/projects/f65b653464b74cbab8d62b3f0967b832/users/72c228c1690a443fb59c65f4782a593f/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:55.920848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062a2e3-6b57-4a5b-bbad-b07eb9bfb92e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:55.993078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 861/1732] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:55.995250 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec737947-0e6d-45f0-9656-1188de834cdf None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:55.997714 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ec737947-0e6d-45f0-9656-1188de834cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:56.005921 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062a2e3-6b57-4a5b-bbad-b07eb9bfb92e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:56.013427 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c6820-ca98-4db6-b552-41a0062c5d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:56.014930 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c6820-ca98-4db6-b552-41a0062c5d2e admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:56.016323 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c6820-ca98-4db6-b552-41a0062c5d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:56.017228 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c6820-ca98-4db6-b552-41a0062c5d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:56.018418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c6820-ca98-4db6-b552-41a0062c5d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:56.020915 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c6820-ca98-4db6-b552-41a0062c5d2e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:56.037334 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 872/1733] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:56.039158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c6820-ca98-4db6-b552-41a0062c5d2e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:56.041566 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d38c6820-ca98-4db6-b552-41a0062c5d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:56.165806 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec737947-0e6d-45f0-9656-1188de834cdf None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:56.233504 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:56.266603 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c6820-ca98-4db6-b552-41a0062c5d2e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:56.286100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f57c83-a849-46da-9250-c4ba175eb14f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebd7c59f0014a3886fa75fb35a40e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:56.287096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f57c83-a849-46da-9250-c4ba175eb14f service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:56.287429 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f57c83-a849-46da-9250-c4ba175eb14f service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:56.287896 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f57c83-a849-46da-9250-c4ba175eb14f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:56.371122 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1515914-9b55-4158-b34a-cbc7559e0bb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:56.371830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1515914-9b55-4158-b34a-cbc7559e0bb4 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:56.372208 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1515914-9b55-4158-b34a-cbc7559e0bb4 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:56.372563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1515914-9b55-4158-b34a-cbc7559e0bb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:56.403553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:56.432764 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f57c83-a849-46da-9250-c4ba175eb14f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:56.434813 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f57c83-a849-46da-9250-c4ba175eb14f service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:56.459278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 873/1734] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 20 19:24:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:24:56.460871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f57c83-a849-46da-9250-c4ba175eb14f service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:56.486734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f57c83-a849-46da-9250-c4ba175eb14f service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:56.500369 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec4f64-6028-4724-af41-f4727a61f8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:56.503135 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec4f64-6028-4724-af41-f4727a61f8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:56.504305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1515914-9b55-4158-b34a-cbc7559e0bb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:56.504818 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec4f64-6028-4724-af41-f4727a61f8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:56.505905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec4f64-6028-4724-af41-f4727a61f8d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:56.506876 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec4f64-6028-4724-af41-f4727a61f8d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:24:56.508189 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec4f64-6028-4724-af41-f4727a61f8d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:56.508832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1515914-9b55-4158-b34a-cbc7559e0bb4 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:56.510814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec4f64-6028-4724-af41-f4727a61f8d5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:56.532750 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 862/1735] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:56.535468 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1515914-9b55-4158-b34a-cbc7559e0bb4 service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:56.540576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 874/1736] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:24:56.544826 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04ba7d-9e79-4347-b773-5c3d286c7948 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:56.555114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04ba7d-9e79-4347-b773-5c3d286c7948 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:56.556301 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04ba7d-9e79-4347-b773-5c3d286c7948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:56.567555 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1515914-9b55-4158-b34a-cbc7559e0bb4 service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:56.586431 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9be0d5-4454-4945-b807-493522e0c464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:56.587481 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9be0d5-4454-4945-b807-493522e0c464 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:56.587883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9be0d5-4454-4945-b807-493522e0c464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:56.590411 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9be0d5-4454-4945-b807-493522e0c464 admin admin] PATH_INFO: `/v3/projects/2ae50e5e3c5d4d5c99060a55b7c16233/users/fbb1d5d64cae48dcaaa9544ea813a5f2/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:56.594135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9be0d5-4454-4945-b807-493522e0c464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae50e5e3c5d4d5c99060a55b7c16233, user_id=fbb1d5d64cae48dcaaa9544ea813a5f2, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:56.600605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9be0d5-4454-4945-b807-493522e0c464 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:56.620355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3e04ba7d-9e79-4347-b773-5c3d286c7948 None None] MFA Rules not processed for user `72c228c1690a443fb59c65f4782a593f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:56.622737 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3e04ba7d-9e79-4347-b773-5c3d286c7948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:56.638808 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 863/1737] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:56 2022] PUT /identity/v3/projects/2ae50e5e3c5d4d5c99060a55b7c16233/users/fbb1d5d64cae48dcaaa9544ea813a5f2/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:56.641017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aecd7b-df92-408b-b9ed-08e8b253c9e1 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:56.644672 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aecd7b-df92-408b-b9ed-08e8b253c9e1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:56.647807 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aecd7b-df92-408b-b9ed-08e8b253c9e1 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:56.649868 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 864/1738] 10.222.0.18 () {54 vars in 912 bytes} [Wed Jul 20 19:24:56 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:24:56.651479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aecd7b-df92-408b-b9ed-08e8b253c9e1 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:56.861686 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 875/1739] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:56.864983 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04ba7d-9e79-4347-b773-5c3d286c7948 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:56.878715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aecd7b-df92-408b-b9ed-08e8b253c9e1 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:56.908690 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be735231-b6f2-4e5c-837d-14f2a18967b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:56.914024 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be735231-b6f2-4e5c-837d-14f2a18967b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:56.914370 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be735231-b6f2-4e5c-837d-14f2a18967b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:56.914931 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be735231-b6f2-4e5c-837d-14f2a18967b4 admin admin] PATH_INFO: `/v3/projects/f0dc932c71334e2e927638cb32bf6715/users/e70d3f6a32b6492296b794fa982d3026/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:56.927260 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04ba7d-9e79-4347-b773-5c3d286c7948 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:56.929787 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be735231-b6f2-4e5c-837d-14f2a18967b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0dc932c71334e2e927638cb32bf6715, user_id=e70d3f6a32b6492296b794fa982d3026, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:56.940164 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be735231-b6f2-4e5c-837d-14f2a18967b4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:56.950513 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb1abe-77eb-4a01-ade6-f9c159d2ae72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:56.951460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb1abe-77eb-4a01-ade6-f9c159d2ae72 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:56.951663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb1abe-77eb-4a01-ade6-f9c159d2ae72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:56.954700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb1abe-77eb-4a01-ade6-f9c159d2ae72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:56.955698 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb1abe-77eb-4a01-ade6-f9c159d2ae72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:56.967733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb1abe-77eb-4a01-ade6-f9c159d2ae72 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:57.009312 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 865/1740] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:56 2022] PUT /identity/v3/projects/f0dc932c71334e2e927638cb32bf6715/users/e70d3f6a32b6492296b794fa982d3026/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:57.009312 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277ec08-1027-4c84-87ae-f20881d91a4f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:57.009312 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277ec08-1027-4c84-87ae-f20881d91a4f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:57.009312 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277ec08-1027-4c84-87ae-f20881d91a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:57.070101 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 876/1741] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:56 2022] POST /identity/v3/projects => generated 403 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:57.070976 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667e2de-f335-498e-ada4-e96341fae5a4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:57.075591 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667e2de-f335-498e-ada4-e96341fae5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:57.078503 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667e2de-f335-498e-ada4-e96341fae5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:57.122950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a277ec08-1027-4c84-87ae-f20881d91a4f None None] MFA Rules not processed for user `fbb1d5d64cae48dcaaa9544ea813a5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:57.127016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a277ec08-1027-4c84-87ae-f20881d91a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:57.205111 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8667e2de-f335-498e-ada4-e96341fae5a4 None None] MFA Rules not processed for user `0c7b88e083d04718bf19d982724babd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:57.207353 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8667e2de-f335-498e-ada4-e96341fae5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:57.371429 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 866/1742] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:56 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:57.377774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277ec08-1027-4c84-87ae-f20881d91a4f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:57.390868 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 877/1743] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 20 19:24:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:57.394115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64826a-6c63-4a4a-8314-efe01fc30f0f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:57.395521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64826a-6c63-4a4a-8314-efe01fc30f0f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:57.395839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64826a-6c63-4a4a-8314-efe01fc30f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:57.411186 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:57.443736 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4b64826a-6c63-4a4a-8314-efe01fc30f0f None None] MFA Rules not processed for user `0c7b88e083d04718bf19d982724babd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:57.446639 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:57.448881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4b64826a-6c63-4a4a-8314-efe01fc30f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:57.472838 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 878/1744] 10.222.0.88 () {58 vars in 1015 bytes} [Wed Jul 20 19:24:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:57.478105 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb2145-0637-4c37-9167-e61f0b81b700 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:57.479095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb2145-0637-4c37-9167-e61f0b81b700 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:57.480295 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb2145-0637-4c37-9167-e61f0b81b700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:57.603328 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e1eb2145-0637-4c37-9167-e61f0b81b700 None None] MFA Rules not processed for user `e70d3f6a32b6492296b794fa982d3026`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:57.604735 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e1eb2145-0637-4c37-9167-e61f0b81b700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:57.607372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277ec08-1027-4c84-87ae-f20881d91a4f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:57.629953 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a62e9c-7815-4aaa-b8d3-c4a6f2b78363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:57.630674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a62e9c-7815-4aaa-b8d3-c4a6f2b78363 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:57.630985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a62e9c-7815-4aaa-b8d3-c4a6f2b78363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:57.631274 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a62e9c-7815-4aaa-b8d3-c4a6f2b78363 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:57.632069 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a62e9c-7815-4aaa-b8d3-c4a6f2b78363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:57.641811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a62e9c-7815-4aaa-b8d3-c4a6f2b78363 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:57.754785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 867/1745] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:24:57 2022] POST /identity/v3/projects => generated 367 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:57.756146 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a62e9c-7815-4aaa-b8d3-c4a6f2b78363 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:57.882439 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 879/1746] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:57.883414 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb2145-0637-4c37-9167-e61f0b81b700 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:57.885919 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e1eb2145-0637-4c37-9167-e61f0b81b700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:58.046379 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a62e9c-7815-4aaa-b8d3-c4a6f2b78363 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:58.071266 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb0dbd-30c5-4ebe-9159-a780b5a0b5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:58.071974 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb0dbd-30c5-4ebe-9159-a780b5a0b5ef admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:58.072267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb0dbd-30c5-4ebe-9159-a780b5a0b5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:58.072551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb0dbd-30c5-4ebe-9159-a780b5a0b5ef admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:58.073268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb0dbd-30c5-4ebe-9159-a780b5a0b5ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:58.084929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb0dbd-30c5-4ebe-9159-a780b5a0b5ef admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:58.116832 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb2145-0637-4c37-9167-e61f0b81b700 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:58.146148 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 868/1747] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:57 2022] POST /identity/v3/users => generated 302 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:58.146148 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb0dbd-30c5-4ebe-9159-a780b5a0b5ef admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:58.174056 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb0dbd-30c5-4ebe-9159-a780b5a0b5ef admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:58.188915 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30a384-9246-475a-b79c-d97c851ef82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:58.189729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30a384-9246-475a-b79c-d97c851ef82e admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:58.190418 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30a384-9246-475a-b79c-d97c851ef82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:58.190717 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30a384-9246-475a-b79c-d97c851ef82e admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:58.192465 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30a384-9246-475a-b79c-d97c851ef82e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:58.197890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30a384-9246-475a-b79c-d97c851ef82e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:58.254201 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 869/1748] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:24:58 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:24:58.258429 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30a384-9246-475a-b79c-d97c851ef82e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:58.264555 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0a30a384-9246-475a-b79c-d97c851ef82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:58.266551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e80a9-dfbc-4206-8a2f-0d80114ee967 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:58.267274 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e80a9-dfbc-4206-8a2f-0d80114ee967 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:58.267566 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e80a9-dfbc-4206-8a2f-0d80114ee967 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:58.268712 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e80a9-dfbc-4206-8a2f-0d80114ee967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:58.422086 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:58.434758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30a384-9246-475a-b79c-d97c851ef82e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:58.445662 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47548861-8e53-49f5-a245-ee8ed704561d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:58.446374 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47548861-8e53-49f5-a245-ee8ed704561d service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:58.446670 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47548861-8e53-49f5-a245-ee8ed704561d service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:58.446957 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47548861-8e53-49f5-a245-ee8ed704561d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:58.450159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e80a9-dfbc-4206-8a2f-0d80114ee967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:58.451779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e80a9-dfbc-4206-8a2f-0d80114ee967 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:58.465703 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47548861-8e53-49f5-a245-ee8ed704561d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:58.467312 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47548861-8e53-49f5-a245-ee8ed704561d service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:58.479366 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 880/1749] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:58.481546 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e80a9-dfbc-4206-8a2f-0d80114ee967 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:58.492500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 870/1750] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:58.493384 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47548861-8e53-49f5-a245-ee8ed704561d service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:58.497171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-47548861-8e53-49f5-a245-ee8ed704561d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:58.500755 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e80a9-dfbc-4206-8a2f-0d80114ee967 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:58.512210 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b9f9a-a207-4b74-b8e5-bcab6d284e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:58.512999 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b9f9a-a207-4b74-b8e5-bcab6d284e63 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:58.513306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b9f9a-a207-4b74-b8e5-bcab6d284e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:58.513651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b9f9a-a207-4b74-b8e5-bcab6d284e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:58.522161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47548861-8e53-49f5-a245-ee8ed704561d service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:58.533596 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b9f9a-a207-4b74-b8e5-bcab6d284e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:58.535374 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b9f9a-a207-4b74-b8e5-bcab6d284e63 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:58.536969 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb42a7-6111-44a4-95ea-83f5ace801aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:58.541142 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb42a7-6111-44a4-95ea-83f5ace801aa service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:58.541312 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb42a7-6111-44a4-95ea-83f5ace801aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:58.541542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb42a7-6111-44a4-95ea-83f5ace801aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:58.574754 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 881/1751] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:58.581866 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b9f9a-a207-4b74-b8e5-bcab6d284e63 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:58.604695 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:58.608915 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b9f9a-a207-4b74-b8e5-bcab6d284e63 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:58.620814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4061a-0f92-42c2-b897-655c0525c705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:58.621559 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4061a-0f92-42c2-b897-655c0525c705 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:58.621897 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4061a-0f92-42c2-b897-655c0525c705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:58.622237 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4061a-0f92-42c2-b897-655c0525c705 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:58.623097 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4061a-0f92-42c2-b897-655c0525c705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:58.628046 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4061a-0f92-42c2-b897-655c0525c705 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:58.655153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 882/1752] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:58.657959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4061a-0f92-42c2-b897-655c0525c705 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:58.691829 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4061a-0f92-42c2-b897-655c0525c705 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:58.711001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe248e75-cc21-40ec-a15e-345c6fa33721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:58.711744 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe248e75-cc21-40ec-a15e-345c6fa33721 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:58.712034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe248e75-cc21-40ec-a15e-345c6fa33721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:58.712319 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe248e75-cc21-40ec-a15e-345c6fa33721 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:58.713070 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe248e75-cc21-40ec-a15e-345c6fa33721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:58.714746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe248e75-cc21-40ec-a15e-345c6fa33721 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:58.724832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb42a7-6111-44a4-95ea-83f5ace801aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:58.726447 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb42a7-6111-44a4-95ea-83f5ace801aa service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:58.741928 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 883/1753] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:58.751906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe248e75-cc21-40ec-a15e-345c6fa33721 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:58.767177 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 871/1754] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:58.768139 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb42a7-6111-44a4-95ea-83f5ace801aa service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:58.795857 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe248e75-cc21-40ec-a15e-345c6fa33721 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:58.804386 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb42a7-6111-44a4-95ea-83f5ace801aa service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:58.811424 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5a1f4-3f18-4cee-a17a-b7733e0e0c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:58.812677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5a1f4-3f18-4cee-a17a-b7733e0e0c66 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:58.812993 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5a1f4-3f18-4cee-a17a-b7733e0e0c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:58.818799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66342fb-2966-4bb3-a735-ecd38eac96ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:58.819014 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5a1f4-3f18-4cee-a17a-b7733e0e0c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:58.819581 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5a1f4-3f18-4cee-a17a-b7733e0e0c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:58.821362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5a1f4-3f18-4cee-a17a-b7733e0e0c66 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:58.823687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66342fb-2966-4bb3-a735-ecd38eac96ce service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:58.824194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66342fb-2966-4bb3-a735-ecd38eac96ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:58.824514 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66342fb-2966-4bb3-a735-ecd38eac96ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:58.829818 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b66342fb-2966-4bb3-a735-ecd38eac96ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:58.854429 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 884/1755] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:58.855502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5a1f4-3f18-4cee-a17a-b7733e0e0c66 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:58.879975 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5a1f4-3f18-4cee-a17a-b7733e0e0c66 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:58.894815 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11d215-c731-4896-a037-44045dd5be89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:58.896017 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11d215-c731-4896-a037-44045dd5be89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:58.896584 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11d215-c731-4896-a037-44045dd5be89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:58.896584 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11d215-c731-4896-a037-44045dd5be89 admin admin] PATH_INFO: `/v3/projects/1d2367fc17614cc297a3c7c5677eae1e/users/b6ad2f1fbdb54531b5def70b7f76ae57/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:58.939486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11d215-c731-4896-a037-44045dd5be89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d2367fc17614cc297a3c7c5677eae1e, user_id=b6ad2f1fbdb54531b5def70b7f76ae57, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:58.946998 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11d215-c731-4896-a037-44045dd5be89 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:58.980839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 885/1756] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:58 2022] PUT /identity/v3/projects/1d2367fc17614cc297a3c7c5677eae1e/users/b6ad2f1fbdb54531b5def70b7f76ae57/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:58.982365 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11d215-c731-4896-a037-44045dd5be89 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:58.997320 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66342fb-2966-4bb3-a735-ecd38eac96ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:59.000133 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66342fb-2966-4bb3-a735-ecd38eac96ce service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:59.027667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 872/1757] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:24:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:24:59.028735 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66342fb-2966-4bb3-a735-ecd38eac96ce service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:59.057404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66342fb-2966-4bb3-a735-ecd38eac96ce service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:59.154826 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11d215-c731-4896-a037-44045dd5be89 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:59.172744 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95f2d6-8090-4640-9d2f-4f0fc29f5be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:59.174017 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95f2d6-8090-4640-9d2f-4f0fc29f5be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:59.178830 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95f2d6-8090-4640-9d2f-4f0fc29f5be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:59.180650 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95f2d6-8090-4640-9d2f-4f0fc29f5be1 admin admin] PATH_INFO: `/v3/projects/6ad8259190c1485186cba1a691f5eedc/users/a4d5570ada2a48eb85ed560248de38d4/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:59.268204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95f2d6-8090-4640-9d2f-4f0fc29f5be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ad8259190c1485186cba1a691f5eedc, user_id=a4d5570ada2a48eb85ed560248de38d4, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:59.287600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95f2d6-8090-4640-9d2f-4f0fc29f5be1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:59.302048 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c3d0d-da21-450f-ac2b-bc46e5f26680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:59.307787 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c3d0d-da21-450f-ac2b-bc46e5f26680 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:59.309342 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c3d0d-da21-450f-ac2b-bc46e5f26680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:59.310816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c3d0d-da21-450f-ac2b-bc46e5f26680 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:59.312721 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c3d0d-da21-450f-ac2b-bc46e5f26680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:59.322354 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c3d0d-da21-450f-ac2b-bc46e5f26680 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:59.356989 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 886/1758] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:58 2022] PUT /identity/v3/projects/6ad8259190c1485186cba1a691f5eedc/users/a4d5570ada2a48eb85ed560248de38d4/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:59.366619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9dce6-7b50-4b5f-940f-0290e1044401 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:59.366967 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9dce6-7b50-4b5f-940f-0290e1044401 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:59.367247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9dce6-7b50-4b5f-940f-0290e1044401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:59.379773 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 873/1759] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:24:59.381169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c3d0d-da21-450f-ac2b-bc46e5f26680 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:24:59.420029 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c3d0d-da21-450f-ac2b-bc46e5f26680 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:24:59.472337 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6ad9dce6-7b50-4b5f-940f-0290e1044401 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:59.498830 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6ad9dce6-7b50-4b5f-940f-0290e1044401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:59.608332 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:59.635764 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20dd06-02b9-4bcc-9feb-37569939e665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:24:59.638245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20dd06-02b9-4bcc-9feb-37569939e665 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:59.639688 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20dd06-02b9-4bcc-9feb-37569939e665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:59.641860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20dd06-02b9-4bcc-9feb-37569939e665 admin admin] PATH_INFO: `/v3/projects/1d2367fc17614cc297a3c7c5677eae1e/users/b6ad2f1fbdb54531b5def70b7f76ae57/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:59.646872 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20dd06-02b9-4bcc-9feb-37569939e665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d2367fc17614cc297a3c7c5677eae1e, user_id=b6ad2f1fbdb54531b5def70b7f76ae57, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:24:59.658656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20dd06-02b9-4bcc-9feb-37569939e665 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:24:59.703237 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 874/1760] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:24:59 2022] PUT /identity/v3/projects/1d2367fc17614cc297a3c7c5677eae1e/users/b6ad2f1fbdb54531b5def70b7f76ae57/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:24:59.706463 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bed6fd-6439-4fba-a39a-8a1a10b8a385 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:24:59.709882 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bed6fd-6439-4fba-a39a-8a1a10b8a385 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:24:59.711115 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bed6fd-6439-4fba-a39a-8a1a10b8a385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:24:59.759375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:24:59.789644 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 887/1761] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:24:59.801361 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f7bed6fd-6439-4fba-a39a-8a1a10b8a385 None None] MFA Rules not processed for user `b6ad2f1fbdb54531b5def70b7f76ae57`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:24:59.804993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f7bed6fd-6439-4fba-a39a-8a1a10b8a385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:24:59.889698 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9dce6-7b50-4b5f-940f-0290e1044401 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:00.025666 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 875/1762] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:24:59 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:00.029522 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bed6fd-6439-4fba-a39a-8a1a10b8a385 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:00.034460 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f7bed6fd-6439-4fba-a39a-8a1a10b8a385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:00.219857 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9dce6-7b50-4b5f-940f-0290e1044401 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:00.320405 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bed6fd-6439-4fba-a39a-8a1a10b8a385 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:00.331524 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31512bcd-7a66-4765-a1c7-94ff3994f3fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:00.332268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31512bcd-7a66-4765-a1c7-94ff3994f3fe service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:00.332559 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31512bcd-7a66-4765-a1c7-94ff3994f3fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:00.334524 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31512bcd-7a66-4765-a1c7-94ff3994f3fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:00.451112 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd8cf4-fa64-4e0a-a26c-c8174492016b tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70d3f6a32b6492296b794fa982d3026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0dc932c71334e2e927638cb32bf6715', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:00.454711 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd8cf4-fa64-4e0a-a26c-c8174492016b tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:00.455147 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd8cf4-fa64-4e0a-a26c-c8174492016b tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:00.457462 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd8cf4-fa64-4e0a-a26c-c8174492016b tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:00.460380 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd8cf4-fa64-4e0a-a26c-c8174492016b tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:00.464945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd8cf4-fa64-4e0a-a26c-c8174492016b tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:00.474535 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd8cf4-fa64-4e0a-a26c-c8174492016b tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:00.529740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 888/1763] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 641 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:25:00.537809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd8cf4-fa64-4e0a-a26c-c8174492016b tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:00.610195 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31512bcd-7a66-4765-a1c7-94ff3994f3fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:00.611517 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31512bcd-7a66-4765-a1c7-94ff3994f3fe service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:00.681280 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 876/1764] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:00.682176 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31512bcd-7a66-4765-a1c7-94ff3994f3fe service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:00.746236 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31512bcd-7a66-4765-a1c7-94ff3994f3fe service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:00.767482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d4ff0-928d-495a-a347-0a80a5ddca62 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70d3f6a32b6492296b794fa982d3026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0dc932c71334e2e927638cb32bf6715', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:00.769873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d4ff0-928d-495a-a347-0a80a5ddca62 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:00.773523 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d4ff0-928d-495a-a347-0a80a5ddca62 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:00.773879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d4ff0-928d-495a-a347-0a80a5ddca62 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:00.774666 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d4ff0-928d-495a-a347-0a80a5ddca62 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:00.776641 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d4ff0-928d-495a-a347-0a80a5ddca62 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:00.812432 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd8cf4-fa64-4e0a-a26c-c8174492016b tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:00.824525 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a7dd0-580c-4fd8-bfcc-0dfc4313ecdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:00.826029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a7dd0-580c-4fd8-bfcc-0dfc4313ecdc service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:00.828091 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a7dd0-580c-4fd8-bfcc-0dfc4313ecdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:00.830753 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a7dd0-580c-4fd8-bfcc-0dfc4313ecdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:00.883389 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a7dd0-580c-4fd8-bfcc-0dfc4313ecdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:00.891950 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a7dd0-580c-4fd8-bfcc-0dfc4313ecdc service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:00.904716 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:00.929976 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 877/1765] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:00 2022] POST /identity/v3/projects => generated 353 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:00.932831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d4ff0-928d-495a-a347-0a80a5ddca62 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:00.948480 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 889/1766] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:00 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:01.268491 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d4ff0-928d-495a-a347-0a80a5ddca62 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:01.300670 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83392ecb-2a8b-4001-9c96-7c48edb519c9 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70d3f6a32b6492296b794fa982d3026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0dc932c71334e2e927638cb32bf6715', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:01.304237 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83392ecb-2a8b-4001-9c96-7c48edb519c9 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:01.307830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83392ecb-2a8b-4001-9c96-7c48edb519c9 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:01.310693 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83392ecb-2a8b-4001-9c96-7c48edb519c9 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:01.312478 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83392ecb-2a8b-4001-9c96-7c48edb519c9 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:01.319306 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83392ecb-2a8b-4001-9c96-7c48edb519c9 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:01.325853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83392ecb-2a8b-4001-9c96-7c48edb519c9 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:01.391840 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 878/1767] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:01.601980 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a7dd0-580c-4fd8-bfcc-0dfc4313ecdc service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:01.638796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a7dd0-580c-4fd8-bfcc-0dfc4313ecdc service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:01.668594 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd9dd1-9765-4992-949f-2e8f8e297931 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70d3f6a32b6492296b794fa982d3026', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f0dc932c71334e2e927638cb32bf6715', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:01.672229 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd9dd1-9765-4992-949f-2e8f8e297931 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:01.678893 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd9dd1-9765-4992-949f-2e8f8e297931 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:01.683354 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd9dd1-9765-4992-949f-2e8f8e297931 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] PATH_INFO: `/v3/projects/20d0cd2205ce400cbee08450a63723de` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:01.697477 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd9dd1-9765-4992-949f-2e8f8e297931 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] RBAC: Authorizing `identity:delete_project(project_id=20d0cd2205ce400cbee08450a63723de)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:01.708936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd9dd1-9765-4992-949f-2e8f8e297931 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:01.963823 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:02.018093 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d4dd9dd1-9765-4992-949f-2e8f8e297931 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20d0cd2205ce400cbee08450a63723de', 'request_id': 'req-d4dd9dd1-9765-4992-949f-2e8f8e297931'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:02.047984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d4dd9dd1-9765-4992-949f-2e8f8e297931 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20d0cd2205ce400cbee08450a63723de', 'request_id': 'req-d4dd9dd1-9765-4992-949f-2e8f8e297931'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:02.082049 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d4dd9dd1-9765-4992-949f-2e8f8e297931 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20d0cd2205ce400cbee08450a63723de', 'request_id': 'req-d4dd9dd1-9765-4992-949f-2e8f8e297931'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:02.228765 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d4dd9dd1-9765-4992-949f-2e8f8e297931 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] The token cache is being invalidate because project 20d0cd2205ce400cbee08450a63723de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:02.236549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d4dd9dd1-9765-4992-949f-2e8f8e297931 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:02.241082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d4dd9dd1-9765-4992-949f-2e8f8e297931 tempest-VolumeQuotaClassesTest-974254903 tempest-VolumeQuotaClassesTest-974254903-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:02.247674 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 890/1768] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:01 2022] DELETE /identity/v3/projects/20d0cd2205ce400cbee08450a63723de => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:02.460094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a410938-78a5-4238-8d19-525f13f3fa80 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:02.461327 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a410938-78a5-4238-8d19-525f13f3fa80 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:02.461616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a410938-78a5-4238-8d19-525f13f3fa80 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:02.463487 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 879/1769] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 20 19:25:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:25:02.599652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c2866-55f2-40cf-a840-fe6406fdd940 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:02.600051 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c2866-55f2-40cf-a840-fe6406fdd940 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:02.600479 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c2866-55f2-40cf-a840-fe6406fdd940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:02.691268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-219c2866-55f2-40cf-a840-fe6406fdd940 None None] MFA Rules not processed for user `a1f0f6bc94de4645a8c82038ff2bd34a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:02.712733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-219c2866-55f2-40cf-a840-fe6406fdd940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:03.098595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41303f3-314c-4804-8cdb-cd3024edb8c1 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:03.098976 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41303f3-314c-4804-8cdb-cd3024edb8c1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:03.099453 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41303f3-314c-4804-8cdb-cd3024edb8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:03.174344 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d41303f3-314c-4804-8cdb-cd3024edb8c1 None None] MFA Rules not processed for user `4eaf9d8ee17e45c99c415e80e72ef868`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:03.175461 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d41303f3-314c-4804-8cdb-cd3024edb8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:03.264063 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 891/1770] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 20 19:25:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 666 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:03.265545 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c2866-55f2-40cf-a840-fe6406fdd940 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:03.269597 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-219c2866-55f2-40cf-a840-fe6406fdd940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:03.404354 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 880/1771] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:03.518721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c2866-55f2-40cf-a840-fe6406fdd940 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:03.533021 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3a2a9-591f-46c0-bec2-d6cbde379f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:03.533996 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3a2a9-591f-46c0-bec2-d6cbde379f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:03.534293 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3a2a9-591f-46c0-bec2-d6cbde379f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:03.534641 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3a2a9-591f-46c0-bec2-d6cbde379f9c admin admin] PATH_INFO: `/v3/users/f456a14b243d4979b951229d695605e1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:03.539060 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3a2a9-591f-46c0-bec2-d6cbde379f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f456a14b243d4979b951229d695605e1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:03.541063 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3a2a9-591f-46c0-bec2-d6cbde379f9c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:03.664882 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-adb3a2a9-591f-46c0-bec2-d6cbde379f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f456a14b243d4979b951229d695605e1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:03.685292 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-adb3a2a9-591f-46c0-bec2-d6cbde379f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f456a14b243d4979b951229d695605e1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:03.694953 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:03.732318 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-adb3a2a9-591f-46c0-bec2-d6cbde379f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f456a14b243d4979b951229d695605e1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:03.786719 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050e795-1e9e-4ec8-b5c2-56ef25ffb039 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:03.787214 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050e795-1e9e-4ec8-b5c2-56ef25ffb039 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:03.787557 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050e795-1e9e-4ec8-b5c2-56ef25ffb039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:03.800546 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-adb3a2a9-591f-46c0-bec2-d6cbde379f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f456a14b243d4979b951229d695605e1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:03.804860 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-adb3a2a9-591f-46c0-bec2-d6cbde379f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f456a14b243d4979b951229d695605e1'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:03.841315 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 892/1772] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:03 2022] DELETE /identity/v3/users/f456a14b243d4979b951229d695605e1 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:03.845769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489916a-4511-496b-bbbb-df221264a649 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:03.850544 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489916a-4511-496b-bbbb-df221264a649 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:03.851763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7050e795-1e9e-4ec8-b5c2-56ef25ffb039 None None] MFA Rules not processed for user `551a91b131bc4a16a40b865a0a3fb50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:03.852655 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489916a-4511-496b-bbbb-df221264a649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:03.858779 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7050e795-1e9e-4ec8-b5c2-56ef25ffb039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:03.939221 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a489916a-4511-496b-bbbb-df221264a649 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:03.944613 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a489916a-4511-496b-bbbb-df221264a649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:04.145693 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 881/1773] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:04.147267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fed9a-1ebc-43ed-b4fa-3c6b5efdef10 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:04.155763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fed9a-1ebc-43ed-b4fa-3c6b5efdef10 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:04.158677 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fed9a-1ebc-43ed-b4fa-3c6b5efdef10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:04.215637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 893/1774] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:04.228108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489916a-4511-496b-bbbb-df221264a649 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:04.229818 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a489916a-4511-496b-bbbb-df221264a649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:04.275822 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-151fed9a-1ebc-43ed-b4fa-3c6b5efdef10 None None] MFA Rules not processed for user `a4d5570ada2a48eb85ed560248de38d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:04.275822 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-151fed9a-1ebc-43ed-b4fa-3c6b5efdef10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:04.416679 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:04.454029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489916a-4511-496b-bbbb-df221264a649 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:04.457035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb972a1-41f1-4678-8776-92586313edaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:04.457622 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb972a1-41f1-4678-8776-92586313edaf service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:04.457914 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb972a1-41f1-4678-8776-92586313edaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:04.459951 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb972a1-41f1-4678-8776-92586313edaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:04.473565 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb972a1-41f1-4678-8776-92586313edaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:04.475194 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb972a1-41f1-4678-8776-92586313edaf service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:04.496200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 894/1775] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:04.568308 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 882/1776] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:04.572334 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb972a1-41f1-4678-8776-92586313edaf service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:04.575979 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3bb972a1-41f1-4678-8776-92586313edaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:04.604802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb972a1-41f1-4678-8776-92586313edaf service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:04.616858 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8da23-1c3d-4996-ae9d-d46b2081be07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:04.616858 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8da23-1c3d-4996-ae9d-d46b2081be07 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:04.616858 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8da23-1c3d-4996-ae9d-d46b2081be07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:04.616858 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8da23-1c3d-4996-ae9d-d46b2081be07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:04.618111 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8da23-1c3d-4996-ae9d-d46b2081be07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:04.622119 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8da23-1c3d-4996-ae9d-d46b2081be07 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:04.751033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 895/1777] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:04 2022] POST /identity/v3/projects => generated 403 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:04.755392 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fed9a-1ebc-43ed-b4fa-3c6b5efdef10 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:04.775127 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8da23-1c3d-4996-ae9d-d46b2081be07 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:04.779537 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f7e8da23-1c3d-4996-ae9d-d46b2081be07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:04.790844 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fed9a-1ebc-43ed-b4fa-3c6b5efdef10 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:05.064560 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:05.112926 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbc224-d332-4e3f-a0f1-843ab7a6e661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:05.113630 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbc224-d332-4e3f-a0f1-843ab7a6e661 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:05.113950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbc224-d332-4e3f-a0f1-843ab7a6e661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:05.114248 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccbc224-d332-4e3f-a0f1-843ab7a6e661 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:05.115041 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccbc224-d332-4e3f-a0f1-843ab7a6e661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:05.117105 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccbc224-d332-4e3f-a0f1-843ab7a6e661 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:05.135878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8da23-1c3d-4996-ae9d-d46b2081be07 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:05.158798 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc774355-957f-43f4-b218-6781614b85ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:05.159511 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc774355-957f-43f4-b218-6781614b85ed service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:05.159878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc774355-957f-43f4-b218-6781614b85ed service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:05.160196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc774355-957f-43f4-b218-6781614b85ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:05.167309 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fc774355-957f-43f4-b218-6781614b85ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:05.204794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 883/1778] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:04 2022] POST /identity/v3/users => generated 308 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:05.209197 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbc224-d332-4e3f-a0f1-843ab7a6e661 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:05.240364 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccbc224-d332-4e3f-a0f1-843ab7a6e661 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:05.248134 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc774355-957f-43f4-b218-6781614b85ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:05.248134 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc774355-957f-43f4-b218-6781614b85ed service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:05.260418 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c10a2-532f-42cf-8088-25a700548d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:05.262808 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c10a2-532f-42cf-8088-25a700548d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:05.263593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c10a2-532f-42cf-8088-25a700548d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:05.265305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c10a2-532f-42cf-8088-25a700548d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:05.269344 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c10a2-532f-42cf-8088-25a700548d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:05.277226 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c10a2-532f-42cf-8088-25a700548d07 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:05.322846 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 884/1779] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:05.324019 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c10a2-532f-42cf-8088-25a700548d07 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:05.344121 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 896/1780] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:05.373182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c10a2-532f-42cf-8088-25a700548d07 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:05.391256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1d53f-dcc5-4312-bb79-adb7fa0d8b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:05.396753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1d53f-dcc5-4312-bb79-adb7fa0d8b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:05.402815 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1d53f-dcc5-4312-bb79-adb7fa0d8b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:05.403467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1d53f-dcc5-4312-bb79-adb7fa0d8b1c admin admin] PATH_INFO: `/v3/projects/9f69042daf9e42e69fc15f10e91de065/users/f622b567cef040d8a8b83b5d51d64c39/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:05.482842 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1d53f-dcc5-4312-bb79-adb7fa0d8b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f69042daf9e42e69fc15f10e91de065, user_id=f622b567cef040d8a8b83b5d51d64c39, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:05.489948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf1d53f-dcc5-4312-bb79-adb7fa0d8b1c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:05.579806 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 885/1781] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:05 2022] PUT /identity/v3/projects/9f69042daf9e42e69fc15f10e91de065/users/f622b567cef040d8a8b83b5d51d64c39/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:05.583928 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc774355-957f-43f4-b218-6781614b85ed service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:05.601651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc774355-957f-43f4-b218-6781614b85ed service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:05.895426 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1d53f-dcc5-4312-bb79-adb7fa0d8b1c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:05.897166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9cf1d53f-dcc5-4312-bb79-adb7fa0d8b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:05.899864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdd1a2-b172-482c-8a99-5f7f08e10dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:05.901294 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdd1a2-b172-482c-8a99-5f7f08e10dbb admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:05.901294 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdd1a2-b172-482c-8a99-5f7f08e10dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:05.901294 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdd1a2-b172-482c-8a99-5f7f08e10dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:05.901814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdd1a2-b172-482c-8a99-5f7f08e10dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:05.906868 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdd1a2-b172-482c-8a99-5f7f08e10dbb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:05.920601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1d53f-dcc5-4312-bb79-adb7fa0d8b1c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:05.927835 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09604b3c-26f1-4ac5-b838-8d725afb77d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:05.929882 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09604b3c-26f1-4ac5-b838-8d725afb77d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:05.930382 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09604b3c-26f1-4ac5-b838-8d725afb77d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:05.930934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09604b3c-26f1-4ac5-b838-8d725afb77d1 admin admin] PATH_INFO: `/v3/users/72c228c1690a443fb59c65f4782a593f` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:05.934029 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09604b3c-26f1-4ac5-b838-8d725afb77d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72c228c1690a443fb59c65f4782a593f)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:05.936551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09604b3c-26f1-4ac5-b838-8d725afb77d1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:05.977468 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 897/1782] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:05.978293 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdd1a2-b172-482c-8a99-5f7f08e10dbb admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:06.015175 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdd1a2-b172-482c-8a99-5f7f08e10dbb admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:06.035936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39f4e2-4963-4dbc-87b2-241bade0c48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:06.037267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39f4e2-4963-4dbc-87b2-241bade0c48f admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:06.037558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39f4e2-4963-4dbc-87b2-241bade0c48f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:06.037878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39f4e2-4963-4dbc-87b2-241bade0c48f admin admin] PATH_INFO: `/v3/projects/9f69042daf9e42e69fc15f10e91de065/users/f622b567cef040d8a8b83b5d51d64c39/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:06.046695 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39f4e2-4963-4dbc-87b2-241bade0c48f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f69042daf9e42e69fc15f10e91de065, user_id=f622b567cef040d8a8b83b5d51d64c39, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:06.050118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39f4e2-4963-4dbc-87b2-241bade0c48f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:06.083553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-09604b3c-26f1-4ac5-b838-8d725afb77d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72c228c1690a443fb59c65f4782a593f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:06.085396 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 898/1783] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:05 2022] PUT /identity/v3/projects/9f69042daf9e42e69fc15f10e91de065/users/f622b567cef040d8a8b83b5d51d64c39/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:06.125112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-09604b3c-26f1-4ac5-b838-8d725afb77d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72c228c1690a443fb59c65f4782a593f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:06.149251 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-09604b3c-26f1-4ac5-b838-8d725afb77d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72c228c1690a443fb59c65f4782a593f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:06.150979 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-09604b3c-26f1-4ac5-b838-8d725afb77d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72c228c1690a443fb59c65f4782a593f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:06.153156 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39f4e2-4963-4dbc-87b2-241bade0c48f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:06.154933 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bd39f4e2-4963-4dbc-87b2-241bade0c48f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:06.166867 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-09604b3c-26f1-4ac5-b838-8d725afb77d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72c228c1690a443fb59c65f4782a593f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:06.234132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:06.272742 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 886/1784] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:05 2022] DELETE /identity/v3/users/72c228c1690a443fb59c65f4782a593f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:06.277176 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca6777-c547-458f-9d94-04f4f0212864 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:06.277762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca6777-c547-458f-9d94-04f4f0212864 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:06.278245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca6777-c547-458f-9d94-04f4f0212864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:06.326916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-10ca6777-c547-458f-9d94-04f4f0212864 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:06.330598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-10ca6777-c547-458f-9d94-04f4f0212864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:06.392916 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39f4e2-4963-4dbc-87b2-241bade0c48f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:06.569595 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560caa0-d21c-4697-b27a-0f41aeb8baf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:06.574561 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560caa0-d21c-4697-b27a-0f41aeb8baf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:06.574561 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560caa0-d21c-4697-b27a-0f41aeb8baf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:06.577288 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560caa0-d21c-4697-b27a-0f41aeb8baf6 admin admin] PATH_INFO: `/v3/projects/5997d6d2766f443d9dd0519a880a64de` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:06.583368 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560caa0-d21c-4697-b27a-0f41aeb8baf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5997d6d2766f443d9dd0519a880a64de)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:06.584329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560caa0-d21c-4697-b27a-0f41aeb8baf6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:06.585694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 887/1785] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:06.597217 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca6777-c547-458f-9d94-04f4f0212864 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:06.598831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-10ca6777-c547-458f-9d94-04f4f0212864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:06.655430 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:06.819695 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5560caa0-d21c-4697-b27a-0f41aeb8baf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5997d6d2766f443d9dd0519a880a64de', 'request_id': 'req-5560caa0-d21c-4697-b27a-0f41aeb8baf6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:06.841297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5560caa0-d21c-4697-b27a-0f41aeb8baf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5997d6d2766f443d9dd0519a880a64de', 'request_id': 'req-5560caa0-d21c-4697-b27a-0f41aeb8baf6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:06.853078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca6777-c547-458f-9d94-04f4f0212864 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:06.858484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5560caa0-d21c-4697-b27a-0f41aeb8baf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5997d6d2766f443d9dd0519a880a64de', 'request_id': 'req-5560caa0-d21c-4697-b27a-0f41aeb8baf6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:06.878854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5560caa0-d21c-4697-b27a-0f41aeb8baf6 admin admin] The token cache is being invalidate because project 5997d6d2766f443d9dd0519a880a64de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:06.880164 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5560caa0-d21c-4697-b27a-0f41aeb8baf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:06.882679 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5560caa0-d21c-4697-b27a-0f41aeb8baf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:06.887603 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 899/1786] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:06 2022] DELETE /identity/v3/projects/5997d6d2766f443d9dd0519a880a64de => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:06.892394 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560caa0-d21c-4697-b27a-0f41aeb8baf6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:06.895754 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5560caa0-d21c-4697-b27a-0f41aeb8baf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:07.001691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d8de4-a09b-4447-a2e9-3585b82637f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:07.004885 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d8de4-a09b-4447-a2e9-3585b82637f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:07.006191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d8de4-a09b-4447-a2e9-3585b82637f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:07.006726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d8de4-a09b-4447-a2e9-3585b82637f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:07.033140 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-176d8de4-a09b-4447-a2e9-3585b82637f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:07.188323 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560caa0-d21c-4697-b27a-0f41aeb8baf6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:07.208219 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd59867-b67e-4e48-8dea-1a2ba5394da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:07.209279 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd59867-b67e-4e48-8dea-1a2ba5394da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:07.209498 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd59867-b67e-4e48-8dea-1a2ba5394da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:07.209774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd59867-b67e-4e48-8dea-1a2ba5394da8 admin admin] PATH_INFO: `/v3/users/e70d3f6a32b6492296b794fa982d3026` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:07.218645 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd59867-b67e-4e48-8dea-1a2ba5394da8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e70d3f6a32b6492296b794fa982d3026)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:07.220645 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd59867-b67e-4e48-8dea-1a2ba5394da8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:07.298965 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d8de4-a09b-4447-a2e9-3585b82637f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:07.301075 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d8de4-a09b-4447-a2e9-3585b82637f7 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:07.322694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 888/1787] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 726 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:07.334535 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fdd59867-b67e-4e48-8dea-1a2ba5394da8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e70d3f6a32b6492296b794fa982d3026'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:07.357098 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fdd59867-b67e-4e48-8dea-1a2ba5394da8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e70d3f6a32b6492296b794fa982d3026'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:07.385732 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fdd59867-b67e-4e48-8dea-1a2ba5394da8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e70d3f6a32b6492296b794fa982d3026'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:07.400968 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fdd59867-b67e-4e48-8dea-1a2ba5394da8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e70d3f6a32b6492296b794fa982d3026'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:07.402700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fdd59867-b67e-4e48-8dea-1a2ba5394da8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e70d3f6a32b6492296b794fa982d3026'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:07.423965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 900/1788] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:06 2022] DELETE /identity/v3/users/e70d3f6a32b6492296b794fa982d3026 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:10.162665 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d8de4-a09b-4447-a2e9-3585b82637f7 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:10.165163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-176d8de4-a09b-4447-a2e9-3585b82637f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:10.187803 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:10.212707 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d8de4-a09b-4447-a2e9-3585b82637f7 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:10.521219 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb62581-707a-4cf5-84d2-9041150e987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:10.522127 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb62581-707a-4cf5-84d2-9041150e987b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:10.522437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb62581-707a-4cf5-84d2-9041150e987b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:10.522777 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb62581-707a-4cf5-84d2-9041150e987b admin admin] PATH_INFO: `/v3/users/6b2dad91f67a4405b97336eb0239fbb5` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:10.524045 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb62581-707a-4cf5-84d2-9041150e987b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b2dad91f67a4405b97336eb0239fbb5)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:10.526023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb62581-707a-4cf5-84d2-9041150e987b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:10.738868 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-efb62581-707a-4cf5-84d2-9041150e987b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b2dad91f67a4405b97336eb0239fbb5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:10.761376 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-efb62581-707a-4cf5-84d2-9041150e987b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b2dad91f67a4405b97336eb0239fbb5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:10.802685 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-efb62581-707a-4cf5-84d2-9041150e987b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b2dad91f67a4405b97336eb0239fbb5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:10.803568 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-efb62581-707a-4cf5-84d2-9041150e987b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b2dad91f67a4405b97336eb0239fbb5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:10.805457 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-efb62581-707a-4cf5-84d2-9041150e987b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b2dad91f67a4405b97336eb0239fbb5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:10.864506 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 889/1789] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:10 2022] DELETE /identity/v3/users/6b2dad91f67a4405b97336eb0239fbb5 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:10.875883 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2175afd-d74c-44b1-81e4-5e2a5d5acfb6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:10.876941 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2175afd-d74c-44b1-81e4-5e2a5d5acfb6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:10.877379 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2175afd-d74c-44b1-81e4-5e2a5d5acfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:10.927136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c2175afd-d74c-44b1-81e4-5e2a5d5acfb6 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:10.928672 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c2175afd-d74c-44b1-81e4-5e2a5d5acfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:10.978142 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:11.113292 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 901/1790] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:11.191914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb62581-707a-4cf5-84d2-9041150e987b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:11.193638 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-efb62581-707a-4cf5-84d2-9041150e987b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:11.486136 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb62581-707a-4cf5-84d2-9041150e987b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:11.503931 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f3442-f419-488d-96b4-67e22bf7e9a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:11.504685 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f3442-f419-488d-96b4-67e22bf7e9a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:11.505003 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f3442-f419-488d-96b4-67e22bf7e9a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:11.505383 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f3442-f419-488d-96b4-67e22bf7e9a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:11.575746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f3442-f419-488d-96b4-67e22bf7e9a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:11.586895 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f3442-f419-488d-96b4-67e22bf7e9a1 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:11.635973 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 890/1791] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:11.736621 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2175afd-d74c-44b1-81e4-5e2a5d5acfb6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:11.738382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c2175afd-d74c-44b1-81e4-5e2a5d5acfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:11.760379 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2175afd-d74c-44b1-81e4-5e2a5d5acfb6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:11.774677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3157516-06b9-4465-bad5-9125a1f62d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:11.775658 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3157516-06b9-4465-bad5-9125a1f62d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:11.775947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3157516-06b9-4465-bad5-9125a1f62d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:11.776406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3157516-06b9-4465-bad5-9125a1f62d84 admin admin] PATH_INFO: `/v3/projects/f0dc932c71334e2e927638cb32bf6715` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:11.778201 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3157516-06b9-4465-bad5-9125a1f62d84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0dc932c71334e2e927638cb32bf6715)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:11.780500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3157516-06b9-4465-bad5-9125a1f62d84 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:11.853220 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f3442-f419-488d-96b4-67e22bf7e9a1 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:11.855401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6d9f3442-f419-488d-96b4-67e22bf7e9a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:11.894769 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f3442-f419-488d-96b4-67e22bf7e9a1 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:11.917278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a3157516-06b9-4465-bad5-9125a1f62d84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0dc932c71334e2e927638cb32bf6715', 'request_id': 'req-a3157516-06b9-4465-bad5-9125a1f62d84'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:11.938898 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a3157516-06b9-4465-bad5-9125a1f62d84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0dc932c71334e2e927638cb32bf6715', 'request_id': 'req-a3157516-06b9-4465-bad5-9125a1f62d84'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:11.974652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a3157516-06b9-4465-bad5-9125a1f62d84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0dc932c71334e2e927638cb32bf6715', 'request_id': 'req-a3157516-06b9-4465-bad5-9125a1f62d84'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:11.980311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:12.005481 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a3157516-06b9-4465-bad5-9125a1f62d84 admin admin] The token cache is being invalidate because project f0dc932c71334e2e927638cb32bf6715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:12.005730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a3157516-06b9-4465-bad5-9125a1f62d84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:12.012053 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a3157516-06b9-4465-bad5-9125a1f62d84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:12.015055 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 902/1792] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:11 2022] DELETE /identity/v3/projects/f0dc932c71334e2e927638cb32bf6715 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:12.022159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ad0d7-22c8-40f0-94e8-27e2f79a4348 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:12.022522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ad0d7-22c8-40f0-94e8-27e2f79a4348 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:12.022818 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ad0d7-22c8-40f0-94e8-27e2f79a4348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:12.088149 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-806ad0d7-22c8-40f0-94e8-27e2f79a4348 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:12.089410 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-806ad0d7-22c8-40f0-94e8-27e2f79a4348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:12.102544 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860e806-5a86-4bea-b7de-3ccc58e0da6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:12.103452 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860e806-5a86-4bea-b7de-3ccc58e0da6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:12.103739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860e806-5a86-4bea-b7de-3ccc58e0da6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:12.104023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860e806-5a86-4bea-b7de-3ccc58e0da6a admin admin] PATH_INFO: `/v3/projects/f65b653464b74cbab8d62b3f0967b832` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:12.110455 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860e806-5a86-4bea-b7de-3ccc58e0da6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f65b653464b74cbab8d62b3f0967b832)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:12.112615 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860e806-5a86-4bea-b7de-3ccc58e0da6a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:12.113754 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 903/1793] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:12.137354 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6d867-9934-47b7-ae9b-452e2649d944 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:12.137649 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6d867-9934-47b7-ae9b-452e2649d944 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:12.137933 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6d867-9934-47b7-ae9b-452e2649d944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:12.229215 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4860e806-5a86-4bea-b7de-3ccc58e0da6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f65b653464b74cbab8d62b3f0967b832', 'request_id': 'req-4860e806-5a86-4bea-b7de-3ccc58e0da6a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:12.252595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4860e806-5a86-4bea-b7de-3ccc58e0da6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f65b653464b74cbab8d62b3f0967b832', 'request_id': 'req-4860e806-5a86-4bea-b7de-3ccc58e0da6a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:12.259630 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-6cd6d867-9934-47b7-ae9b-452e2649d944 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:12.260896 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6cd6d867-9934-47b7-ae9b-452e2649d944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:12.266016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4860e806-5a86-4bea-b7de-3ccc58e0da6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f65b653464b74cbab8d62b3f0967b832', 'request_id': 'req-4860e806-5a86-4bea-b7de-3ccc58e0da6a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:12.294251 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4860e806-5a86-4bea-b7de-3ccc58e0da6a admin admin] The token cache is being invalidate because project f65b653464b74cbab8d62b3f0967b832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:12.294603 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4860e806-5a86-4bea-b7de-3ccc58e0da6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:12.295341 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4860e806-5a86-4bea-b7de-3ccc58e0da6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:12.299200 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 891/1794] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:11 2022] DELETE /identity/v3/projects/f65b653464b74cbab8d62b3f0967b832 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:12.302898 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860e806-5a86-4bea-b7de-3ccc58e0da6a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:12.304968 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4860e806-5a86-4bea-b7de-3ccc58e0da6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:12.453061 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860e806-5a86-4bea-b7de-3ccc58e0da6a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:12.467075 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89784ab-2621-43c3-b7bd-e10a75d41d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:12.468694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89784ab-2621-43c3-b7bd-e10a75d41d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:12.468912 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89784ab-2621-43c3-b7bd-e10a75d41d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:12.470262 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89784ab-2621-43c3-b7bd-e10a75d41d19 admin admin] PATH_INFO: `/v3/users/b6ad2f1fbdb54531b5def70b7f76ae57` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:12.471671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89784ab-2621-43c3-b7bd-e10a75d41d19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ad2f1fbdb54531b5def70b7f76ae57)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:12.473952 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89784ab-2621-43c3-b7bd-e10a75d41d19 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:12.513513 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 904/1795] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:12.518961 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6d867-9934-47b7-ae9b-452e2649d944 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:12.541168 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6d867-9934-47b7-ae9b-452e2649d944 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:12.554464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9d147-16cf-4be6-9c2f-bc48cb574456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:12.554881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9d147-16cf-4be6-9c2f-bc48cb574456 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:12.555876 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9d147-16cf-4be6-9c2f-bc48cb574456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:12.556199 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9d147-16cf-4be6-9c2f-bc48cb574456 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:12.556980 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9d147-16cf-4be6-9c2f-bc48cb574456 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:12.557288 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9d147-16cf-4be6-9c2f-bc48cb574456 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:12.566193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9d147-16cf-4be6-9c2f-bc48cb574456 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:12.601409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 905/1796] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:25:12.602365 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9d147-16cf-4be6-9c2f-bc48cb574456 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:12.607680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d89784ab-2621-43c3-b7bd-e10a75d41d19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ad2f1fbdb54531b5def70b7f76ae57'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:12.628841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9d147-16cf-4be6-9c2f-bc48cb574456 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:12.629984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d89784ab-2621-43c3-b7bd-e10a75d41d19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ad2f1fbdb54531b5def70b7f76ae57'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:12.638466 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:12.639299 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba087e0d-d2e5-441a-a736-b27ab5b746ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:12.645063 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba087e0d-d2e5-441a-a736-b27ab5b746ac admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:12.650391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba087e0d-d2e5-441a-a736-b27ab5b746ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:12.650391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba087e0d-d2e5-441a-a736-b27ab5b746ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:12.650391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba087e0d-d2e5-441a-a736-b27ab5b746ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:12.652479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d89784ab-2621-43c3-b7bd-e10a75d41d19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ad2f1fbdb54531b5def70b7f76ae57'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:12.657518 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba087e0d-d2e5-441a-a736-b27ab5b746ac admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:12.660428 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d89784ab-2621-43c3-b7bd-e10a75d41d19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ad2f1fbdb54531b5def70b7f76ae57'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:12.661760 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d89784ab-2621-43c3-b7bd-e10a75d41d19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ad2f1fbdb54531b5def70b7f76ae57'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:12.726830 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 906/1797] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:12 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:12.727928 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba087e0d-d2e5-441a-a736-b27ab5b746ac admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:12.729891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ba087e0d-d2e5-441a-a736-b27ab5b746ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:12.747047 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 892/1798] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:12 2022] DELETE /identity/v3/users/b6ad2f1fbdb54531b5def70b7f76ae57 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:12.765182 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:12.914563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba087e0d-d2e5-441a-a736-b27ab5b746ac admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:13.098434 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee661133-1376-4960-8ed8-f339901dd17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:13.103151 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee661133-1376-4960-8ed8-f339901dd17d admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:13.103467 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee661133-1376-4960-8ed8-f339901dd17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:13.103740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee661133-1376-4960-8ed8-f339901dd17d admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:13.106589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee661133-1376-4960-8ed8-f339901dd17d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:13.118872 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee661133-1376-4960-8ed8-f339901dd17d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:13.168932 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 907/1799] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:12 2022] POST /identity/v3/users => generated 289 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:13.174312 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89784ab-2621-43c3-b7bd-e10a75d41d19 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:13.196175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89784ab-2621-43c3-b7bd-e10a75d41d19 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:13.207264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd63461-fa5c-41d6-9ae8-9e7ff0bc8b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:13.209225 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd63461-fa5c-41d6-9ae8-9e7ff0bc8b22 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:13.210146 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd63461-fa5c-41d6-9ae8-9e7ff0bc8b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:13.210658 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd63461-fa5c-41d6-9ae8-9e7ff0bc8b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:13.212286 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd63461-fa5c-41d6-9ae8-9e7ff0bc8b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:13.215837 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd63461-fa5c-41d6-9ae8-9e7ff0bc8b22 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:13.232848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 893/1800] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:13.237974 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee661133-1376-4960-8ed8-f339901dd17d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:13.255098 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee661133-1376-4960-8ed8-f339901dd17d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:13.314890 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df1d37-b308-4bad-9825-8e553fb95600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:13.318722 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df1d37-b308-4bad-9825-8e553fb95600 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:13.323547 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df1d37-b308-4bad-9825-8e553fb95600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:13.324510 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df1d37-b308-4bad-9825-8e553fb95600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:13.326979 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df1d37-b308-4bad-9825-8e553fb95600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:13.333187 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df1d37-b308-4bad-9825-8e553fb95600 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:13.395780 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 908/1801] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:13.399831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd63461-fa5c-41d6-9ae8-9e7ff0bc8b22 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:13.427548 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd63461-fa5c-41d6-9ae8-9e7ff0bc8b22 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:13.443832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee1cd7-cadc-4a8c-a53a-f6cd4d380931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:13.445257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee1cd7-cadc-4a8c-a53a-f6cd4d380931 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:13.445587 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee1cd7-cadc-4a8c-a53a-f6cd4d380931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:13.445867 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee1cd7-cadc-4a8c-a53a-f6cd4d380931 admin admin] PATH_INFO: `/v3/projects/295bdf47fbfb4f51a2f2e95b01d06a95/users/52a934152dca4098b99701430a340486/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:13.470246 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee1cd7-cadc-4a8c-a53a-f6cd4d380931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=295bdf47fbfb4f51a2f2e95b01d06a95, user_id=52a934152dca4098b99701430a340486, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:13.477126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee1cd7-cadc-4a8c-a53a-f6cd4d380931 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:13.499382 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 894/1802] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:13 2022] PUT /identity/v3/projects/295bdf47fbfb4f51a2f2e95b01d06a95/users/52a934152dca4098b99701430a340486/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:13.512076 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462a88e-c4f2-4fd5-a088-f02bdc20c348 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:13.512420 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462a88e-c4f2-4fd5-a088-f02bdc20c348 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:13.512697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462a88e-c4f2-4fd5-a088-f02bdc20c348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:13.573434 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e462a88e-c4f2-4fd5-a088-f02bdc20c348 None None] MFA Rules not processed for user `52a934152dca4098b99701430a340486`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:13.574552 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e462a88e-c4f2-4fd5-a088-f02bdc20c348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:13.749459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf43a0-f232-4ac6-a289-3ec896abb1d5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:13.750109 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf43a0-f232-4ac6-a289-3ec896abb1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:13.750726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf43a0-f232-4ac6-a289-3ec896abb1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:13.764357 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 909/1803] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:13.772902 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462a88e-c4f2-4fd5-a088-f02bdc20c348 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:13.774848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e462a88e-c4f2-4fd5-a088-f02bdc20c348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:13.828965 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ebcf43a0-f232-4ac6-a289-3ec896abb1d5 None None] MFA Rules not processed for user `f622b567cef040d8a8b83b5d51d64c39`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:13.830942 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ebcf43a0-f232-4ac6-a289-3ec896abb1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:13.837187 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:13.995132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462a88e-c4f2-4fd5-a088-f02bdc20c348 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:14.008617 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ec7db-cda0-4a7a-a71a-5107b9a2655e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f646c526a044e8b5b6e74aa64cf6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:14.009293 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ec7db-cda0-4a7a-a71a-5107b9a2655e service glance] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:14.009581 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ec7db-cda0-4a7a-a71a-5107b9a2655e service glance] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:14.009857 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ec7db-cda0-4a7a-a71a-5107b9a2655e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:14.029501 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 895/1804] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:13 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:14.035098 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ec7db-cda0-4a7a-a71a-5107b9a2655e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:14.037416 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ec7db-cda0-4a7a-a71a-5107b9a2655e service glance] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:14.073168 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 910/1805] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:25:15.188212 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf43a0-f232-4ac6-a289-3ec896abb1d5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:15.190106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ebcf43a0-f232-4ac6-a289-3ec896abb1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:15.322913 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf43a0-f232-4ac6-a289-3ec896abb1d5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:15.328834 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2ff50-a95c-48f9-9bbd-f1636bfb2a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:15.330797 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2ff50-a95c-48f9-9bbd-f1636bfb2a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:15.331272 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2ff50-a95c-48f9-9bbd-f1636bfb2a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:15.331772 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2ff50-a95c-48f9-9bbd-f1636bfb2a2c admin admin] PATH_INFO: `/v3/projects/e63176d25e2348ffada98d98e63554fd` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:15.333942 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2ff50-a95c-48f9-9bbd-f1636bfb2a2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e63176d25e2348ffada98d98e63554fd)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:15.336251 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2ff50-a95c-48f9-9bbd-f1636bfb2a2c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:15.389874 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:15.427704 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6ab2ff50-a95c-48f9-9bbd-f1636bfb2a2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e63176d25e2348ffada98d98e63554fd', 'request_id': 'req-6ab2ff50-a95c-48f9-9bbd-f1636bfb2a2c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:15.443694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6ab2ff50-a95c-48f9-9bbd-f1636bfb2a2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e63176d25e2348ffada98d98e63554fd', 'request_id': 'req-6ab2ff50-a95c-48f9-9bbd-f1636bfb2a2c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:15.452021 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6ab2ff50-a95c-48f9-9bbd-f1636bfb2a2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e63176d25e2348ffada98d98e63554fd', 'request_id': 'req-6ab2ff50-a95c-48f9-9bbd-f1636bfb2a2c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:15.482059 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6ab2ff50-a95c-48f9-9bbd-f1636bfb2a2c admin admin] The token cache is being invalidate because project e63176d25e2348ffada98d98e63554fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:15.482774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6ab2ff50-a95c-48f9-9bbd-f1636bfb2a2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:15.484829 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6ab2ff50-a95c-48f9-9bbd-f1636bfb2a2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:15.486979 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 896/1806] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:15 2022] DELETE /identity/v3/projects/e63176d25e2348ffada98d98e63554fd => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:15.491500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ec7db-cda0-4a7a-a71a-5107b9a2655e service glance] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:15.520717 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ec7db-cda0-4a7a-a71a-5107b9a2655e service glance] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:15.611905 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2ff50-a95c-48f9-9bbd-f1636bfb2a2c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:15.613635 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6ab2ff50-a95c-48f9-9bbd-f1636bfb2a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:15.703162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe91cb-1412-4160-989f-d9e4bb762915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:15.704214 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe91cb-1412-4160-989f-d9e4bb762915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:15.704609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe91cb-1412-4160-989f-d9e4bb762915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:15.704996 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe91cb-1412-4160-989f-d9e4bb762915 admin admin] PATH_INFO: `/v3/users/fbb1d5d64cae48dcaaa9544ea813a5f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:15.718317 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe91cb-1412-4160-989f-d9e4bb762915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbb1d5d64cae48dcaaa9544ea813a5f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:15.722110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe91cb-1412-4160-989f-d9e4bb762915 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:15.835087 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2ff50-a95c-48f9-9bbd-f1636bfb2a2c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:15.847215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-83fe91cb-1412-4160-989f-d9e4bb762915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbb1d5d64cae48dcaaa9544ea813a5f2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:15.858470 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b196c3-6ece-4a71-94c7-c60f04a2afcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:15.859474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b196c3-6ece-4a71-94c7-c60f04a2afcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:15.859660 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b196c3-6ece-4a71-94c7-c60f04a2afcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:15.859934 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b196c3-6ece-4a71-94c7-c60f04a2afcc admin admin] PATH_INFO: `/v3/projects/1d2367fc17614cc297a3c7c5677eae1e` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:15.864717 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b196c3-6ece-4a71-94c7-c60f04a2afcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d2367fc17614cc297a3c7c5677eae1e)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:15.866985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b196c3-6ece-4a71-94c7-c60f04a2afcc admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:15.883484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-83fe91cb-1412-4160-989f-d9e4bb762915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbb1d5d64cae48dcaaa9544ea813a5f2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:15.959095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-83fe91cb-1412-4160-989f-d9e4bb762915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbb1d5d64cae48dcaaa9544ea813a5f2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:15.979873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f5b196c3-6ece-4a71-94c7-c60f04a2afcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d2367fc17614cc297a3c7c5677eae1e', 'request_id': 'req-f5b196c3-6ece-4a71-94c7-c60f04a2afcc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:15.980464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-83fe91cb-1412-4160-989f-d9e4bb762915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbb1d5d64cae48dcaaa9544ea813a5f2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:15.981557 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-83fe91cb-1412-4160-989f-d9e4bb762915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbb1d5d64cae48dcaaa9544ea813a5f2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:15.994081 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f5b196c3-6ece-4a71-94c7-c60f04a2afcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d2367fc17614cc297a3c7c5677eae1e', 'request_id': 'req-f5b196c3-6ece-4a71-94c7-c60f04a2afcc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:16.001012 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 911/1807] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:15 2022] DELETE /identity/v3/users/fbb1d5d64cae48dcaaa9544ea813a5f2 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:16.010985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f5b196c3-6ece-4a71-94c7-c60f04a2afcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d2367fc17614cc297a3c7c5677eae1e', 'request_id': 'req-f5b196c3-6ece-4a71-94c7-c60f04a2afcc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:16.041637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f5b196c3-6ece-4a71-94c7-c60f04a2afcc admin admin] The token cache is being invalidate because project 1d2367fc17614cc297a3c7c5677eae1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:16.042027 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f5b196c3-6ece-4a71-94c7-c60f04a2afcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:16.042722 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f5b196c3-6ece-4a71-94c7-c60f04a2afcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:16.045011 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 897/1808] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:15 2022] DELETE /identity/v3/projects/1d2367fc17614cc297a3c7c5677eae1e => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:16.049954 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c235d0-c272-4a70-8739-67e41a23ced5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:16.050598 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c235d0-c272-4a70-8739-67e41a23ced5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:16.050919 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c235d0-c272-4a70-8739-67e41a23ced5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:16.075364 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f4c235d0-c272-4a70-8739-67e41a23ced5 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:16.075605 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f4c235d0-c272-4a70-8739-67e41a23ced5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:16.099240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:16.160187 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 912/1809] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:16.168984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505eac6-ee3e-4e6c-94f0-4fc591441634 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:16.169352 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505eac6-ee3e-4e6c-94f0-4fc591441634 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:16.169698 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505eac6-ee3e-4e6c-94f0-4fc591441634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:16.202161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5505eac6-ee3e-4e6c-94f0-4fc591441634 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:16.204202 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5505eac6-ee3e-4e6c-94f0-4fc591441634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:16.234025 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c235d0-c272-4a70-8739-67e41a23ced5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:16.234476 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 898/1810] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:16.247455 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c235d0-c272-4a70-8739-67e41a23ced5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:16.257929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a6f79-651a-4fe9-8ced-f60f46bd8f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:16.258921 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a6f79-651a-4fe9-8ced-f60f46bd8f75 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:16.259347 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a6f79-651a-4fe9-8ced-f60f46bd8f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:16.259831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a6f79-651a-4fe9-8ced-f60f46bd8f75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:16.260719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a6f79-651a-4fe9-8ced-f60f46bd8f75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:16.261177 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a6f79-651a-4fe9-8ced-f60f46bd8f75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:16.263560 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a6f79-651a-4fe9-8ced-f60f46bd8f75 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:16.282528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 913/1811] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:16.283783 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505eac6-ee3e-4e6c-94f0-4fc591441634 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:16.293831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505eac6-ee3e-4e6c-94f0-4fc591441634 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:16.300402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc87cc-68eb-47a5-81b1-d8e1f7ba9d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:16.301321 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc87cc-68eb-47a5-81b1-d8e1f7ba9d9e admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:16.301493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc87cc-68eb-47a5-81b1-d8e1f7ba9d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:16.301893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc87cc-68eb-47a5-81b1-d8e1f7ba9d9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:16.302975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc87cc-68eb-47a5-81b1-d8e1f7ba9d9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:16.305078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc87cc-68eb-47a5-81b1-d8e1f7ba9d9e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:16.334883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 899/1812] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:16 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:16.339448 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a6f79-651a-4fe9-8ced-f60f46bd8f75 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:16.350971 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a6f79-651a-4fe9-8ced-f60f46bd8f75 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:16.421564 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbabe4-b8b4-4f81-a4f7-a4d25a2c6575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:16.422423 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbabe4-b8b4-4f81-a4f7-a4d25a2c6575 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:16.424745 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbabe4-b8b4-4f81-a4f7-a4d25a2c6575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:16.424745 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbabe4-b8b4-4f81-a4f7-a4d25a2c6575 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:16.424745 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbabe4-b8b4-4f81-a4f7-a4d25a2c6575 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:16.425879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbabe4-b8b4-4f81-a4f7-a4d25a2c6575 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:16.452553 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 914/1813] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:16 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:16.457047 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc87cc-68eb-47a5-81b1-d8e1f7ba9d9e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:16.477445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc87cc-68eb-47a5-81b1-d8e1f7ba9d9e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:16.483962 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5484d-a392-4509-959b-46f07a569e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:16.485978 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5484d-a392-4509-959b-46f07a569e66 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:16.485978 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5484d-a392-4509-959b-46f07a569e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:16.485978 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5484d-a392-4509-959b-46f07a569e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:16.485978 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5484d-a392-4509-959b-46f07a569e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:16.487896 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5484d-a392-4509-959b-46f07a569e66 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:16.506441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 900/1814] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:25:16.510418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbabe4-b8b4-4f81-a4f7-a4d25a2c6575 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:16.525259 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbabe4-b8b4-4f81-a4f7-a4d25a2c6575 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:16.534536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d58ea3-47dd-468d-86c1-b42c97b7c953 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:16.534911 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d58ea3-47dd-468d-86c1-b42c97b7c953 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:16.537631 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d58ea3-47dd-468d-86c1-b42c97b7c953 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:16.540258 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 901/1815] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 20 19:25:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:25:16.549774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6ee75-5b52-4555-b28b-bcef80377ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:16.552548 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6ee75-5b52-4555-b28b-bcef80377ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:16.552858 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6ee75-5b52-4555-b28b-bcef80377ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:16.553144 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6ee75-5b52-4555-b28b-bcef80377ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:16.553894 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6ee75-5b52-4555-b28b-bcef80377ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:16.559960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6ee75-5b52-4555-b28b-bcef80377ec8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:16.572194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf989c9-c969-46e7-a656-e77313debddb None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:16.572792 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf989c9-c969-46e7-a656-e77313debddb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:16.573703 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf989c9-c969-46e7-a656-e77313debddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:16.577894 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 915/1816] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:25:16.581788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6ee75-5b52-4555-b28b-bcef80377ec8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:16.603486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6ee75-5b52-4555-b28b-bcef80377ec8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:16.617892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:16.626105 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82599979-007d-45fd-8a15-d0ca4210df7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:16.630989 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82599979-007d-45fd-8a15-d0ca4210df7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:16.636944 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82599979-007d-45fd-8a15-d0ca4210df7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:16.637091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-bbf989c9-c969-46e7-a656-e77313debddb None None] MFA Rules not processed for user `d310799ac43e42bc9c7810e1296ddb9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:16.638236 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82599979-007d-45fd-8a15-d0ca4210df7e admin admin] PATH_INFO: `/v3/projects/e15e6564813648219c75b1240c014640/users/32fac3259ea5432f8c6714aaf2034396/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:16.638841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bbf989c9-c969-46e7-a656-e77313debddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:16.703684 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82599979-007d-45fd-8a15-d0ca4210df7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15e6564813648219c75b1240c014640, user_id=32fac3259ea5432f8c6714aaf2034396, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:16.706611 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82599979-007d-45fd-8a15-d0ca4210df7e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:16.734176 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 916/1817] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:16 2022] PUT /identity/v3/projects/e15e6564813648219c75b1240c014640/users/32fac3259ea5432f8c6714aaf2034396/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:16.745136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a43246-6dfc-4aa8-88ff-e41a00151f96 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:16.745682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a43246-6dfc-4aa8-88ff-e41a00151f96 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:16.746203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a43246-6dfc-4aa8-88ff-e41a00151f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:16.788338 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 902/1818] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 20 19:25:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:16.789897 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22244896-8185-47e0-9c13-0ccb30f2fe73 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:16.790268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22244896-8185-47e0-9c13-0ccb30f2fe73 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:16.790665 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22244896-8185-47e0-9c13-0ccb30f2fe73 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:16.792320 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 903/1819] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 20 19:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:25:16.793193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e7a43246-6dfc-4aa8-88ff-e41a00151f96 None None] MFA Rules not processed for user `32fac3259ea5432f8c6714aaf2034396`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:16.794766 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e7a43246-6dfc-4aa8-88ff-e41a00151f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:16.889426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:16.908295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22244896-8185-47e0-9c13-0ccb30f2fe73 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:16.909716 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 917/1820] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:16.916505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf9f2a-a2a7-4c6f-a4ae-8a5dda6c6a2e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:16.917034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf9f2a-a2a7-4c6f-a4ae-8a5dda6c6a2e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:16.917486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf9f2a-a2a7-4c6f-a4ae-8a5dda6c6a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:16.945121 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0ecf9f2a-a2a7-4c6f-a4ae-8a5dda6c6a2e None None] MFA Rules not processed for user `a1f0f6bc94de4645a8c82038ff2bd34a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:16.947498 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0ecf9f2a-a2a7-4c6f-a4ae-8a5dda6c6a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:17.016842 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22244896-8185-47e0-9c13-0ccb30f2fe73 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:17.025770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949b29e-cc3c-40c4-8e21-ac63a24d5879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:17.027391 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949b29e-cc3c-40c4-8e21-ac63a24d5879 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:17.027858 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949b29e-cc3c-40c4-8e21-ac63a24d5879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:17.028659 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949b29e-cc3c-40c4-8e21-ac63a24d5879 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:17.029599 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949b29e-cc3c-40c4-8e21-ac63a24d5879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:17.032957 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949b29e-cc3c-40c4-8e21-ac63a24d5879 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:17.144164 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 904/1821] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:16 2022] POST /identity/v3/projects => generated 387 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:17.145737 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949b29e-cc3c-40c4-8e21-ac63a24d5879 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:17.150067 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3949b29e-cc3c-40c4-8e21-ac63a24d5879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:17.173044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 918/1822] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 20 19:25:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:17.173044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf9f2a-a2a7-4c6f-a4ae-8a5dda6c6a2e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:17.205036 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf9f2a-a2a7-4c6f-a4ae-8a5dda6c6a2e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:17.268400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949b29e-cc3c-40c4-8e21-ac63a24d5879 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:17.275529 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d39f1-02f2-4f0b-93e0-584a5c0a2ac3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd310799ac43e42bc9c7810e1296ddb9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:17.276411 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d39f1-02f2-4f0b-93e0-584a5c0a2ac3 service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:17.277253 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d39f1-02f2-4f0b-93e0-584a5c0a2ac3 service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:17.277678 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d39f1-02f2-4f0b-93e0-584a5c0a2ac3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:17.289742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124a311-e2a0-4005-a71e-14a25a0419d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:17.290845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124a311-e2a0-4005-a71e-14a25a0419d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:17.291535 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124a311-e2a0-4005-a71e-14a25a0419d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:17.291939 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124a311-e2a0-4005-a71e-14a25a0419d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:17.293337 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124a311-e2a0-4005-a71e-14a25a0419d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:17.295139 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d39f1-02f2-4f0b-93e0-584a5c0a2ac3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:17.296742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124a311-e2a0-4005-a71e-14a25a0419d0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:17.298051 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d39f1-02f2-4f0b-93e0-584a5c0a2ac3 service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:17.313284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 905/1823] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:17.323181 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 919/1824] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:17 2022] POST /identity/v3/users => generated 300 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:17.325236 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d39f1-02f2-4f0b-93e0-584a5c0a2ac3 service placement] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:17.339726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d39f1-02f2-4f0b-93e0-584a5c0a2ac3 service placement] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:17.345195 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea66a3-e277-4686-b62c-efb7e2a10a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:17.350643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea66a3-e277-4686-b62c-efb7e2a10a4f admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:17.351677 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea66a3-e277-4686-b62c-efb7e2a10a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:17.352329 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea66a3-e277-4686-b62c-efb7e2a10a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:17.353258 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea66a3-e277-4686-b62c-efb7e2a10a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:17.355735 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea66a3-e277-4686-b62c-efb7e2a10a4f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:17.371313 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 906/1825] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:17.375774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124a311-e2a0-4005-a71e-14a25a0419d0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:17.392466 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124a311-e2a0-4005-a71e-14a25a0419d0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:17.402584 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777b4d4-a153-4ecb-9ebc-31a0c6d626a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:17.404598 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777b4d4-a153-4ecb-9ebc-31a0c6d626a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:17.404598 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777b4d4-a153-4ecb-9ebc-31a0c6d626a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:17.404598 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777b4d4-a153-4ecb-9ebc-31a0c6d626a7 admin admin] PATH_INFO: `/v3/projects/50365000c9d841f998e9e6ea6398523c/users/0a9ebfad1599491c8a2eb8ddbd3cfd79/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:17.425447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777b4d4-a153-4ecb-9ebc-31a0c6d626a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50365000c9d841f998e9e6ea6398523c, user_id=0a9ebfad1599491c8a2eb8ddbd3cfd79, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:17.428782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777b4d4-a153-4ecb-9ebc-31a0c6d626a7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:17.456284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea66a3-e277-4686-b62c-efb7e2a10a4f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:17.458163 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 920/1826] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:17 2022] PUT /identity/v3/projects/50365000c9d841f998e9e6ea6398523c/users/0a9ebfad1599491c8a2eb8ddbd3cfd79/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:17.466593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea66a3-e277-4686-b62c-efb7e2a10a4f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:17.474335 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:17.559216 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e18a96-09f1-4b45-97b3-30d6acf28328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:17.560380 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e18a96-09f1-4b45-97b3-30d6acf28328 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:17.562263 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e18a96-09f1-4b45-97b3-30d6acf28328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:17.562838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e18a96-09f1-4b45-97b3-30d6acf28328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:17.563694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e18a96-09f1-4b45-97b3-30d6acf28328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:17.566504 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e18a96-09f1-4b45-97b3-30d6acf28328 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:17.576373 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777b4d4-a153-4ecb-9ebc-31a0c6d626a7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:17.585707 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3777b4d4-a153-4ecb-9ebc-31a0c6d626a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:17.616183 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 907/1827] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:17.621217 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e18a96-09f1-4b45-97b3-30d6acf28328 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:17.650832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e18a96-09f1-4b45-97b3-30d6acf28328 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:17.680680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c22f3-665e-4716-968b-423da8409b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:17.682078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c22f3-665e-4716-968b-423da8409b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:17.682567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c22f3-665e-4716-968b-423da8409b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:17.683116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c22f3-665e-4716-968b-423da8409b22 admin admin] PATH_INFO: `/v3/projects/50365000c9d841f998e9e6ea6398523c/users/0a9ebfad1599491c8a2eb8ddbd3cfd79/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:17.685603 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c22f3-665e-4716-968b-423da8409b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50365000c9d841f998e9e6ea6398523c, user_id=0a9ebfad1599491c8a2eb8ddbd3cfd79, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:17.689371 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186c22f3-665e-4716-968b-423da8409b22 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:17.723311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 908/1828] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:17 2022] PUT /identity/v3/projects/50365000c9d841f998e9e6ea6398523c/users/0a9ebfad1599491c8a2eb8ddbd3cfd79/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:17.734362 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2260d-16a0-4119-bc9c-483b60f009f4 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:17.735013 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2260d-16a0-4119-bc9c-483b60f009f4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:17.735469 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2260d-16a0-4119-bc9c-483b60f009f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:17.747752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:17.791892 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777b4d4-a153-4ecb-9ebc-31a0c6d626a7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:17.794458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-37f2260d-16a0-4119-bc9c-483b60f009f4 None None] MFA Rules not processed for user `0a9ebfad1599491c8a2eb8ddbd3cfd79`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:17.796108 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-37f2260d-16a0-4119-bc9c-483b60f009f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:17.990907 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadbacb-ba78-40bb-8db5-0b718deec089 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:17.997720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadbacb-ba78-40bb-8db5-0b718deec089 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:17.998178 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadbacb-ba78-40bb-8db5-0b718deec089 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:17.998574 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadbacb-ba78-40bb-8db5-0b718deec089 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:18.002801 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 909/1829] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:18.004419 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2260d-16a0-4119-bc9c-483b60f009f4 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:18.010098 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-37f2260d-16a0-4119-bc9c-483b60f009f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:18.021859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadbacb-ba78-40bb-8db5-0b718deec089 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:18.024674 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadbacb-ba78-40bb-8db5-0b718deec089 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:18.059407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 921/1830] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:18.063122 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadbacb-ba78-40bb-8db5-0b718deec089 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:18.066080 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8fadbacb-ba78-40bb-8db5-0b718deec089 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:18.121850 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2260d-16a0-4119-bc9c-483b60f009f4 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:18.129603 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c3325-38e8-47bb-a5ad-6110e7570448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:18.132604 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c3325-38e8-47bb-a5ad-6110e7570448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:18.133419 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c3325-38e8-47bb-a5ad-6110e7570448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:18.133702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c3325-38e8-47bb-a5ad-6110e7570448 admin admin] PATH_INFO: `/v3/projects/2ae50e5e3c5d4d5c99060a55b7c16233` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:18.135917 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c3325-38e8-47bb-a5ad-6110e7570448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ae50e5e3c5d4d5c99060a55b7c16233)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:18.137932 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c3325-38e8-47bb-a5ad-6110e7570448 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:18.164277 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:18.222336 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-0e5c3325-38e8-47bb-a5ad-6110e7570448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ae50e5e3c5d4d5c99060a55b7c16233', 'request_id': 'req-0e5c3325-38e8-47bb-a5ad-6110e7570448'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:18.231841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-0e5c3325-38e8-47bb-a5ad-6110e7570448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ae50e5e3c5d4d5c99060a55b7c16233', 'request_id': 'req-0e5c3325-38e8-47bb-a5ad-6110e7570448'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:18.239729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-0e5c3325-38e8-47bb-a5ad-6110e7570448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ae50e5e3c5d4d5c99060a55b7c16233', 'request_id': 'req-0e5c3325-38e8-47bb-a5ad-6110e7570448'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:18.241370 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadbacb-ba78-40bb-8db5-0b718deec089 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:18.265404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-0e5c3325-38e8-47bb-a5ad-6110e7570448 admin admin] The token cache is being invalidate because project 2ae50e5e3c5d4d5c99060a55b7c16233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:18.267556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-0e5c3325-38e8-47bb-a5ad-6110e7570448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:18.269531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-0e5c3325-38e8-47bb-a5ad-6110e7570448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:18.273171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 910/1831] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:18 2022] DELETE /identity/v3/projects/2ae50e5e3c5d4d5c99060a55b7c16233 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:18.278570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa6e0b-fd3d-4efc-840b-a249dd4893f0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:18.278855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa6e0b-fd3d-4efc-840b-a249dd4893f0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:18.282043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa6e0b-fd3d-4efc-840b-a249dd4893f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:18.330457 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f6aa6e0b-fd3d-4efc-840b-a249dd4893f0 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:18.335637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f6aa6e0b-fd3d-4efc-840b-a249dd4893f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:18.386543 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a05d9-8b6d-475c-9dad-5b0738c91872 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:18.387221 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a05d9-8b6d-475c-9dad-5b0738c91872 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:18.387504 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a05d9-8b6d-475c-9dad-5b0738c91872 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:18.387783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a05d9-8b6d-475c-9dad-5b0738c91872 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:18.394438 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-139a05d9-8b6d-475c-9dad-5b0738c91872 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:18.499756 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 911/1832] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:18.507676 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59296139-56b1-4323-8686-11448afb0bb8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:18.508155 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59296139-56b1-4323-8686-11448afb0bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:18.508541 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59296139-56b1-4323-8686-11448afb0bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:18.522870 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:18.542680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-59296139-56b1-4323-8686-11448afb0bb8 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:18.544514 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-59296139-56b1-4323-8686-11448afb0bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:18.569915 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a05d9-8b6d-475c-9dad-5b0738c91872 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:18.571569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a05d9-8b6d-475c-9dad-5b0738c91872 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:18.596386 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 922/1833] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:18.603155 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 912/1834] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:18.609364 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a05d9-8b6d-475c-9dad-5b0738c91872 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:18.644593 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a05d9-8b6d-475c-9dad-5b0738c91872 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:18.673728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc4fe8-3fc0-455a-8b3e-f02ac0b55024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:18.674524 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59296139-56b1-4323-8686-11448afb0bb8 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:18.674646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc4fe8-3fc0-455a-8b3e-f02ac0b55024 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:18.675048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc4fe8-3fc0-455a-8b3e-f02ac0b55024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:18.675342 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc4fe8-3fc0-455a-8b3e-f02ac0b55024 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:18.676088 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc4fe8-3fc0-455a-8b3e-f02ac0b55024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:18.676399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc4fe8-3fc0-455a-8b3e-f02ac0b55024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:18.676665 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-59296139-56b1-4323-8686-11448afb0bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:18.678090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc4fe8-3fc0-455a-8b3e-f02ac0b55024 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:18.692235 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59296139-56b1-4323-8686-11448afb0bb8 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:18.697872 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045a826-fef8-4788-9018-177d94fec7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:18.698941 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045a826-fef8-4788-9018-177d94fec7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:18.699389 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045a826-fef8-4788-9018-177d94fec7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:18.699772 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045a826-fef8-4788-9018-177d94fec7bf admin admin] PATH_INFO: `/v3/users/32fac3259ea5432f8c6714aaf2034396` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:18.701132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045a826-fef8-4788-9018-177d94fec7bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=32fac3259ea5432f8c6714aaf2034396)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:18.703936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045a826-fef8-4788-9018-177d94fec7bf admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:18.720483 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 923/1835] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:18.730824 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc4fe8-3fc0-455a-8b3e-f02ac0b55024 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:18.765548 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc4fe8-3fc0-455a-8b3e-f02ac0b55024 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:18.779132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e428c6-5156-4b41-8d04-47d6b85da244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:18.780465 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e428c6-5156-4b41-8d04-47d6b85da244 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:18.780646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e428c6-5156-4b41-8d04-47d6b85da244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:18.780929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e428c6-5156-4b41-8d04-47d6b85da244 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:18.781631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e428c6-5156-4b41-8d04-47d6b85da244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:18.783609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e428c6-5156-4b41-8d04-47d6b85da244 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:18.792388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7045a826-fef8-4788-9018-177d94fec7bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32fac3259ea5432f8c6714aaf2034396'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:18.801422 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7045a826-fef8-4788-9018-177d94fec7bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32fac3259ea5432f8c6714aaf2034396'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:18.817641 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7045a826-fef8-4788-9018-177d94fec7bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32fac3259ea5432f8c6714aaf2034396'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:18.818428 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7045a826-fef8-4788-9018-177d94fec7bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32fac3259ea5432f8c6714aaf2034396'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:18.819099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7045a826-fef8-4788-9018-177d94fec7bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32fac3259ea5432f8c6714aaf2034396'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:18.829182 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 924/1836] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:18 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:18.834425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e428c6-5156-4b41-8d04-47d6b85da244 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:18.839262 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-89e428c6-5156-4b41-8d04-47d6b85da244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:18.862877 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 913/1837] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:18 2022] DELETE /identity/v3/users/32fac3259ea5432f8c6714aaf2034396 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:18.874422 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100d631-3c0b-4c0d-93ca-297725c96fb7 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:18.876035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100d631-3c0b-4c0d-93ca-297725c96fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:18.876035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3100d631-3c0b-4c0d-93ca-297725c96fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:18.903562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3100d631-3c0b-4c0d-93ca-297725c96fb7 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:18.905800 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3100d631-3c0b-4c0d-93ca-297725c96fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:18.913833 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:18.980796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e428c6-5156-4b41-8d04-47d6b85da244 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:19.041251 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 914/1838] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:19.042685 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd394b5-22ef-4862-82b3-d8cc59479dbb None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:19.042975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd394b5-22ef-4862-82b3-d8cc59479dbb None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:19.043257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd394b5-22ef-4862-82b3-d8cc59479dbb None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:19.045345 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 915/1839] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 20 19:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:25:19.069673 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671b170-bc28-46a1-8869-5dbcd2ec1add None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:19.070100 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671b170-bc28-46a1-8869-5dbcd2ec1add None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:19.070484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671b170-bc28-46a1-8869-5dbcd2ec1add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:19.087118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ae161-aa13-41ce-8c04-96f6f81358cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:19.088191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ae161-aa13-41ce-8c04-96f6f81358cc admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:19.088622 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ae161-aa13-41ce-8c04-96f6f81358cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:19.089041 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ae161-aa13-41ce-8c04-96f6f81358cc admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:19.089885 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ae161-aa13-41ce-8c04-96f6f81358cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:19.092328 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ae161-aa13-41ce-8c04-96f6f81358cc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:19.098881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8671b170-bc28-46a1-8869-5dbcd2ec1add None None] MFA Rules not processed for user `d310799ac43e42bc9c7810e1296ddb9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:19.100448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8671b170-bc28-46a1-8869-5dbcd2ec1add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:19.133155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 925/1840] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:18 2022] POST /identity/v3/users => generated 287 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:19.134809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ae161-aa13-41ce-8c04-96f6f81358cc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:19.137577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a09ae161-aa13-41ce-8c04-96f6f81358cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:19.196208 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:19.203781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 916/1841] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 20 19:25:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:19.204691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671b170-bc28-46a1-8869-5dbcd2ec1add None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:19.220251 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ae161-aa13-41ce-8c04-96f6f81358cc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:19.223154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671b170-bc28-46a1-8869-5dbcd2ec1add None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:19.224457 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020c378-408b-4730-a1c7-5c2647e46691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:19.225230 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020c378-408b-4730-a1c7-5c2647e46691 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:19.225526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020c378-408b-4730-a1c7-5c2647e46691 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:19.225804 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6020c378-408b-4730-a1c7-5c2647e46691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:19.230230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ccec3-b1fb-49d9-84ee-4d0ce9b5fbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:19.231503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ccec3-b1fb-49d9-84ee-4d0ce9b5fbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:19.232120 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ccec3-b1fb-49d9-84ee-4d0ce9b5fbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:19.232543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ccec3-b1fb-49d9-84ee-4d0ce9b5fbf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:19.233654 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ccec3-b1fb-49d9-84ee-4d0ce9b5fbf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:19.235417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ccec3-b1fb-49d9-84ee-4d0ce9b5fbf0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:19.238494 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020c378-408b-4730-a1c7-5c2647e46691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:19.241636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6020c378-408b-4730-a1c7-5c2647e46691 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:19.253899 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 926/1842] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:19.254256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 917/1843] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:19.257937 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ccec3-b1fb-49d9-84ee-4d0ce9b5fbf0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:19.259871 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-438ccec3-b1fb-49d9-84ee-4d0ce9b5fbf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:19.263508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020c378-408b-4730-a1c7-5c2647e46691 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:19.272890 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6020c378-408b-4730-a1c7-5c2647e46691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:19.277261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ccec3-b1fb-49d9-84ee-4d0ce9b5fbf0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:19.283554 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e69b0e-3231-47b8-82b8-56360ebf39d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:19.284737 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e69b0e-3231-47b8-82b8-56360ebf39d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:19.285410 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e69b0e-3231-47b8-82b8-56360ebf39d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:19.285956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e69b0e-3231-47b8-82b8-56360ebf39d7 admin admin] PATH_INFO: `/v3/users/a4d5570ada2a48eb85ed560248de38d4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:19.287897 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e69b0e-3231-47b8-82b8-56360ebf39d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4d5570ada2a48eb85ed560248de38d4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:19.290518 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e69b0e-3231-47b8-82b8-56360ebf39d7 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:19.294079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6020c378-408b-4730-a1c7-5c2647e46691 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:19.299937 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a18098-1f65-4e30-b7e4-52815d66595e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd310799ac43e42bc9c7810e1296ddb9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:19.300678 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a18098-1f65-4e30-b7e4-52815d66595e service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:19.301035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a18098-1f65-4e30-b7e4-52815d66595e service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:19.301520 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a18098-1f65-4e30-b7e4-52815d66595e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:19.317853 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a18098-1f65-4e30-b7e4-52815d66595e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:19.319511 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a18098-1f65-4e30-b7e4-52815d66595e service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:19.338841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 927/1844] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:19.339909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a18098-1f65-4e30-b7e4-52815d66595e service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:19.355713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a18098-1f65-4e30-b7e4-52815d66595e service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:19.363145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c0c37-a201-4907-82df-5b7b70143209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:19.364009 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c0c37-a201-4907-82df-5b7b70143209 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:19.364430 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c0c37-a201-4907-82df-5b7b70143209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:19.364799 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c0c37-a201-4907-82df-5b7b70143209 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:19.365505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c0c37-a201-4907-82df-5b7b70143209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:19.367572 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c0c37-a201-4907-82df-5b7b70143209 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:19.390895 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 928/1845] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:19.396617 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c0c37-a201-4907-82df-5b7b70143209 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:19.398388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d9e69b0e-3231-47b8-82b8-56360ebf39d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4d5570ada2a48eb85ed560248de38d4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:19.416536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d9e69b0e-3231-47b8-82b8-56360ebf39d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4d5570ada2a48eb85ed560248de38d4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:19.417285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c0c37-a201-4907-82df-5b7b70143209 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:19.438956 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73705ab9-444f-4bf0-a705-80c79bea4131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:19.439304 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d9e69b0e-3231-47b8-82b8-56360ebf39d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4d5570ada2a48eb85ed560248de38d4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:19.439304 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d9e69b0e-3231-47b8-82b8-56360ebf39d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4d5570ada2a48eb85ed560248de38d4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:19.439471 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73705ab9-444f-4bf0-a705-80c79bea4131 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:19.439471 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73705ab9-444f-4bf0-a705-80c79bea4131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:19.439600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d9e69b0e-3231-47b8-82b8-56360ebf39d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4d5570ada2a48eb85ed560248de38d4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:19.439669 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73705ab9-444f-4bf0-a705-80c79bea4131 admin admin] PATH_INFO: `/v3/projects/c8b5a65a23fa47b8b8f6486f04c40a05/users/0fa4f65a6d1a41429155d291673b4a0c/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:19.453806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73705ab9-444f-4bf0-a705-80c79bea4131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b5a65a23fa47b8b8f6486f04c40a05, user_id=0fa4f65a6d1a41429155d291673b4a0c, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:19.457759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73705ab9-444f-4bf0-a705-80c79bea4131 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:19.462354 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 918/1846] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:19 2022] DELETE /identity/v3/users/a4d5570ada2a48eb85ed560248de38d4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:19.490389 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 929/1847] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:19 2022] PUT /identity/v3/projects/c8b5a65a23fa47b8b8f6486f04c40a05/users/0fa4f65a6d1a41429155d291673b4a0c/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:19.502419 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf580d-8172-4a71-94e0-8c6be6c8d17e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:19.502722 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf580d-8172-4a71-94e0-8c6be6c8d17e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:19.503196 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf580d-8172-4a71-94e0-8c6be6c8d17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:19.535175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:19.552113 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-99bf580d-8172-4a71-94e0-8c6be6c8d17e None None] MFA Rules not processed for user `0fa4f65a6d1a41429155d291673b4a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:19.555965 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-99bf580d-8172-4a71-94e0-8c6be6c8d17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:19.642260 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 919/1848] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:19.646958 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73705ab9-444f-4bf0-a705-80c79bea4131 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:19.650224 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-73705ab9-444f-4bf0-a705-80c79bea4131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:19.699454 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf580d-8172-4a71-94e0-8c6be6c8d17e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:19.702652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-99bf580d-8172-4a71-94e0-8c6be6c8d17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:19.781745 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73705ab9-444f-4bf0-a705-80c79bea4131 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:19.788127 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc315a-9658-47ce-a277-7130ed2d5eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:19.788795 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc315a-9658-47ce-a277-7130ed2d5eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:19.790114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc315a-9658-47ce-a277-7130ed2d5eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:19.790114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc315a-9658-47ce-a277-7130ed2d5eb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:19.790526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc315a-9658-47ce-a277-7130ed2d5eb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:19.792966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdc315a-9658-47ce-a277-7130ed2d5eb4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:19.832923 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf580d-8172-4a71-94e0-8c6be6c8d17e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:19.835794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 930/1849] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:19 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:19.836719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc315a-9658-47ce-a277-7130ed2d5eb4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:19.839785 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4bdc315a-9658-47ce-a277-7130ed2d5eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:19.845773 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a14a04-b226-4e49-8405-2303e983dcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:19.846775 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a14a04-b226-4e49-8405-2303e983dcd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:19.847245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a14a04-b226-4e49-8405-2303e983dcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:19.847530 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a14a04-b226-4e49-8405-2303e983dcd7 admin admin] PATH_INFO: `/v3/projects/e15e6564813648219c75b1240c014640` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:19.848748 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a14a04-b226-4e49-8405-2303e983dcd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e15e6564813648219c75b1240c014640)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:19.851756 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a14a04-b226-4e49-8405-2303e983dcd7 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:19.913538 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc315a-9658-47ce-a277-7130ed2d5eb4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:19.915165 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-11a14a04-b226-4e49-8405-2303e983dcd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e15e6564813648219c75b1240c014640', 'request_id': 'req-11a14a04-b226-4e49-8405-2303e983dcd7'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:19.922016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-11a14a04-b226-4e49-8405-2303e983dcd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e15e6564813648219c75b1240c014640', 'request_id': 'req-11a14a04-b226-4e49-8405-2303e983dcd7'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:19.928270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-11a14a04-b226-4e49-8405-2303e983dcd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e15e6564813648219c75b1240c014640', 'request_id': 'req-11a14a04-b226-4e49-8405-2303e983dcd7'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:19.942953 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-11a14a04-b226-4e49-8405-2303e983dcd7 admin admin] The token cache is being invalidate because project e15e6564813648219c75b1240c014640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:19.943387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-11a14a04-b226-4e49-8405-2303e983dcd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:19.944090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-11a14a04-b226-4e49-8405-2303e983dcd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:19.945664 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 920/1850] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:19 2022] DELETE /identity/v3/projects/e15e6564813648219c75b1240c014640 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:19.946432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a14a04-b226-4e49-8405-2303e983dcd7 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:19.946791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:19.948409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-11a14a04-b226-4e49-8405-2303e983dcd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:19.981333 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:19.981582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa483b50-aec5-46c4-909b-5f967bf857ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:19.982686 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa483b50-aec5-46c4-909b-5f967bf857ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:19.982879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa483b50-aec5-46c4-909b-5f967bf857ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:19.983249 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa483b50-aec5-46c4-909b-5f967bf857ef admin admin] PATH_INFO: `/v3/projects/6ad8259190c1485186cba1a691f5eedc` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:19.984570 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa483b50-aec5-46c4-909b-5f967bf857ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ad8259190c1485186cba1a691f5eedc)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:19.986781 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa483b50-aec5-46c4-909b-5f967bf857ef admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:20.030212 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a14a04-b226-4e49-8405-2303e983dcd7 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:20.050418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aa483b50-aec5-46c4-909b-5f967bf857ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ad8259190c1485186cba1a691f5eedc', 'request_id': 'req-aa483b50-aec5-46c4-909b-5f967bf857ef'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.056959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aa483b50-aec5-46c4-909b-5f967bf857ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ad8259190c1485186cba1a691f5eedc', 'request_id': 'req-aa483b50-aec5-46c4-909b-5f967bf857ef'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.071469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aa483b50-aec5-46c4-909b-5f967bf857ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ad8259190c1485186cba1a691f5eedc', 'request_id': 'req-aa483b50-aec5-46c4-909b-5f967bf857ef'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.084485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aa483b50-aec5-46c4-909b-5f967bf857ef admin admin] The token cache is being invalidate because project 6ad8259190c1485186cba1a691f5eedc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:20.084485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aa483b50-aec5-46c4-909b-5f967bf857ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.085411 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-aa483b50-aec5-46c4-909b-5f967bf857ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.090179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 931/1851] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:19 2022] DELETE /identity/v3/projects/6ad8259190c1485186cba1a691f5eedc => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:20.091100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa483b50-aec5-46c4-909b-5f967bf857ef admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:20.092519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-aa483b50-aec5-46c4-909b-5f967bf857ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:20.098370 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf1fc8-38a0-4059-84f4-0e18bba0566a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:20.099142 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf1fc8-38a0-4059-84f4-0e18bba0566a admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:20.099501 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf1fc8-38a0-4059-84f4-0e18bba0566a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:20.099854 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf1fc8-38a0-4059-84f4-0e18bba0566a admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:20.100741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf1fc8-38a0-4059-84f4-0e18bba0566a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:20.102844 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf1fc8-38a0-4059-84f4-0e18bba0566a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:20.113852 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa483b50-aec5-46c4-909b-5f967bf857ef admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:20.120214 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e850359-3fd0-4fa4-a088-a6760f605d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:20.121275 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e850359-3fd0-4fa4-a088-a6760f605d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:20.121720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e850359-3fd0-4fa4-a088-a6760f605d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:20.122001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e850359-3fd0-4fa4-a088-a6760f605d01 admin admin] PATH_INFO: `/v3/users/0a9ebfad1599491c8a2eb8ddbd3cfd79` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:20.123361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e850359-3fd0-4fa4-a088-a6760f605d01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a9ebfad1599491c8a2eb8ddbd3cfd79)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:20.125840 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e850359-3fd0-4fa4-a088-a6760f605d01 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:20.131589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 921/1852] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:19 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:20.131589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf1fc8-38a0-4059-84f4-0e18bba0566a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:20.132123 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bbdf1fc8-38a0-4059-84f4-0e18bba0566a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:20.145435 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf1fc8-38a0-4059-84f4-0e18bba0566a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:20.150611 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e61624-6d8d-4882-bed1-4ef81e06058c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:20.151501 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e61624-6d8d-4882-bed1-4ef81e06058c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:20.151791 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e61624-6d8d-4882-bed1-4ef81e06058c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:20.152074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e61624-6d8d-4882-bed1-4ef81e06058c admin admin] PATH_INFO: `/v3/users/f622b567cef040d8a8b83b5d51d64c39` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:20.153307 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e61624-6d8d-4882-bed1-4ef81e06058c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f622b567cef040d8a8b83b5d51d64c39)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:20.155485 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e61624-6d8d-4882-bed1-4ef81e06058c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:20.223879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b8e61624-6d8d-4882-bed1-4ef81e06058c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f622b567cef040d8a8b83b5d51d64c39'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.226686 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4e850359-3fd0-4fa4-a088-a6760f605d01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a9ebfad1599491c8a2eb8ddbd3cfd79'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.233440 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b8e61624-6d8d-4882-bed1-4ef81e06058c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f622b567cef040d8a8b83b5d51d64c39'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.245826 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4e850359-3fd0-4fa4-a088-a6760f605d01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a9ebfad1599491c8a2eb8ddbd3cfd79'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.249668 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b8e61624-6d8d-4882-bed1-4ef81e06058c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f622b567cef040d8a8b83b5d51d64c39'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.250630 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b8e61624-6d8d-4882-bed1-4ef81e06058c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f622b567cef040d8a8b83b5d51d64c39'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.251920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b8e61624-6d8d-4882-bed1-4ef81e06058c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f622b567cef040d8a8b83b5d51d64c39'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.270702 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4e850359-3fd0-4fa4-a088-a6760f605d01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a9ebfad1599491c8a2eb8ddbd3cfd79'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.274914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 922/1853] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:20 2022] DELETE /identity/v3/users/f622b567cef040d8a8b83b5d51d64c39 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:20.276342 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e61624-6d8d-4882-bed1-4ef81e06058c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:20.281053 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b8e61624-6d8d-4882-bed1-4ef81e06058c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:20.288956 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4e850359-3fd0-4fa4-a088-a6760f605d01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a9ebfad1599491c8a2eb8ddbd3cfd79'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.291246 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4e850359-3fd0-4fa4-a088-a6760f605d01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a9ebfad1599491c8a2eb8ddbd3cfd79'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.301941 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 932/1854] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:20 2022] DELETE /identity/v3/users/0a9ebfad1599491c8a2eb8ddbd3cfd79 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:20.361246 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:20.401192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e61624-6d8d-4882-bed1-4ef81e06058c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:20.479843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fe339-9679-451a-967b-3e6533b803fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:20.481076 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fe339-9679-451a-967b-3e6533b803fe admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:20.481436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fe339-9679-451a-967b-3e6533b803fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:20.481783 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fe339-9679-451a-967b-3e6533b803fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:20.483659 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55fe339-9679-451a-967b-3e6533b803fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:20.485813 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55fe339-9679-451a-967b-3e6533b803fe admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:20.505122 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 923/1855] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:20.511036 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e850359-3fd0-4fa4-a088-a6760f605d01 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:20.512404 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4e850359-3fd0-4fa4-a088-a6760f605d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:20.538937 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e850359-3fd0-4fa4-a088-a6760f605d01 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:20.544085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82ee5c-6950-49c0-b7c1-3be69d917ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:20.545006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82ee5c-6950-49c0-b7c1-3be69d917ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:20.545231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82ee5c-6950-49c0-b7c1-3be69d917ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:20.545536 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82ee5c-6950-49c0-b7c1-3be69d917ab8 admin admin] PATH_INFO: `/v3/projects/a1ba08ba77004a11995d7522256fa56c/users/f30f4affd5424d60b02c224208279671/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:20.567711 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82ee5c-6950-49c0-b7c1-3be69d917ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ba08ba77004a11995d7522256fa56c, user_id=f30f4affd5424d60b02c224208279671, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:20.571522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82ee5c-6950-49c0-b7c1-3be69d917ab8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:20.587495 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fe339-9679-451a-967b-3e6533b803fe admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:20.590466 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e55fe339-9679-451a-967b-3e6533b803fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:20.594528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 933/1856] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:20 2022] PUT /identity/v3/projects/a1ba08ba77004a11995d7522256fa56c/users/f30f4affd5424d60b02c224208279671/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:20.595420 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82ee5c-6950-49c0-b7c1-3be69d917ab8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:20.609433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:20.617911 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fe339-9679-451a-967b-3e6533b803fe admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:20.704604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82ee5c-6950-49c0-b7c1-3be69d917ab8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:20.714887 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac50ca-47ce-499e-a45a-c492c058ef09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:20.715767 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac50ca-47ce-499e-a45a-c492c058ef09 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:20.716124 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac50ca-47ce-499e-a45a-c492c058ef09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:20.716514 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac50ca-47ce-499e-a45a-c492c058ef09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:20.717521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac50ca-47ce-499e-a45a-c492c058ef09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:20.724703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac50ca-47ce-499e-a45a-c492c058ef09 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:20.733593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb881b4-f036-4e1d-b469-be8ad1123d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:20.734684 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb881b4-f036-4e1d-b469-be8ad1123d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:20.735093 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb881b4-f036-4e1d-b469-be8ad1123d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:20.735483 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb881b4-f036-4e1d-b469-be8ad1123d13 admin admin] PATH_INFO: `/v3/projects/9f69042daf9e42e69fc15f10e91de065` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:20.737125 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb881b4-f036-4e1d-b469-be8ad1123d13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f69042daf9e42e69fc15f10e91de065)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:20.742722 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb881b4-f036-4e1d-b469-be8ad1123d13 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:20.742910 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 934/1857] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:20.744314 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac50ca-47ce-499e-a45a-c492c058ef09 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:20.757884 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac50ca-47ce-499e-a45a-c492c058ef09 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:20.763993 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed201cf-bb85-430a-92fe-b292127ca30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:20.765565 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed201cf-bb85-430a-92fe-b292127ca30e admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:20.765848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed201cf-bb85-430a-92fe-b292127ca30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:20.766124 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed201cf-bb85-430a-92fe-b292127ca30e admin admin] PATH_INFO: `/v3/projects/a1ba08ba77004a11995d7522256fa56c/users/f30f4affd5424d60b02c224208279671/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:20.768764 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed201cf-bb85-430a-92fe-b292127ca30e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ba08ba77004a11995d7522256fa56c, user_id=f30f4affd5424d60b02c224208279671, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:20.773442 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed201cf-bb85-430a-92fe-b292127ca30e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:20.794569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 935/1858] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:20 2022] PUT /identity/v3/projects/a1ba08ba77004a11995d7522256fa56c/users/f30f4affd5424d60b02c224208279671/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:20.800633 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b366e40-1888-4166-8928-7bc33c7c43a1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:20.808049 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b366e40-1888-4166-8928-7bc33c7c43a1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:20.808426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b366e40-1888-4166-8928-7bc33c7c43a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:20.862383 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9fb881b4-f036-4e1d-b469-be8ad1123d13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f69042daf9e42e69fc15f10e91de065', 'request_id': 'req-9fb881b4-f036-4e1d-b469-be8ad1123d13'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.864904 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3b366e40-1888-4166-8928-7bc33c7c43a1 None None] MFA Rules not processed for user `f30f4affd5424d60b02c224208279671`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:20.867057 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3b366e40-1888-4166-8928-7bc33c7c43a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:20.870919 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9fb881b4-f036-4e1d-b469-be8ad1123d13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f69042daf9e42e69fc15f10e91de065', 'request_id': 'req-9fb881b4-f036-4e1d-b469-be8ad1123d13'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.879868 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9fb881b4-f036-4e1d-b469-be8ad1123d13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f69042daf9e42e69fc15f10e91de065', 'request_id': 'req-9fb881b4-f036-4e1d-b469-be8ad1123d13'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.900025 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9fb881b4-f036-4e1d-b469-be8ad1123d13 admin admin] The token cache is being invalidate because project 9f69042daf9e42e69fc15f10e91de065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:20.923928 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9fb881b4-f036-4e1d-b469-be8ad1123d13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.925827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9fb881b4-f036-4e1d-b469-be8ad1123d13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:20.935056 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 924/1859] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:20 2022] DELETE /identity/v3/projects/9f69042daf9e42e69fc15f10e91de065 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:20.938081 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb881b4-f036-4e1d-b469-be8ad1123d13 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:20.943471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9fb881b4-f036-4e1d-b469-be8ad1123d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:20.983351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:20.992957 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 936/1860] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:20.992957 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ce14e-82a3-438d-9a16-31e88a0431aa None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:20.992957 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ce14e-82a3-438d-9a16-31e88a0431aa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:20.992957 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ce14e-82a3-438d-9a16-31e88a0431aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:21.017123 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1f4ce14e-82a3-438d-9a16-31e88a0431aa None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:21.028396 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1f4ce14e-82a3-438d-9a16-31e88a0431aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:21.070055 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb881b4-f036-4e1d-b469-be8ad1123d13 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:21.079404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd88f9-1212-4ba6-bb2e-4f8232514366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:21.080308 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd88f9-1212-4ba6-bb2e-4f8232514366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:21.080599 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd88f9-1212-4ba6-bb2e-4f8232514366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:21.080890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd88f9-1212-4ba6-bb2e-4f8232514366 admin admin] PATH_INFO: `/v3/projects/50365000c9d841f998e9e6ea6398523c` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:21.082630 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd88f9-1212-4ba6-bb2e-4f8232514366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50365000c9d841f998e9e6ea6398523c)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:21.085181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd88f9-1212-4ba6-bb2e-4f8232514366 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:21.135089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 937/1861] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:21.135980 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ce14e-82a3-438d-9a16-31e88a0431aa None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:21.137458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1f4ce14e-82a3-438d-9a16-31e88a0431aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:21.154460 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2ddd88f9-1212-4ba6-bb2e-4f8232514366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50365000c9d841f998e9e6ea6398523c', 'request_id': 'req-2ddd88f9-1212-4ba6-bb2e-4f8232514366'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:21.168733 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2ddd88f9-1212-4ba6-bb2e-4f8232514366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50365000c9d841f998e9e6ea6398523c', 'request_id': 'req-2ddd88f9-1212-4ba6-bb2e-4f8232514366'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:21.169416 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:21.181414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2ddd88f9-1212-4ba6-bb2e-4f8232514366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50365000c9d841f998e9e6ea6398523c', 'request_id': 'req-2ddd88f9-1212-4ba6-bb2e-4f8232514366'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:21.212612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2ddd88f9-1212-4ba6-bb2e-4f8232514366 admin admin] The token cache is being invalidate because project 50365000c9d841f998e9e6ea6398523c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:21.212909 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2ddd88f9-1212-4ba6-bb2e-4f8232514366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:21.218937 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2ddd88f9-1212-4ba6-bb2e-4f8232514366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:21.220991 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 925/1862] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:20 2022] DELETE /identity/v3/projects/50365000c9d841f998e9e6ea6398523c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:21.225581 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80284d7-8da0-4cba-9421-0ba2d71b80c4 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:21.225857 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80284d7-8da0-4cba-9421-0ba2d71b80c4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:21.226142 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80284d7-8da0-4cba-9421-0ba2d71b80c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:21.260097 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ce14e-82a3-438d-9a16-31e88a0431aa None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:21.261416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b80284d7-8da0-4cba-9421-0ba2d71b80c4 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:21.262743 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b80284d7-8da0-4cba-9421-0ba2d71b80c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:21.347284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 926/1863] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:21.349132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c6d09-0d36-46a2-aa3f-c394010e452f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:21.349422 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c6d09-0d36-46a2-aa3f-c394010e452f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:21.349708 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c6d09-0d36-46a2-aa3f-c394010e452f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:21.351661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ff55e-8dfa-4cd1-a6f8-d3a8a2ffc8d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:21.352685 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ff55e-8dfa-4cd1-a6f8-d3a8a2ffc8d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:21.353337 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ff55e-8dfa-4cd1-a6f8-d3a8a2ffc8d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:21.353859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ff55e-8dfa-4cd1-a6f8-d3a8a2ffc8d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:21.356801 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-120ff55e-8dfa-4cd1-a6f8-d3a8a2ffc8d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:21.375671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-bb9c6d09-0d36-46a2-aa3f-c394010e452f None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:21.377097 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bb9c6d09-0d36-46a2-aa3f-c394010e452f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:21.394659 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 927/1864] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:21.395795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c6d09-0d36-46a2-aa3f-c394010e452f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:21.413141 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c6d09-0d36-46a2-aa3f-c394010e452f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:21.426734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f47d58-ecf8-4f99-a277-16f51dc55c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:21.429079 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f47d58-ecf8-4f99-a277-16f51dc55c92 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:21.430408 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f47d58-ecf8-4f99-a277-16f51dc55c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:21.431111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f47d58-ecf8-4f99-a277-16f51dc55c92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:21.433059 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f47d58-ecf8-4f99-a277-16f51dc55c92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:21.434145 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f47d58-ecf8-4f99-a277-16f51dc55c92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:21.437794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f47d58-ecf8-4f99-a277-16f51dc55c92 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:21.460307 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 928/1865] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:21.463749 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a81b1-7bbe-4b89-88ec-ff5357147c91 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:21.464969 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a81b1-7bbe-4b89-88ec-ff5357147c91 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:21.466168 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a81b1-7bbe-4b89-88ec-ff5357147c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:21.469226 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ff55e-8dfa-4cd1-a6f8-d3a8a2ffc8d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:21.470969 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ff55e-8dfa-4cd1-a6f8-d3a8a2ffc8d2 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:21.488534 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 938/1866] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:21.490138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ff55e-8dfa-4cd1-a6f8-d3a8a2ffc8d2 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:21.504690 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ff55e-8dfa-4cd1-a6f8-d3a8a2ffc8d2 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:21.509692 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0a6a81b1-7bbe-4b89-88ec-ff5357147c91 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:21.510286 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2df8d7-9345-45cc-901c-550f4f5a912a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:21.511008 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2df8d7-9345-45cc-901c-550f4f5a912a admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:21.511298 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2df8d7-9345-45cc-901c-550f4f5a912a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:21.511583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2df8d7-9345-45cc-901c-550f4f5a912a admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:21.513138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2df8d7-9345-45cc-901c-550f4f5a912a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:21.514280 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0a6a81b1-7bbe-4b89-88ec-ff5357147c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:21.515147 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2df8d7-9345-45cc-901c-550f4f5a912a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:21.543568 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 929/1867] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:21.550394 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a81b1-7bbe-4b89-88ec-ff5357147c91 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:21.562791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 939/1868] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:21 2022] POST /identity/v3/projects => generated 367 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:21.567081 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2df8d7-9345-45cc-901c-550f4f5a912a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:21.574569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a81b1-7bbe-4b89-88ec-ff5357147c91 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:21.622612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:21.742607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75177857-d699-41f6-a488-93bd5cff9180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:21.747047 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75177857-d699-41f6-a488-93bd5cff9180 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:21.748853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75177857-d699-41f6-a488-93bd5cff9180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:21.751416 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2df8d7-9345-45cc-901c-550f4f5a912a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:21.752365 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75177857-d699-41f6-a488-93bd5cff9180 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:21.753613 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75177857-d699-41f6-a488-93bd5cff9180 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:21.753931 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75177857-d699-41f6-a488-93bd5cff9180 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:21.759166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75177857-d699-41f6-a488-93bd5cff9180 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:21.768416 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fa71e-3af6-40b8-804b-e85943ad7eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:21.769102 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fa71e-3af6-40b8-804b-e85943ad7eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:21.769386 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fa71e-3af6-40b8-804b-e85943ad7eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:21.769659 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fa71e-3af6-40b8-804b-e85943ad7eb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:21.770393 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fa71e-3af6-40b8-804b-e85943ad7eb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:21.772301 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fa71e-3af6-40b8-804b-e85943ad7eb7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:21.782349 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 930/1869] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:21.783680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75177857-d699-41f6-a488-93bd5cff9180 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:21.796572 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:21.798946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75177857-d699-41f6-a488-93bd5cff9180 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:21.807964 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf920e1d-30b4-4d77-90ad-2293bbf6d6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:21.808989 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf920e1d-30b4-4d77-90ad-2293bbf6d6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:21.809487 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf920e1d-30b4-4d77-90ad-2293bbf6d6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:21.810179 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf920e1d-30b4-4d77-90ad-2293bbf6d6c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:21.811305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf920e1d-30b4-4d77-90ad-2293bbf6d6c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:21.814260 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf920e1d-30b4-4d77-90ad-2293bbf6d6c9 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:21.818241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 940/1870] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:21 2022] POST /identity/v3/users => generated 284 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:21.819844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fa71e-3af6-40b8-804b-e85943ad7eb7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:21.856474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 931/1871] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:21 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:21.863833 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf920e1d-30b4-4d77-90ad-2293bbf6d6c9 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:21.880999 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fa71e-3af6-40b8-804b-e85943ad7eb7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:22.011097 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac66ba-a827-4606-925f-a3e14d55e100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:22.011811 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac66ba-a827-4606-925f-a3e14d55e100 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.012138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac66ba-a827-4606-925f-a3e14d55e100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.012428 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac66ba-a827-4606-925f-a3e14d55e100 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.013390 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac66ba-a827-4606-925f-a3e14d55e100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:22.018021 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac66ba-a827-4606-925f-a3e14d55e100 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:22.049331 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf920e1d-30b4-4d77-90ad-2293bbf6d6c9 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:22.059729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 941/1872] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:22.066045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac66ba-a827-4606-925f-a3e14d55e100 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:22.067889 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef8769-4b15-4b84-8290-9ac2cd0b7f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:22.068592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef8769-4b15-4b84-8290-9ac2cd0b7f85 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.068879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef8769-4b15-4b84-8290-9ac2cd0b7f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.069157 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef8769-4b15-4b84-8290-9ac2cd0b7f85 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.069857 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef8769-4b15-4b84-8290-9ac2cd0b7f85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:22.077632 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef8769-4b15-4b84-8290-9ac2cd0b7f85 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:22.085221 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac66ba-a827-4606-925f-a3e14d55e100 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:22.116299 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9e758-dbf5-4fe7-8617-ee5a6ce3f0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:22.118556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9e758-dbf5-4fe7-8617-ee5a6ce3f0cc admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.119131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9e758-dbf5-4fe7-8617-ee5a6ce3f0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.119555 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9e758-dbf5-4fe7-8617-ee5a6ce3f0cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.122638 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9e758-dbf5-4fe7-8617-ee5a6ce3f0cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:22.128279 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 932/1873] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:21 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:22.129653 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef8769-4b15-4b84-8290-9ac2cd0b7f85 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:22.135408 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9e758-dbf5-4fe7-8617-ee5a6ce3f0cc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:22.153891 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef8769-4b15-4b84-8290-9ac2cd0b7f85 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:22.167865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805334b-231f-421c-9c2a-36b5255f00ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:22.168695 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805334b-231f-421c-9c2a-36b5255f00ff admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.168916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805334b-231f-421c-9c2a-36b5255f00ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.169191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805334b-231f-421c-9c2a-36b5255f00ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.172449 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805334b-231f-421c-9c2a-36b5255f00ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:22.174136 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805334b-231f-421c-9c2a-36b5255f00ff admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:22.179981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 942/1874] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:22.183486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9e758-dbf5-4fe7-8617-ee5a6ce3f0cc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:22.203722 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 933/1875] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:25:22.206129 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9e758-dbf5-4fe7-8617-ee5a6ce3f0cc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:22.206590 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805334b-231f-421c-9c2a-36b5255f00ff admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:22.212152 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52319c8-7afb-464e-a3d7-7c08b9a9324a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:22.213077 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52319c8-7afb-464e-a3d7-7c08b9a9324a admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.213362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52319c8-7afb-464e-a3d7-7c08b9a9324a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.213641 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52319c8-7afb-464e-a3d7-7c08b9a9324a admin admin] PATH_INFO: `/v3/projects/dc9286e73f6c4150b5f06673890f1ba0/users/eb80d522c1f54387b33e32e641f7fbc5/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.220645 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805334b-231f-421c-9c2a-36b5255f00ff admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:22.225959 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f126f1-c9a0-4098-b665-9238199383c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:22.226851 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f126f1-c9a0-4098-b665-9238199383c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.227151 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f126f1-c9a0-4098-b665-9238199383c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.227434 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f126f1-c9a0-4098-b665-9238199383c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.228167 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f126f1-c9a0-4098-b665-9238199383c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:22.229992 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52319c8-7afb-464e-a3d7-7c08b9a9324a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc9286e73f6c4150b5f06673890f1ba0, user_id=eb80d522c1f54387b33e32e641f7fbc5, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:22.230132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f126f1-c9a0-4098-b665-9238199383c7 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:22.233721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52319c8-7afb-464e-a3d7-7c08b9a9324a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:22.247994 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 934/1876] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:22.249684 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f126f1-c9a0-4098-b665-9238199383c7 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:22.252278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 943/1877] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:22 2022] PUT /identity/v3/projects/dc9286e73f6c4150b5f06673890f1ba0/users/eb80d522c1f54387b33e32e641f7fbc5/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:22.261519 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f126f1-c9a0-4098-b665-9238199383c7 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:22.264711 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230d19d-0924-4a4f-8ae8-7bb1466db385 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.265008 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230d19d-0924-4a4f-8ae8-7bb1466db385 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.265291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230d19d-0924-4a4f-8ae8-7bb1466db385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.301090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5230d19d-0924-4a4f-8ae8-7bb1466db385 None None] MFA Rules not processed for user `eb80d522c1f54387b33e32e641f7fbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:22.302597 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5230d19d-0924-4a4f-8ae8-7bb1466db385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:22.351956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:22.369811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cbd3c-f148-4c1e-b902-0553f287c580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:22.372630 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cbd3c-f148-4c1e-b902-0553f287c580 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.373406 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cbd3c-f148-4c1e-b902-0553f287c580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.374750 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cbd3c-f148-4c1e-b902-0553f287c580 admin admin] PATH_INFO: `/v3/projects/e015c1a4a7224635a150c5a619b6c54c/users/47d9ac536aaa4e80ac3323aaecc024b5/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.401948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 944/1878] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:22.403833 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230d19d-0924-4a4f-8ae8-7bb1466db385 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:22.406058 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5230d19d-0924-4a4f-8ae8-7bb1466db385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:22.409099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89cbd3c-f148-4c1e-b902-0553f287c580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e015c1a4a7224635a150c5a619b6c54c, user_id=47d9ac536aaa4e80ac3323aaecc024b5, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:22.412479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89cbd3c-f148-4c1e-b902-0553f287c580 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:22.420854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230d19d-0924-4a4f-8ae8-7bb1466db385 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:22.426495 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4737dec-c537-443d-9d57-dea6cf3a2bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:22.427905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4737dec-c537-443d-9d57-dea6cf3a2bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.428189 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4737dec-c537-443d-9d57-dea6cf3a2bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.428465 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4737dec-c537-443d-9d57-dea6cf3a2bc4 admin admin] PATH_INFO: `/v3/users/0fa4f65a6d1a41429155d291673b4a0c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.430018 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4737dec-c537-443d-9d57-dea6cf3a2bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fa4f65a6d1a41429155d291673b4a0c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:22.430428 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 935/1879] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:22 2022] PUT /identity/v3/projects/e015c1a4a7224635a150c5a619b6c54c/users/47d9ac536aaa4e80ac3323aaecc024b5/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:22.431655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cbd3c-f148-4c1e-b902-0553f287c580 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:22.432830 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4737dec-c537-443d-9d57-dea6cf3a2bc4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:22.493623 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:22.503945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f4737dec-c537-443d-9d57-dea6cf3a2bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fa4f65a6d1a41429155d291673b4a0c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:22.510500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cbd3c-f148-4c1e-b902-0553f287c580 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:22.511259 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f4737dec-c537-443d-9d57-dea6cf3a2bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fa4f65a6d1a41429155d291673b4a0c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:22.515707 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ec12f-f4b3-4159-9dec-bc55ec32629f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:22.516367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ec12f-f4b3-4159-9dec-bc55ec32629f admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.516765 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ec12f-f4b3-4159-9dec-bc55ec32629f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.517026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ec12f-f4b3-4159-9dec-bc55ec32629f admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.517714 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ec12f-f4b3-4159-9dec-bc55ec32629f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:22.519787 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ec12f-f4b3-4159-9dec-bc55ec32629f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:22.526674 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f4737dec-c537-443d-9d57-dea6cf3a2bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fa4f65a6d1a41429155d291673b4a0c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:22.535511 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f4737dec-c537-443d-9d57-dea6cf3a2bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fa4f65a6d1a41429155d291673b4a0c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:22.536480 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f4737dec-c537-443d-9d57-dea6cf3a2bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fa4f65a6d1a41429155d291673b4a0c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:22.543114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 945/1880] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:22 2022] DELETE /identity/v3/users/0fa4f65a6d1a41429155d291673b4a0c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:22.544760 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816f69b-51ef-495e-83de-3d7316a967fa None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.545060 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816f69b-51ef-495e-83de-3d7316a967fa None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.545372 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816f69b-51ef-495e-83de-3d7316a967fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.548904 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 936/1881] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:22 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:22.550542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe39e5-16c4-4c39-96f5-4237acc37a4c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.551075 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe39e5-16c4-4c39-96f5-4237acc37a4c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.551379 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe39e5-16c4-4c39-96f5-4237acc37a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.571407 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-cfbe39e5-16c4-4c39-96f5-4237acc37a4c None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:22.572730 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cfbe39e5-16c4-4c39-96f5-4237acc37a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:22.573340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2816f69b-51ef-495e-83de-3d7316a967fa None None] MFA Rules not processed for user `47d9ac536aaa4e80ac3323aaecc024b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:22.574618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2816f69b-51ef-495e-83de-3d7316a967fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:22.643590 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 937/1882] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:22.644550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe39e5-16c4-4c39-96f5-4237acc37a4c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:22.645958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cfbe39e5-16c4-4c39-96f5-4237acc37a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:22.650751 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 946/1883] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:22.653423 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816f69b-51ef-495e-83de-3d7316a967fa None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:22.659591 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2816f69b-51ef-495e-83de-3d7316a967fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:22.668390 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe39e5-16c4-4c39-96f5-4237acc37a4c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:22.673386 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c24dc-cf5d-4092-9bf7-1c6ea475fadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:22.674072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c24dc-cf5d-4092-9bf7-1c6ea475fadc admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.674529 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c24dc-cf5d-4092-9bf7-1c6ea475fadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.674977 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c24dc-cf5d-4092-9bf7-1c6ea475fadc admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.675728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c24dc-cf5d-4092-9bf7-1c6ea475fadc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:22.677713 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c24dc-cf5d-4092-9bf7-1c6ea475fadc admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:22.707293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 938/1884] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:22 2022] POST /identity/v3/users => generated 290 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:22.708660 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c24dc-cf5d-4092-9bf7-1c6ea475fadc admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:22.710966 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-da5c24dc-cf5d-4092-9bf7-1c6ea475fadc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:22.724237 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c24dc-cf5d-4092-9bf7-1c6ea475fadc admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:22.730002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60db60-41d1-4ade-ae16-3dcd6d3f7e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:22.730706 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60db60-41d1-4ade-ae16-3dcd6d3f7e03 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.730994 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60db60-41d1-4ade-ae16-3dcd6d3f7e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.731273 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60db60-41d1-4ade-ae16-3dcd6d3f7e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.731970 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60db60-41d1-4ade-ae16-3dcd6d3f7e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:22.733624 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816f69b-51ef-495e-83de-3d7316a967fa None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:22.734055 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60db60-41d1-4ade-ae16-3dcd6d3f7e03 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:22.737612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dad4a1-bf45-431e-9ec4-d4c2d9a02ad5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:22.738605 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dad4a1-bf45-431e-9ec4-d4c2d9a02ad5 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.738605 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dad4a1-bf45-431e-9ec4-d4c2d9a02ad5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.738884 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dad4a1-bf45-431e-9ec4-d4c2d9a02ad5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.756399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dad4a1-bf45-431e-9ec4-d4c2d9a02ad5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:22.758232 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dad4a1-bf45-431e-9ec4-d4c2d9a02ad5 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:22.770692 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 939/1885] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:22 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:22.770692 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60db60-41d1-4ade-ae16-3dcd6d3f7e03 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:22.770984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 947/1886] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:25:22.772118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dad4a1-bf45-431e-9ec4-d4c2d9a02ad5 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:22.786552 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dad4a1-bf45-431e-9ec4-d4c2d9a02ad5 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:22.820202 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:22.859777 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:22.884665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa9763-4852-4b23-84a9-472e933c363a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:22.885616 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa9763-4852-4b23-84a9-472e933c363a admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.886013 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa9763-4852-4b23-84a9-472e933c363a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.886578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa9763-4852-4b23-84a9-472e933c363a admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.887853 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa9763-4852-4b23-84a9-472e933c363a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:22.891396 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caa9763-4852-4b23-84a9-472e933c363a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:22.897877 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60db60-41d1-4ade-ae16-3dcd6d3f7e03 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:22.906639 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52728247-ca20-4572-8fdc-64afbc8c48d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:22.910266 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52728247-ca20-4572-8fdc-64afbc8c48d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.913101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52728247-ca20-4572-8fdc-64afbc8c48d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.913513 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52728247-ca20-4572-8fdc-64afbc8c48d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.914924 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52728247-ca20-4572-8fdc-64afbc8c48d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:22.917348 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52728247-ca20-4572-8fdc-64afbc8c48d4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:22.921044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 948/1887] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:22 2022] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:22.922266 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa9763-4852-4b23-84a9-472e933c363a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:22.940403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caa9763-4852-4b23-84a9-472e933c363a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:22.944372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 940/1888] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:22.946059 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52728247-ca20-4572-8fdc-64afbc8c48d4 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:22.948282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47c70f-4574-4929-a866-9871eeaf2c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:22.949382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47c70f-4574-4929-a866-9871eeaf2c63 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.949501 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47c70f-4574-4929-a866-9871eeaf2c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.949693 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47c70f-4574-4929-a866-9871eeaf2c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.950480 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47c70f-4574-4929-a866-9871eeaf2c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:22.954342 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47c70f-4574-4929-a866-9871eeaf2c63 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:22.962546 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52728247-ca20-4572-8fdc-64afbc8c48d4 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:22.972431 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3f170-f5da-417b-b752-57dc52cad17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:22.974169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3f170-f5da-417b-b752-57dc52cad17e admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:22.974484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3f170-f5da-417b-b752-57dc52cad17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:22.974769 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3f170-f5da-417b-b752-57dc52cad17e admin admin] PATH_INFO: `/v3/projects/13d58cac52014fc797298a999143cde4/users/6c7ab23787044429855e80c20a71e255/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:22.977752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 949/1889] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:25:22.981706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47c70f-4574-4929-a866-9871eeaf2c63 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:22.994471 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47c70f-4574-4929-a866-9871eeaf2c63 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:23.002404 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a28fb-a3eb-49f6-95a4-1e44f8ac8610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:23.003326 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a28fb-a3eb-49f6-95a4-1e44f8ac8610 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:23.003616 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a28fb-a3eb-49f6-95a4-1e44f8ac8610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:23.003897 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a28fb-a3eb-49f6-95a4-1e44f8ac8610 admin admin] PATH_INFO: `/v3/projects/e48f2df340384ff881c12eedcf17afb6/users/4c555a6c90824a40af0bcd3a68e7788a/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:23.009177 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3f170-f5da-417b-b752-57dc52cad17e admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d58cac52014fc797298a999143cde4, user_id=6c7ab23787044429855e80c20a71e255, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:23.013895 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f3f170-f5da-417b-b752-57dc52cad17e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:23.029332 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a28fb-a3eb-49f6-95a4-1e44f8ac8610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e48f2df340384ff881c12eedcf17afb6, user_id=4c555a6c90824a40af0bcd3a68e7788a, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:23.034808 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a28fb-a3eb-49f6-95a4-1e44f8ac8610 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:23.051136 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 941/1890] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:22 2022] PUT /identity/v3/projects/13d58cac52014fc797298a999143cde4/users/6c7ab23787044429855e80c20a71e255/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:23.054939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3f170-f5da-417b-b752-57dc52cad17e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:23.067540 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 950/1891] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:22 2022] PUT /identity/v3/projects/e48f2df340384ff881c12eedcf17afb6/users/4c555a6c90824a40af0bcd3a68e7788a/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:23.072296 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a28fb-a3eb-49f6-95a4-1e44f8ac8610 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:23.146935 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3f170-f5da-417b-b752-57dc52cad17e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:23.178558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a28fb-a3eb-49f6-95a4-1e44f8ac8610 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:23.211111 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839ce6d-cfd3-4802-a51e-221ccd295677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:23.212424 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839ce6d-cfd3-4802-a51e-221ccd295677 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:23.212892 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839ce6d-cfd3-4802-a51e-221ccd295677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:23.213386 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839ce6d-cfd3-4802-a51e-221ccd295677 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:23.214552 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839ce6d-cfd3-4802-a51e-221ccd295677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:23.218614 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839ce6d-cfd3-4802-a51e-221ccd295677 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:23.244540 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f47f63-1526-4c79-8e83-ccd30c08091e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:23.245400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f47f63-1526-4c79-8e83-ccd30c08091e admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:23.245854 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f47f63-1526-4c79-8e83-ccd30c08091e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:23.246142 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f47f63-1526-4c79-8e83-ccd30c08091e admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:23.247654 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f47f63-1526-4c79-8e83-ccd30c08091e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:23.249952 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f47f63-1526-4c79-8e83-ccd30c08091e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:23.254216 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 951/1892] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:23.255462 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839ce6d-cfd3-4802-a51e-221ccd295677 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:23.261415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8839ce6d-cfd3-4802-a51e-221ccd295677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:23.273979 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 942/1893] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:25:23.274922 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f47f63-1526-4c79-8e83-ccd30c08091e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:23.275981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839ce6d-cfd3-4802-a51e-221ccd295677 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:23.291629 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f11fdb-1add-402d-8bb3-01be4fad4ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:23.292845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f11fdb-1add-402d-8bb3-01be4fad4ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:23.293316 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f11fdb-1add-402d-8bb3-01be4fad4ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:23.293894 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f11fdb-1add-402d-8bb3-01be4fad4ac3 admin admin] PATH_INFO: `/v3/projects/c8b5a65a23fa47b8b8f6486f04c40a05` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:23.294771 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f47f63-1526-4c79-8e83-ccd30c08091e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:23.296351 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f11fdb-1add-402d-8bb3-01be4fad4ac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8b5a65a23fa47b8b8f6486f04c40a05)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:23.298684 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f11fdb-1add-402d-8bb3-01be4fad4ac3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:23.306596 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba9c77-b701-476b-9767-bfe574b5aca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:23.308270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba9c77-b701-476b-9767-bfe574b5aca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:23.308769 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba9c77-b701-476b-9767-bfe574b5aca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:23.309220 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba9c77-b701-476b-9767-bfe574b5aca2 admin admin] PATH_INFO: `/v3/projects/e48f2df340384ff881c12eedcf17afb6/users/4c555a6c90824a40af0bcd3a68e7788a/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:23.313621 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba9c77-b701-476b-9767-bfe574b5aca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e48f2df340384ff881c12eedcf17afb6, user_id=4c555a6c90824a40af0bcd3a68e7788a, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:23.320696 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba9c77-b701-476b-9767-bfe574b5aca2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:23.346488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 943/1894] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:23 2022] PUT /identity/v3/projects/e48f2df340384ff881c12eedcf17afb6/users/4c555a6c90824a40af0bcd3a68e7788a/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:23.346488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba9c77-b701-476b-9767-bfe574b5aca2 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:23.356365 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-64f11fdb-1add-402d-8bb3-01be4fad4ac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8b5a65a23fa47b8b8f6486f04c40a05', 'request_id': 'req-64f11fdb-1add-402d-8bb3-01be4fad4ac3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:23.369188 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-64f11fdb-1add-402d-8bb3-01be4fad4ac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8b5a65a23fa47b8b8f6486f04c40a05', 'request_id': 'req-64f11fdb-1add-402d-8bb3-01be4fad4ac3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:23.381082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-64f11fdb-1add-402d-8bb3-01be4fad4ac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8b5a65a23fa47b8b8f6486f04c40a05', 'request_id': 'req-64f11fdb-1add-402d-8bb3-01be4fad4ac3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:23.391898 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:23.396051 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-64f11fdb-1add-402d-8bb3-01be4fad4ac3 admin admin] The token cache is being invalidate because project c8b5a65a23fa47b8b8f6486f04c40a05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:23.396051 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-64f11fdb-1add-402d-8bb3-01be4fad4ac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:23.396731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-64f11fdb-1add-402d-8bb3-01be4fad4ac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:23.400382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 952/1895] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:23 2022] DELETE /identity/v3/projects/c8b5a65a23fa47b8b8f6486f04c40a05 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:23.400382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9d49e-e495-45ef-a581-ccbc22021b3f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:23.400382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9d49e-e495-45ef-a581-ccbc22021b3f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:23.400382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9d49e-e495-45ef-a581-ccbc22021b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:23.432859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-29d9d49e-e495-45ef-a581-ccbc22021b3f None None] MFA Rules not processed for user `4c555a6c90824a40af0bcd3a68e7788a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:23.434078 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-29d9d49e-e495-45ef-a581-ccbc22021b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:23.442294 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba9c77-b701-476b-9767-bfe574b5aca2 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:23.446278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:23.507374 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cfab5-ced3-4be6-8ebd-2541d8842b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:23.509097 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cfab5-ced3-4be6-8ebd-2541d8842b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:23.509097 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cfab5-ced3-4be6-8ebd-2541d8842b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:23.509536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cfab5-ced3-4be6-8ebd-2541d8842b8c admin admin] PATH_INFO: `/v3/projects/13d58cac52014fc797298a999143cde4/users/6c7ab23787044429855e80c20a71e255/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:23.511752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cfab5-ced3-4be6-8ebd-2541d8842b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d58cac52014fc797298a999143cde4, user_id=6c7ab23787044429855e80c20a71e255, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:23.514535 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cfab5-ced3-4be6-8ebd-2541d8842b8c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:23.523343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 953/1896] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:23.524585 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9d49e-e495-45ef-a581-ccbc22021b3f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:23.525989 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-29d9d49e-e495-45ef-a581-ccbc22021b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:23.541662 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 944/1897] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:23 2022] PUT /identity/v3/projects/13d58cac52014fc797298a999143cde4/users/6c7ab23787044429855e80c20a71e255/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:23.542845 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cfab5-ced3-4be6-8ebd-2541d8842b8c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:23.549279 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9d49e-e495-45ef-a581-ccbc22021b3f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:23.554672 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-836cfab5-ced3-4be6-8ebd-2541d8842b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:23.619484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafd215-2692-418e-840f-87aa6cc2e469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:23.620655 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafd215-2692-418e-840f-87aa6cc2e469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:23.620949 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafd215-2692-418e-840f-87aa6cc2e469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:23.621236 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fafd215-2692-418e-840f-87aa6cc2e469 admin admin] PATH_INFO: `/v3/users/f30f4affd5424d60b02c224208279671` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:23.624368 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafd215-2692-418e-840f-87aa6cc2e469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f30f4affd5424d60b02c224208279671)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:23.627558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fafd215-2692-418e-840f-87aa6cc2e469 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:23.635880 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cfab5-ced3-4be6-8ebd-2541d8842b8c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:23.641020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245c083-d76d-4730-afe2-978b11d376e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:23.641776 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245c083-d76d-4730-afe2-978b11d376e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:23.642179 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245c083-d76d-4730-afe2-978b11d376e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:23.642567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245c083-d76d-4730-afe2-978b11d376e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:23.644907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1245c083-d76d-4730-afe2-978b11d376e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:23.694029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4fafd215-2692-418e-840f-87aa6cc2e469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f30f4affd5424d60b02c224208279671'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:23.704897 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4fafd215-2692-418e-840f-87aa6cc2e469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f30f4affd5424d60b02c224208279671'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:23.720230 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4fafd215-2692-418e-840f-87aa6cc2e469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f30f4affd5424d60b02c224208279671'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:23.726906 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245c083-d76d-4730-afe2-978b11d376e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:23.728723 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245c083-d76d-4730-afe2-978b11d376e0 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:23.731671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4fafd215-2692-418e-840f-87aa6cc2e469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f30f4affd5424d60b02c224208279671'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:23.732402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4fafd215-2692-418e-840f-87aa6cc2e469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f30f4affd5424d60b02c224208279671'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:23.739657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 945/1898] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:23.740195 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 954/1899] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:23 2022] DELETE /identity/v3/users/f30f4affd5424d60b02c224208279671 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:23.740980 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdb80b-f2b1-489c-88a8-92efc585f550 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:23.742082 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdb80b-f2b1-489c-88a8-92efc585f550 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:23.742082 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdb80b-f2b1-489c-88a8-92efc585f550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:23.772928 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-90bdb80b-f2b1-489c-88a8-92efc585f550 None None] MFA Rules not processed for user `6c7ab23787044429855e80c20a71e255`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:23.774209 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-90bdb80b-f2b1-489c-88a8-92efc585f550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:23.792614 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:23.880999 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 946/1900] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:23 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:23.893974 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafd215-2692-418e-840f-87aa6cc2e469 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:23.896712 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4fafd215-2692-418e-840f-87aa6cc2e469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:23.952129 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:24.008801 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fafd215-2692-418e-840f-87aa6cc2e469 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:24.013344 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b181ed8-f2c5-47da-825b-51d3f5a34bdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:24.014958 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b181ed8-f2c5-47da-825b-51d3f5a34bdc service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:24.015487 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b181ed8-f2c5-47da-825b-51d3f5a34bdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:24.015919 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b181ed8-f2c5-47da-825b-51d3f5a34bdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:24.033677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b181ed8-f2c5-47da-825b-51d3f5a34bdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:24.036094 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b181ed8-f2c5-47da-825b-51d3f5a34bdc service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:24.048286 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 955/1901] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:23 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:24.133858 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdb80b-f2b1-489c-88a8-92efc585f550 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:24.137102 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b181ed8-f2c5-47da-825b-51d3f5a34bdc service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:24.138964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8b181ed8-f2c5-47da-825b-51d3f5a34bdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:24.149976 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdb80b-f2b1-489c-88a8-92efc585f550 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:24.154634 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b4ed1-a695-4633-83ab-b1814d405698 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:24.155494 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b4ed1-a695-4633-83ab-b1814d405698 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:24.156209 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b4ed1-a695-4633-83ab-b1814d405698 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:24.156833 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b4ed1-a695-4633-83ab-b1814d405698 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:24.159113 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c05b4ed1-a695-4633-83ab-b1814d405698 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:24.259131 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b4ed1-a695-4633-83ab-b1814d405698 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:24.260650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b4ed1-a695-4633-83ab-b1814d405698 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:24.272752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 947/1902] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:24 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:24.281967 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b181ed8-f2c5-47da-825b-51d3f5a34bdc service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:24.287682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ef903-a132-4879-ad6c-96d9b47f9cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:24.288634 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ef903-a132-4879-ad6c-96d9b47f9cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:24.289289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ef903-a132-4879-ad6c-96d9b47f9cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:24.289637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ef903-a132-4879-ad6c-96d9b47f9cda admin admin] PATH_INFO: `/v3/projects/a1ba08ba77004a11995d7522256fa56c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:24.290973 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ef903-a132-4879-ad6c-96d9b47f9cda admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1ba08ba77004a11995d7522256fa56c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:24.292921 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ef903-a132-4879-ad6c-96d9b47f9cda admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:24.355590 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ac9ef903-a132-4879-ad6c-96d9b47f9cda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1ba08ba77004a11995d7522256fa56c', 'request_id': 'req-ac9ef903-a132-4879-ad6c-96d9b47f9cda'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:24.363936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ac9ef903-a132-4879-ad6c-96d9b47f9cda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1ba08ba77004a11995d7522256fa56c', 'request_id': 'req-ac9ef903-a132-4879-ad6c-96d9b47f9cda'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:24.374089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ac9ef903-a132-4879-ad6c-96d9b47f9cda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1ba08ba77004a11995d7522256fa56c', 'request_id': 'req-ac9ef903-a132-4879-ad6c-96d9b47f9cda'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:24.386362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ac9ef903-a132-4879-ad6c-96d9b47f9cda admin admin] The token cache is being invalidate because project a1ba08ba77004a11995d7522256fa56c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:24.386624 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ac9ef903-a132-4879-ad6c-96d9b47f9cda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:24.387382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ac9ef903-a132-4879-ad6c-96d9b47f9cda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:24.392883 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 956/1903] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:24 2022] DELETE /identity/v3/projects/a1ba08ba77004a11995d7522256fa56c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:24.395294 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4487508-ea8c-4946-a25f-1796a548a3a1 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:24.395761 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4487508-ea8c-4946-a25f-1796a548a3a1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:24.396127 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4487508-ea8c-4946-a25f-1796a548a3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:24.422449 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b4487508-ea8c-4946-a25f-1796a548a3a1 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:24.424028 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b4487508-ea8c-4946-a25f-1796a548a3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:24.537365 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 948/1904] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:24.539295 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3c023-b888-4ffa-b3e1-9ecf30c0b22a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:24.539585 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3c023-b888-4ffa-b3e1-9ecf30c0b22a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:24.539882 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3c023-b888-4ffa-b3e1-9ecf30c0b22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:24.588558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8cb3c023-b888-4ffa-b3e1-9ecf30c0b22a None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:24.589828 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8cb3c023-b888-4ffa-b3e1-9ecf30c0b22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:24.617840 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 957/1905] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:24.618183 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4487508-ea8c-4946-a25f-1796a548a3a1 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:24.628990 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4487508-ea8c-4946-a25f-1796a548a3a1 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:24.635688 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8c34e-940e-4396-8469-09c16a6be65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:24.636378 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8c34e-940e-4396-8469-09c16a6be65b admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:24.636769 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8c34e-940e-4396-8469-09c16a6be65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:24.637054 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8c34e-940e-4396-8469-09c16a6be65b admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:24.637939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8c34e-940e-4396-8469-09c16a6be65b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:24.638110 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8c34e-940e-4396-8469-09c16a6be65b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:24.641282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8c34e-940e-4396-8469-09c16a6be65b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:24.671151 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3c023-b888-4ffa-b3e1-9ecf30c0b22a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:24.671367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 949/1906] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:24.683410 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3c023-b888-4ffa-b3e1-9ecf30c0b22a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:24.691509 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ba8eb-04d0-479a-b516-ef4d5a300072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:24.692792 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ba8eb-04d0-479a-b516-ef4d5a300072 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:24.693216 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ba8eb-04d0-479a-b516-ef4d5a300072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:24.693642 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ba8eb-04d0-479a-b516-ef4d5a300072 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:24.695081 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ba8eb-04d0-479a-b516-ef4d5a300072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:24.697431 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ba8eb-04d0-479a-b516-ef4d5a300072 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:24.744116 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 958/1907] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:24 2022] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:24.747889 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8c34e-940e-4396-8469-09c16a6be65b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:24.760587 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90ea36-19d4-4f4b-a14e-bfc3d1748bbc None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:24.761209 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90ea36-19d4-4f4b-a14e-bfc3d1748bbc None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:24.761822 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90ea36-19d4-4f4b-a14e-bfc3d1748bbc None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:24.763898 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 959/1908] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 20 19:25:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:25:24.768305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8c34e-940e-4396-8469-09c16a6be65b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:24.804714 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80d801-c8da-4510-b185-5daaf699cc21 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:24.805151 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80d801-c8da-4510-b185-5daaf699cc21 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:24.805534 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80d801-c8da-4510-b185-5daaf699cc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:24.825268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:24.839197 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9b80d801-c8da-4510-b185-5daaf699cc21 None None] MFA Rules not processed for user `a1f0f6bc94de4645a8c82038ff2bd34a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:24.840646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9b80d801-c8da-4510-b185-5daaf699cc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:24.862283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a1a7a-594f-4016-be48-33d93de9ad9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:24.863117 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a1a7a-594f-4016-be48-33d93de9ad9f admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:24.863502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a1a7a-594f-4016-be48-33d93de9ad9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:24.863879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a1a7a-594f-4016-be48-33d93de9ad9f admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:24.864798 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a1a7a-594f-4016-be48-33d93de9ad9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:24.866936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a1a7a-594f-4016-be48-33d93de9ad9f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:24.869989 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:24.908794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 950/1909] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:24 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:24.908794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a1a7a-594f-4016-be48-33d93de9ad9f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:24.916045 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a1a7a-594f-4016-be48-33d93de9ad9f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:24.921154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985c87d-633a-45c6-a9ad-2b3e4eefe686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:24.921819 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985c87d-633a-45c6-a9ad-2b3e4eefe686 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:24.922107 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985c87d-633a-45c6-a9ad-2b3e4eefe686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:24.922412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985c87d-633a-45c6-a9ad-2b3e4eefe686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:24.926331 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985c87d-633a-45c6-a9ad-2b3e4eefe686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:24.926331 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985c87d-633a-45c6-a9ad-2b3e4eefe686 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:24.926542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 960/1910] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 20 19:25:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:24.937979 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 951/1911] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:24.939622 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80d801-c8da-4510-b185-5daaf699cc21 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:24.941014 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9b80d801-c8da-4510-b185-5daaf699cc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:24.942015 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985c87d-633a-45c6-a9ad-2b3e4eefe686 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:24.951937 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985c87d-633a-45c6-a9ad-2b3e4eefe686 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:24.954926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80d801-c8da-4510-b185-5daaf699cc21 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:24.957527 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f8b95-8965-44b4-b133-7e804237b29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:24.958180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f8b95-8965-44b4-b133-7e804237b29e admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:24.958514 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f8b95-8965-44b4-b133-7e804237b29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:24.958907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f8b95-8965-44b4-b133-7e804237b29e admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:24.959641 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f8b95-8965-44b4-b133-7e804237b29e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:24.961177 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf84eb-5eaa-438e-8acd-0c422e2006dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:24.961319 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f8b95-8965-44b4-b133-7e804237b29e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:24.961973 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf84eb-5eaa-438e-8acd-0c422e2006dd service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:24.962294 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf84eb-5eaa-438e-8acd-0c422e2006dd service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:24.962642 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf84eb-5eaa-438e-8acd-0c422e2006dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:24.972618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf84eb-5eaa-438e-8acd-0c422e2006dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:24.973196 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 952/1912] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:24.974200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf84eb-5eaa-438e-8acd-0c422e2006dd service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:24.976935 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f8b95-8965-44b4-b133-7e804237b29e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:24.987327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 961/1913] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:24.987593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f8b95-8965-44b4-b133-7e804237b29e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:24.993425 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd93ba6-af44-4662-af03-01f21c4aeb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:24.993628 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd93ba6-af44-4662-af03-01f21c4aeb25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:24.993926 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd93ba6-af44-4662-af03-01f21c4aeb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:24.994339 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd93ba6-af44-4662-af03-01f21c4aeb25 admin admin] PATH_INFO: `/v3/projects/726bd27faf5f4e6c9f0b398c281c103f/users/b3ceca9590f14b708b457d2e84678dcd/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:25.009844 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd93ba6-af44-4662-af03-01f21c4aeb25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=726bd27faf5f4e6c9f0b398c281c103f, user_id=b3ceca9590f14b708b457d2e84678dcd, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:25.012647 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd93ba6-af44-4662-af03-01f21c4aeb25 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:25.026454 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 953/1914] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:24 2022] PUT /identity/v3/projects/726bd27faf5f4e6c9f0b398c281c103f/users/b3ceca9590f14b708b457d2e84678dcd/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:25.038272 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961430fa-a2d9-4800-baaf-2e4bd1b1f0ce None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:25.038559 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961430fa-a2d9-4800-baaf-2e4bd1b1f0ce None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:25.038843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961430fa-a2d9-4800-baaf-2e4bd1b1f0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:25.066053 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-961430fa-a2d9-4800-baaf-2e4bd1b1f0ce None None] MFA Rules not processed for user `b3ceca9590f14b708b457d2e84678dcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:25.067394 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-961430fa-a2d9-4800-baaf-2e4bd1b1f0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:25.135764 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 962/1915] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:25.140923 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd93ba6-af44-4662-af03-01f21c4aeb25 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:25.212205 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd93ba6-af44-4662-af03-01f21c4aeb25 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:25.218133 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77a88b-35e0-49e1-8d0c-f94bdee05c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:25.218878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77a88b-35e0-49e1-8d0c-f94bdee05c50 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:25.219167 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77a88b-35e0-49e1-8d0c-f94bdee05c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:25.219441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77a88b-35e0-49e1-8d0c-f94bdee05c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:25.220147 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77a88b-35e0-49e1-8d0c-f94bdee05c50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:25.222174 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77a88b-35e0-49e1-8d0c-f94bdee05c50 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:25.240709 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961430fa-a2d9-4800-baaf-2e4bd1b1f0ce None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:25.244306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-961430fa-a2d9-4800-baaf-2e4bd1b1f0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:25.250367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 954/1916] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:25 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:25.254245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77a88b-35e0-49e1-8d0c-f94bdee05c50 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:25.336107 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961430fa-a2d9-4800-baaf-2e4bd1b1f0ce None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:25.337410 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77a88b-35e0-49e1-8d0c-f94bdee05c50 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:25.342974 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2701d6-2768-400d-9ba5-a39da223b0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:25.343994 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2701d6-2768-400d-9ba5-a39da223b0fb admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:25.344471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2701d6-2768-400d-9ba5-a39da223b0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:25.344954 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2701d6-2768-400d-9ba5-a39da223b0fb admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:25.345836 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2701d6-2768-400d-9ba5-a39da223b0fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:25.349324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2701d6-2768-400d-9ba5-a39da223b0fb admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:25.360582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:25.396387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 955/1917] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:25 2022] POST /identity/v3/users => generated 295 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:25.398048 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2701d6-2768-400d-9ba5-a39da223b0fb admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:25.415029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a2556-1ce7-4110-b12b-2d718cdbc4e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:25.416717 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2701d6-2768-400d-9ba5-a39da223b0fb admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:25.417807 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a2556-1ce7-4110-b12b-2d718cdbc4e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:25.418096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a2556-1ce7-4110-b12b-2d718cdbc4e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:25.418401 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a2556-1ce7-4110-b12b-2d718cdbc4e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:25.422424 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b53a2556-1ce7-4110-b12b-2d718cdbc4e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:25.426289 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23baf72-90be-4c90-ae8c-af58249da2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:25.426992 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23baf72-90be-4c90-ae8c-af58249da2ce admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:25.427277 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23baf72-90be-4c90-ae8c-af58249da2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:25.427557 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23baf72-90be-4c90-ae8c-af58249da2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:25.428944 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23baf72-90be-4c90-ae8c-af58249da2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:25.430579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23baf72-90be-4c90-ae8c-af58249da2ce admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:25.436598 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:25.468439 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 956/1918] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:25:25.473619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23baf72-90be-4c90-ae8c-af58249da2ce admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:25.490076 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23baf72-90be-4c90-ae8c-af58249da2ce admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:25.495775 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2f277-e978-4e2a-bef3-e5db1646a8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:25.496954 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2f277-e978-4e2a-bef3-e5db1646a8a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:25.497240 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2f277-e978-4e2a-bef3-e5db1646a8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:25.497519 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2f277-e978-4e2a-bef3-e5db1646a8a4 admin admin] PATH_INFO: `/v3/projects/3e49535faa7c446d9334809923c1fedb/users/6b75c266621d4ab498c7b11aa19ff875/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:25.533487 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2f277-e978-4e2a-bef3-e5db1646a8a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e49535faa7c446d9334809923c1fedb, user_id=6b75c266621d4ab498c7b11aa19ff875, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:25.538738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2f277-e978-4e2a-bef3-e5db1646a8a4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:25.563895 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 957/1919] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:25 2022] PUT /identity/v3/projects/3e49535faa7c446d9334809923c1fedb/users/6b75c266621d4ab498c7b11aa19ff875/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:25.565082 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2f277-e978-4e2a-bef3-e5db1646a8a4 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:25.571449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a2556-1ce7-4110-b12b-2d718cdbc4e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:25.573717 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a2556-1ce7-4110-b12b-2d718cdbc4e5 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:25.591708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 963/1920] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:25:25.668576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2f277-e978-4e2a-bef3-e5db1646a8a4 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:25.690138 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db0a23-2332-4b11-ae22-9c3568d671cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:25.690138 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db0a23-2332-4b11-ae22-9c3568d671cc admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:25.690138 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db0a23-2332-4b11-ae22-9c3568d671cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:25.690138 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db0a23-2332-4b11-ae22-9c3568d671cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:25.695037 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db0a23-2332-4b11-ae22-9c3568d671cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:25.699145 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db0a23-2332-4b11-ae22-9c3568d671cc admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:25.771132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 958/1921] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:25.776433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a2556-1ce7-4110-b12b-2d718cdbc4e5 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:25.808561 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a2556-1ce7-4110-b12b-2d718cdbc4e5 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:25.819845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39350e91-c3f3-4814-988d-379d780f151e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:25.821710 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39350e91-c3f3-4814-988d-379d780f151e admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:25.822637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39350e91-c3f3-4814-988d-379d780f151e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:25.823371 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39350e91-c3f3-4814-988d-379d780f151e admin admin] PATH_INFO: `/v3/projects/3e49535faa7c446d9334809923c1fedb/users/6b75c266621d4ab498c7b11aa19ff875/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:25.828966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39350e91-c3f3-4814-988d-379d780f151e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e49535faa7c446d9334809923c1fedb, user_id=6b75c266621d4ab498c7b11aa19ff875, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:25.834356 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39350e91-c3f3-4814-988d-379d780f151e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:25.878370 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 964/1922] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:25 2022] PUT /identity/v3/projects/3e49535faa7c446d9334809923c1fedb/users/6b75c266621d4ab498c7b11aa19ff875/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:25.879600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc6339-abbe-46b4-96b0-4d4a7841c66c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:25.880099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc6339-abbe-46b4-96b0-4d4a7841c66c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:25.880580 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc6339-abbe-46b4-96b0-4d4a7841c66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:25.918493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a8cc6339-abbe-46b4-96b0-4d4a7841c66c None None] MFA Rules not processed for user `6b75c266621d4ab498c7b11aa19ff875`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:25.919702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a8cc6339-abbe-46b4-96b0-4d4a7841c66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:26.009223 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 959/1923] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:26.034798 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39350e91-c3f3-4814-988d-379d780f151e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:26.037959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-39350e91-c3f3-4814-988d-379d780f151e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:26.130676 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39350e91-c3f3-4814-988d-379d780f151e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:26.135437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8c8aa-5d60-4800-8627-b454c8b4a354 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:26.136572 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8c8aa-5d60-4800-8627-b454c8b4a354 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:26.136992 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8c8aa-5d60-4800-8627-b454c8b4a354 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:26.137520 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8c8aa-5d60-4800-8627-b454c8b4a354 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:26.219906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8c8aa-5d60-4800-8627-b454c8b4a354 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:26.221777 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8c8aa-5d60-4800-8627-b454c8b4a354 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:26.231257 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 965/1924] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:27.928609 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc6339-abbe-46b4-96b0-4d4a7841c66c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:27.930043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a8cc6339-abbe-46b4-96b0-4d4a7841c66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:27.988330 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:28.013118 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc6339-abbe-46b4-96b0-4d4a7841c66c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:28.019321 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6952d6-650e-4047-9512-fb86af10bc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:28.020198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6952d6-650e-4047-9512-fb86af10bc97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:28.020479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6952d6-650e-4047-9512-fb86af10bc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:28.020753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6952d6-650e-4047-9512-fb86af10bc97 admin admin] PATH_INFO: `/v3/users/eb80d522c1f54387b33e32e641f7fbc5` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:28.021923 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6952d6-650e-4047-9512-fb86af10bc97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb80d522c1f54387b33e32e641f7fbc5)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:28.023907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6952d6-650e-4047-9512-fb86af10bc97 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:28.069579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3c6952d6-650e-4047-9512-fb86af10bc97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb80d522c1f54387b33e32e641f7fbc5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:28.077400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3c6952d6-650e-4047-9512-fb86af10bc97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb80d522c1f54387b33e32e641f7fbc5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:28.085720 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3c6952d6-650e-4047-9512-fb86af10bc97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb80d522c1f54387b33e32e641f7fbc5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:28.086418 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3c6952d6-650e-4047-9512-fb86af10bc97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb80d522c1f54387b33e32e641f7fbc5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:28.087043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3c6952d6-650e-4047-9512-fb86af10bc97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb80d522c1f54387b33e32e641f7fbc5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:28.104261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 960/1925] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:27 2022] DELETE /identity/v3/users/eb80d522c1f54387b33e32e641f7fbc5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:28.109200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda17e5-b69d-41f7-84ce-f8d80326b718 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:28.109200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda17e5-b69d-41f7-84ce-f8d80326b718 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:28.109749 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda17e5-b69d-41f7-84ce-f8d80326b718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:28.127145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8cda17e5-b69d-41f7-84ce-f8d80326b718 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:28.128377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8cda17e5-b69d-41f7-84ce-f8d80326b718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:28.167441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:28.189106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 966/1926] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:28.198564 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6952d6-650e-4047-9512-fb86af10bc97 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:28.200341 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3c6952d6-650e-4047-9512-fb86af10bc97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:28.257061 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6952d6-650e-4047-9512-fb86af10bc97 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:28.260660 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fb744-9f02-4f6e-ad5b-a6b63d99e474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:28.261303 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fb744-9f02-4f6e-ad5b-a6b63d99e474 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:28.261586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fb744-9f02-4f6e-ad5b-a6b63d99e474 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:28.261862 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fb744-9f02-4f6e-ad5b-a6b63d99e474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:28.270916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9fb744-9f02-4f6e-ad5b-a6b63d99e474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:28.272348 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9fb744-9f02-4f6e-ad5b-a6b63d99e474 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:28.282249 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 961/1927] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:25:28.747511 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda17e5-b69d-41f7-84ce-f8d80326b718 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:28.754157 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8cda17e5-b69d-41f7-84ce-f8d80326b718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:28.767793 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda17e5-b69d-41f7-84ce-f8d80326b718 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:28.773763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee457cd-8745-4ca8-a227-f1c069b00f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:28.774848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee457cd-8745-4ca8-a227-f1c069b00f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:28.775231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee457cd-8745-4ca8-a227-f1c069b00f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:28.775604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee457cd-8745-4ca8-a227-f1c069b00f4d admin admin] PATH_INFO: `/v3/projects/dc9286e73f6c4150b5f06673890f1ba0` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:28.777341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee457cd-8745-4ca8-a227-f1c069b00f4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc9286e73f6c4150b5f06673890f1ba0)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:28.780190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee457cd-8745-4ca8-a227-f1c069b00f4d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:28.844569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6ee457cd-8745-4ca8-a227-f1c069b00f4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc9286e73f6c4150b5f06673890f1ba0', 'request_id': 'req-6ee457cd-8745-4ca8-a227-f1c069b00f4d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:28.851439 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6ee457cd-8745-4ca8-a227-f1c069b00f4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc9286e73f6c4150b5f06673890f1ba0', 'request_id': 'req-6ee457cd-8745-4ca8-a227-f1c069b00f4d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:28.860230 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6ee457cd-8745-4ca8-a227-f1c069b00f4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc9286e73f6c4150b5f06673890f1ba0', 'request_id': 'req-6ee457cd-8745-4ca8-a227-f1c069b00f4d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:28.884387 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6ee457cd-8745-4ca8-a227-f1c069b00f4d admin admin] The token cache is being invalidate because project dc9286e73f6c4150b5f06673890f1ba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:28.884707 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6ee457cd-8745-4ca8-a227-f1c069b00f4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:28.886769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6ee457cd-8745-4ca8-a227-f1c069b00f4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:28.889986 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 967/1928] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:28 2022] DELETE /identity/v3/projects/dc9286e73f6c4150b5f06673890f1ba0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:28.894055 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fb744-9f02-4f6e-ad5b-a6b63d99e474 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:28.915560 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fb744-9f02-4f6e-ad5b-a6b63d99e474 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:28.980208 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1fbf8-60d4-402a-abad-0a08353cb254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:28.981190 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1fbf8-60d4-402a-abad-0a08353cb254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:28.981535 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1fbf8-60d4-402a-abad-0a08353cb254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:28.981873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1fbf8-60d4-402a-abad-0a08353cb254 admin admin] PATH_INFO: `/v3/users/6c7ab23787044429855e80c20a71e255` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:28.983206 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1fbf8-60d4-402a-abad-0a08353cb254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c7ab23787044429855e80c20a71e255)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:28.985396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1fbf8-60d4-402a-abad-0a08353cb254 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:28.987558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:29.051909 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-67b1fbf8-60d4-402a-abad-0a08353cb254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c7ab23787044429855e80c20a71e255'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:29.059206 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-67b1fbf8-60d4-402a-abad-0a08353cb254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c7ab23787044429855e80c20a71e255'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:29.069361 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-67b1fbf8-60d4-402a-abad-0a08353cb254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c7ab23787044429855e80c20a71e255'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:29.070125 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-67b1fbf8-60d4-402a-abad-0a08353cb254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c7ab23787044429855e80c20a71e255'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:29.070860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-67b1fbf8-60d4-402a-abad-0a08353cb254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c7ab23787044429855e80c20a71e255'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:29.089610 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 962/1929] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:28 2022] DELETE /identity/v3/users/6c7ab23787044429855e80c20a71e255 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:29.528074 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee457cd-8745-4ca8-a227-f1c069b00f4d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:29.530124 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6ee457cd-8745-4ca8-a227-f1c069b00f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:29.561387 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee457cd-8745-4ca8-a227-f1c069b00f4d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:29.625202 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c4c30-3248-487b-a2e4-52d80273099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:29.626144 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c4c30-3248-487b-a2e4-52d80273099a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:29.626525 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c4c30-3248-487b-a2e4-52d80273099a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:29.626813 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c4c30-3248-487b-a2e4-52d80273099a admin admin] PATH_INFO: `/v3/projects/13d58cac52014fc797298a999143cde4` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:29.628172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c4c30-3248-487b-a2e4-52d80273099a admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d58cac52014fc797298a999143cde4)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:29.630250 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c4c30-3248-487b-a2e4-52d80273099a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:29.758906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-413c4c30-3248-487b-a2e4-52d80273099a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d58cac52014fc797298a999143cde4', 'request_id': 'req-413c4c30-3248-487b-a2e4-52d80273099a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:29.775217 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-413c4c30-3248-487b-a2e4-52d80273099a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d58cac52014fc797298a999143cde4', 'request_id': 'req-413c4c30-3248-487b-a2e4-52d80273099a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:29.788315 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-413c4c30-3248-487b-a2e4-52d80273099a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d58cac52014fc797298a999143cde4', 'request_id': 'req-413c4c30-3248-487b-a2e4-52d80273099a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:29.801501 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:29.805121 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-413c4c30-3248-487b-a2e4-52d80273099a admin admin] The token cache is being invalidate because project 13d58cac52014fc797298a999143cde4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:29.805973 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-413c4c30-3248-487b-a2e4-52d80273099a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:29.807682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-413c4c30-3248-487b-a2e4-52d80273099a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:29.812959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 968/1930] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:29 2022] DELETE /identity/v3/projects/13d58cac52014fc797298a999143cde4 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:29.819147 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161507f-6e22-43d6-a21d-9ce6c68e7c19 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:29.819609 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161507f-6e22-43d6-a21d-9ce6c68e7c19 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:29.820213 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161507f-6e22-43d6-a21d-9ce6c68e7c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:29.857098 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2161507f-6e22-43d6-a21d-9ce6c68e7c19 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:29.859314 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2161507f-6e22-43d6-a21d-9ce6c68e7c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:29.937426 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 963/1931] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:29.945226 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f2fed-f4ac-484a-af45-e5af3d268dba None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:29.945892 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f2fed-f4ac-484a-af45-e5af3d268dba None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:29.946357 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f2fed-f4ac-484a-af45-e5af3d268dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:29.992534 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-946f2fed-f4ac-484a-af45-e5af3d268dba None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:29.994368 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-946f2fed-f4ac-484a-af45-e5af3d268dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:29.999552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161507f-6e22-43d6-a21d-9ce6c68e7c19 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:30.003295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2161507f-6e22-43d6-a21d-9ce6c68e7c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:30.009966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 969/1932] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:30.012908 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f2fed-f4ac-484a-af45-e5af3d268dba None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:30.024197 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f2fed-f4ac-484a-af45-e5af3d268dba None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:30.030311 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3b8c2-0fe4-4355-bd79-b56336e68ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:30.031120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3b8c2-0fe4-4355-bd79-b56336e68ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:30.032353 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3b8c2-0fe4-4355-bd79-b56336e68ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:30.032800 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3b8c2-0fe4-4355-bd79-b56336e68ad2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:30.033648 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3b8c2-0fe4-4355-bd79-b56336e68ad2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:30.034064 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3b8c2-0fe4-4355-bd79-b56336e68ad2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:30.036680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3b8c2-0fe4-4355-bd79-b56336e68ad2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:30.054251 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 970/1933] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:30.059150 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3b8c2-0fe4-4355-bd79-b56336e68ad2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:30.073897 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3b8c2-0fe4-4355-bd79-b56336e68ad2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:30.080893 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbfbc8-db25-40f0-9dfb-1d0274019366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:30.081700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbfbc8-db25-40f0-9dfb-1d0274019366 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:30.082089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbfbc8-db25-40f0-9dfb-1d0274019366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:30.082494 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cbfbc8-db25-40f0-9dfb-1d0274019366 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:30.083412 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbfbc8-db25-40f0-9dfb-1d0274019366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:30.086525 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cbfbc8-db25-40f0-9dfb-1d0274019366 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:30.129773 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 971/1934] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:30 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:30.137906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbfbc8-db25-40f0-9dfb-1d0274019366 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:30.157170 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161507f-6e22-43d6-a21d-9ce6c68e7c19 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:30.194353 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:30.216814 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf533601-13a4-43f3-944d-32cc9685205d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:30.218038 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf533601-13a4-43f3-944d-32cc9685205d service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:30.220394 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf533601-13a4-43f3-944d-32cc9685205d service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:30.221052 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf533601-13a4-43f3-944d-32cc9685205d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:30.223959 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bf533601-13a4-43f3-944d-32cc9685205d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:30.232854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cbfbc8-db25-40f0-9dfb-1d0274019366 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:30.240197 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93090933-23ac-4b42-988c-5b96c85b5c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:30.241068 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93090933-23ac-4b42-988c-5b96c85b5c83 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:30.241643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93090933-23ac-4b42-988c-5b96c85b5c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:30.241924 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93090933-23ac-4b42-988c-5b96c85b5c83 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:30.243103 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93090933-23ac-4b42-988c-5b96c85b5c83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:30.244959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93090933-23ac-4b42-988c-5b96c85b5c83 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:30.273549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 972/1935] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:30 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:30.274657 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93090933-23ac-4b42-988c-5b96c85b5c83 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:30.287786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93090933-23ac-4b42-988c-5b96c85b5c83 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:30.293199 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66523d5a-9bd3-4ad1-9c79-e0cb5b8e4a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:30.294048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66523d5a-9bd3-4ad1-9c79-e0cb5b8e4a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:30.294361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66523d5a-9bd3-4ad1-9c79-e0cb5b8e4a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:30.294788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66523d5a-9bd3-4ad1-9c79-e0cb5b8e4a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:30.296311 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66523d5a-9bd3-4ad1-9c79-e0cb5b8e4a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:30.297854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66523d5a-9bd3-4ad1-9c79-e0cb5b8e4a87 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:30.312950 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 973/1936] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:30.314250 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66523d5a-9bd3-4ad1-9c79-e0cb5b8e4a87 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:30.326564 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf533601-13a4-43f3-944d-32cc9685205d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:30.328804 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf533601-13a4-43f3-944d-32cc9685205d service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:30.336474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66523d5a-9bd3-4ad1-9c79-e0cb5b8e4a87 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:30.340102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 964/1937] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:25:30.350359 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbc7f6-958b-42f7-b1f0-15b5107b530d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:30.351114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbc7f6-958b-42f7-b1f0-15b5107b530d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:30.352548 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbc7f6-958b-42f7-b1f0-15b5107b530d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:30.352838 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbc7f6-958b-42f7-b1f0-15b5107b530d admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:30.355715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbc7f6-958b-42f7-b1f0-15b5107b530d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:30.357537 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbc7f6-958b-42f7-b1f0-15b5107b530d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:30.387815 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 974/1938] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:30.393858 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf533601-13a4-43f3-944d-32cc9685205d service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:30.411041 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf533601-13a4-43f3-944d-32cc9685205d service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:30.418004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e0140-91ba-44fa-b95d-315b9e3b08a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:30.420840 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e0140-91ba-44fa-b95d-315b9e3b08a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:30.421142 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e0140-91ba-44fa-b95d-315b9e3b08a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:30.421423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e0140-91ba-44fa-b95d-315b9e3b08a0 admin admin] PATH_INFO: `/v3/projects/8c5cb2db8e824971954682f03a102b88/users/211ba82caef144d99625ba3737a96eb7/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:30.445375 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e0140-91ba-44fa-b95d-315b9e3b08a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5cb2db8e824971954682f03a102b88, user_id=211ba82caef144d99625ba3737a96eb7, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:30.450758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e0140-91ba-44fa-b95d-315b9e3b08a0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:30.486387 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2bf57-eea9-4bec-bcb1-69a64738f3b4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:30.486676 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2bf57-eea9-4bec-bcb1-69a64738f3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:30.486953 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2bf57-eea9-4bec-bcb1-69a64738f3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:30.488305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 965/1939] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:30 2022] PUT /identity/v3/projects/8c5cb2db8e824971954682f03a102b88/users/211ba82caef144d99625ba3737a96eb7/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:30.544342 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-27f2bf57-eea9-4bec-bcb1-69a64738f3b4 None None] MFA Rules not processed for user `211ba82caef144d99625ba3737a96eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:30.547876 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-27f2bf57-eea9-4bec-bcb1-69a64738f3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:30.658359 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 975/1940] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:30.662935 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e0140-91ba-44fa-b95d-315b9e3b08a0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:30.783204 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e0140-91ba-44fa-b95d-315b9e3b08a0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:30.789073 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d111a-da69-4d3c-92a3-d1cefb211ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:30.789765 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d111a-da69-4d3c-92a3-d1cefb211ddb admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:30.790519 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d111a-da69-4d3c-92a3-d1cefb211ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:30.790810 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d111a-da69-4d3c-92a3-d1cefb211ddb admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:30.791526 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d111a-da69-4d3c-92a3-d1cefb211ddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:30.794149 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d111a-da69-4d3c-92a3-d1cefb211ddb admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:30.836063 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2bf57-eea9-4bec-bcb1-69a64738f3b4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:30.847559 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 966/1941] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:30 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:30.853646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2bf57-eea9-4bec-bcb1-69a64738f3b4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:30.872115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:30.903558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d111a-da69-4d3c-92a3-d1cefb211ddb admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:30.906029 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cd2d111a-da69-4d3c-92a3-d1cefb211ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:30.950254 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a5043-d87e-4ba2-a064-a52778248058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:30.951803 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a5043-d87e-4ba2-a064-a52778248058 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:30.952202 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a5043-d87e-4ba2-a064-a52778248058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:30.952609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a5043-d87e-4ba2-a064-a52778248058 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:30.953702 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a5043-d87e-4ba2-a064-a52778248058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:30.957008 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a5043-d87e-4ba2-a064-a52778248058 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:30.985454 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:31.000457 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 976/1942] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:30 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:31.004341 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d111a-da69-4d3c-92a3-d1cefb211ddb admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:31.004826 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a5043-d87e-4ba2-a064-a52778248058 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:31.008924 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b1505-0120-467c-b81c-c07690e3eb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:31.009788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b1505-0120-467c-b81c-c07690e3eb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:31.010069 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b1505-0120-467c-b81c-c07690e3eb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:31.010657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b1505-0120-467c-b81c-c07690e3eb77 admin admin] PATH_INFO: `/v3/users/47d9ac536aaa4e80ac3323aaecc024b5` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:31.011879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b1505-0120-467c-b81c-c07690e3eb77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d9ac536aaa4e80ac3323aaecc024b5)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:31.014622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b1505-0120-467c-b81c-c07690e3eb77 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:31.015447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a5043-d87e-4ba2-a064-a52778248058 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:31.020132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8f31d-579d-4a20-954d-849f31f282d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:31.020792 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8f31d-579d-4a20-954d-849f31f282d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:31.021095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8f31d-579d-4a20-954d-849f31f282d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:31.021369 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8f31d-579d-4a20-954d-849f31f282d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:31.022083 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8f31d-579d-4a20-954d-849f31f282d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:31.023699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8f31d-579d-4a20-954d-849f31f282d4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:31.037651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 977/1943] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:25:31.038699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8f31d-579d-4a20-954d-849f31f282d4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:31.049818 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8f31d-579d-4a20-954d-849f31f282d4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:31.054618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7dfc0-c95d-47d7-a5c4-f6157e93a520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:31.055363 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7dfc0-c95d-47d7-a5c4-f6157e93a520 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:31.055717 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7dfc0-c95d-47d7-a5c4-f6157e93a520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:31.056063 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7dfc0-c95d-47d7-a5c4-f6157e93a520 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:31.056853 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7dfc0-c95d-47d7-a5c4-f6157e93a520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:31.058549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7dfc0-c95d-47d7-a5c4-f6157e93a520 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:31.062448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9b5b1505-0120-467c-b81c-c07690e3eb77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d9ac536aaa4e80ac3323aaecc024b5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:31.069113 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9b5b1505-0120-467c-b81c-c07690e3eb77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d9ac536aaa4e80ac3323aaecc024b5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:31.069760 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 978/1944] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:31.074004 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7dfc0-c95d-47d7-a5c4-f6157e93a520 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:31.078121 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9b5b1505-0120-467c-b81c-c07690e3eb77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d9ac536aaa4e80ac3323aaecc024b5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:31.078936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9b5b1505-0120-467c-b81c-c07690e3eb77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d9ac536aaa4e80ac3323aaecc024b5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:31.079631 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9b5b1505-0120-467c-b81c-c07690e3eb77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d9ac536aaa4e80ac3323aaecc024b5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:31.085372 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7dfc0-c95d-47d7-a5c4-f6157e93a520 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:31.089909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7b6100-5761-4bc7-bcf1-6af4be02830d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:31.090811 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b6100-5761-4bc7-bcf1-6af4be02830d admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:31.091098 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b6100-5761-4bc7-bcf1-6af4be02830d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:31.091377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7b6100-5761-4bc7-bcf1-6af4be02830d admin admin] PATH_INFO: `/v3/projects/8bf10fccb2c846f793304ed0ec773ab2/users/51325c4199424ad999cea49555ca6c01/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:31.097883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 967/1945] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:30 2022] DELETE /identity/v3/users/47d9ac536aaa4e80ac3323aaecc024b5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:31.102123 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4ef48-7a75-4c01-af6c-024402b6a51b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:31.102452 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4ef48-7a75-4c01-af6c-024402b6a51b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:31.102727 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4ef48-7a75-4c01-af6c-024402b6a51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:31.106014 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b6100-5761-4bc7-bcf1-6af4be02830d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf10fccb2c846f793304ed0ec773ab2, user_id=51325c4199424ad999cea49555ca6c01, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:31.108755 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7b6100-5761-4bc7-bcf1-6af4be02830d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:31.120468 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6bf4ef48-7a75-4c01-af6c-024402b6a51b None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:31.121736 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6bf4ef48-7a75-4c01-af6c-024402b6a51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:31.123472 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 979/1946] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:31 2022] PUT /identity/v3/projects/8bf10fccb2c846f793304ed0ec773ab2/users/51325c4199424ad999cea49555ca6c01/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:31.133265 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af860686-0a89-4ce7-bdec-3ffe50a13af1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:31.133556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af860686-0a89-4ce7-bdec-3ffe50a13af1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:31.135581 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af860686-0a89-4ce7-bdec-3ffe50a13af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:31.167039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-af860686-0a89-4ce7-bdec-3ffe50a13af1 None None] MFA Rules not processed for user `51325c4199424ad999cea49555ca6c01`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:31.168288 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-af860686-0a89-4ce7-bdec-3ffe50a13af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:31.197126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 968/1947] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:31.211755 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4ef48-7a75-4c01-af6c-024402b6a51b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:31.213396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6bf4ef48-7a75-4c01-af6c-024402b6a51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:31.250153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 980/1948] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:31.254408 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af860686-0a89-4ce7-bdec-3ffe50a13af1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:31.255697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-af860686-0a89-4ce7-bdec-3ffe50a13af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:31.268848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af860686-0a89-4ce7-bdec-3ffe50a13af1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:31.273537 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d059a76-821f-47d2-8853-5163d07a5e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:31.274197 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059a76-821f-47d2-8853-5163d07a5e45 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:31.274507 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059a76-821f-47d2-8853-5163d07a5e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:31.275027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059a76-821f-47d2-8853-5163d07a5e45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:31.275725 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d059a76-821f-47d2-8853-5163d07a5e45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:31.277612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d059a76-821f-47d2-8853-5163d07a5e45 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:31.278986 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4ef48-7a75-4c01-af6c-024402b6a51b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:31.283803 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab2858-6e30-4d49-8e68-6a49a3e119af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:31.284463 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab2858-6e30-4d49-8e68-6a49a3e119af service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:31.284752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab2858-6e30-4d49-8e68-6a49a3e119af service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:31.285032 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab2858-6e30-4d49-8e68-6a49a3e119af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:31.294675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab2858-6e30-4d49-8e68-6a49a3e119af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:31.297046 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab2858-6e30-4d49-8e68-6a49a3e119af service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:31.308232 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 981/1949] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:31 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:31.309261 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d059a76-821f-47d2-8853-5163d07a5e45 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:31.317730 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 969/1950] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:31.351768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:31.399285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d059a76-821f-47d2-8853-5163d07a5e45 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:31.405212 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112290a8-cf5e-4205-9569-8bb0f85c4fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:31.406390 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112290a8-cf5e-4205-9569-8bb0f85c4fea admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:31.406979 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112290a8-cf5e-4205-9569-8bb0f85c4fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:31.407412 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112290a8-cf5e-4205-9569-8bb0f85c4fea admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:31.408319 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112290a8-cf5e-4205-9569-8bb0f85c4fea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:31.410520 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112290a8-cf5e-4205-9569-8bb0f85c4fea admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:31.434787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 982/1951] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:31 2022] POST /identity/v3/users => generated 296 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:31.438227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab2858-6e30-4d49-8e68-6a49a3e119af service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:31.454658 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab2858-6e30-4d49-8e68-6a49a3e119af service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:31.462709 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5841f-7a00-4fe0-958b-02d130b4d3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:31.464137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5841f-7a00-4fe0-958b-02d130b4d3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:31.464715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5841f-7a00-4fe0-958b-02d130b4d3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:31.465216 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5841f-7a00-4fe0-958b-02d130b4d3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:31.466435 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5841f-7a00-4fe0-958b-02d130b4d3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:31.470635 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5841f-7a00-4fe0-958b-02d130b4d3c2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:31.474091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:31.492038 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 970/1952] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:31.495548 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112290a8-cf5e-4205-9569-8bb0f85c4fea admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:31.518282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112290a8-cf5e-4205-9569-8bb0f85c4fea admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:31.535403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8bbfe-bc19-464f-9e0c-c00aafd1ae2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:31.540585 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8bbfe-bc19-464f-9e0c-c00aafd1ae2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:31.541050 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8bbfe-bc19-464f-9e0c-c00aafd1ae2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:31.542064 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8bbfe-bc19-464f-9e0c-c00aafd1ae2b admin admin] PATH_INFO: `/v3/projects/aef6437854044be0879c501211201335/users/3cad168e8a9c4f56819076505b6dbed4/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:31.573343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8bbfe-bc19-464f-9e0c-c00aafd1ae2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef6437854044be0879c501211201335, user_id=3cad168e8a9c4f56819076505b6dbed4, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:31.582373 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8bbfe-bc19-464f-9e0c-c00aafd1ae2b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:31.600205 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 983/1953] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:31 2022] PUT /identity/v3/projects/aef6437854044be0879c501211201335/users/3cad168e8a9c4f56819076505b6dbed4/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:31.603612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5841f-7a00-4fe0-958b-02d130b4d3c2 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:31.614053 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5841f-7a00-4fe0-958b-02d130b4d3c2 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:31.693557 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9f361-554d-427f-843f-d9388d7cb0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:31.694579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f361-554d-427f-843f-d9388d7cb0bc admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:31.694579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f361-554d-427f-843f-d9388d7cb0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:31.694815 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f361-554d-427f-843f-d9388d7cb0bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:31.695584 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9f361-554d-427f-843f-d9388d7cb0bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:31.697174 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9f361-554d-427f-843f-d9388d7cb0bc admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:31.709738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 971/1954] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:31.713774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8bbfe-bc19-464f-9e0c-c00aafd1ae2b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:31.725516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8bbfe-bc19-464f-9e0c-c00aafd1ae2b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:31.731672 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cce88-aef9-4f8a-b4e7-d563e48161f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:31.732611 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cce88-aef9-4f8a-b4e7-d563e48161f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:31.732980 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cce88-aef9-4f8a-b4e7-d563e48161f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:31.733191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cce88-aef9-4f8a-b4e7-d563e48161f8 admin admin] PATH_INFO: `/v3/projects/aef6437854044be0879c501211201335/users/3cad168e8a9c4f56819076505b6dbed4/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:31.735837 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591cce88-aef9-4f8a-b4e7-d563e48161f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef6437854044be0879c501211201335, user_id=3cad168e8a9c4f56819076505b6dbed4, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:31.738835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591cce88-aef9-4f8a-b4e7-d563e48161f8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:31.757756 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 984/1955] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:31 2022] PUT /identity/v3/projects/aef6437854044be0879c501211201335/users/3cad168e8a9c4f56819076505b6dbed4/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:31.768460 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17308e7-9e56-47b8-9bd8-d775756212fc None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:31.768753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17308e7-9e56-47b8-9bd8-d775756212fc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:31.769032 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17308e7-9e56-47b8-9bd8-d775756212fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:31.795606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a17308e7-9e56-47b8-9bd8-d775756212fc None None] MFA Rules not processed for user `3cad168e8a9c4f56819076505b6dbed4`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:31.796831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a17308e7-9e56-47b8-9bd8-d775756212fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:31.881086 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 972/1956] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:31.894078 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cce88-aef9-4f8a-b4e7-d563e48161f8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:31.895785 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-591cce88-aef9-4f8a-b4e7-d563e48161f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:31.968293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17308e7-9e56-47b8-9bd8-d775756212fc None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:31.969513 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cce88-aef9-4f8a-b4e7-d563e48161f8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:31.970230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a17308e7-9e56-47b8-9bd8-d775756212fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:31.977065 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91715387-78f6-46ae-ad8a-4d601de8e7da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:31.978217 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91715387-78f6-46ae-ad8a-4d601de8e7da service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:31.978217 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91715387-78f6-46ae-ad8a-4d601de8e7da service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:31.978659 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91715387-78f6-46ae-ad8a-4d601de8e7da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:31.991772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91715387-78f6-46ae-ad8a-4d601de8e7da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:31.995395 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91715387-78f6-46ae-ad8a-4d601de8e7da service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:32.026197 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 985/1957] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:32.066294 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17308e7-9e56-47b8-9bd8-d775756212fc None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:32.071295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c0f0a-41c2-4763-96ca-c01749d68ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:32.072185 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c0f0a-41c2-4763-96ca-c01749d68ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:32.072499 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c0f0a-41c2-4763-96ca-c01749d68ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:32.072755 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c0f0a-41c2-4763-96ca-c01749d68ec4 admin admin] PATH_INFO: `/v3/projects/e015c1a4a7224635a150c5a619b6c54c` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:32.074160 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c0f0a-41c2-4763-96ca-c01749d68ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e015c1a4a7224635a150c5a619b6c54c)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:32.076217 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c0f0a-41c2-4763-96ca-c01749d68ec4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:32.092816 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91715387-78f6-46ae-ad8a-4d601de8e7da service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:32.103510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:32.104585 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91715387-78f6-46ae-ad8a-4d601de8e7da service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:32.109218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c2018-3d3e-4465-8397-81afb52135cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:32.110020 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c2018-3d3e-4465-8397-81afb52135cb service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:32.110664 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c2018-3d3e-4465-8397-81afb52135cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:32.111467 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c2018-3d3e-4465-8397-81afb52135cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:32.117216 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7c7c2018-3d3e-4465-8397-81afb52135cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:32.133846 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2e1c0f0a-41c2-4763-96ca-c01749d68ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e015c1a4a7224635a150c5a619b6c54c', 'request_id': 'req-2e1c0f0a-41c2-4763-96ca-c01749d68ec4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:32.141860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2e1c0f0a-41c2-4763-96ca-c01749d68ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e015c1a4a7224635a150c5a619b6c54c', 'request_id': 'req-2e1c0f0a-41c2-4763-96ca-c01749d68ec4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:32.150828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2e1c0f0a-41c2-4763-96ca-c01749d68ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e015c1a4a7224635a150c5a619b6c54c', 'request_id': 'req-2e1c0f0a-41c2-4763-96ca-c01749d68ec4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:32.171492 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2e1c0f0a-41c2-4763-96ca-c01749d68ec4 admin admin] The token cache is being invalidate because project e015c1a4a7224635a150c5a619b6c54c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:32.172027 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2e1c0f0a-41c2-4763-96ca-c01749d68ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:32.172776 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2e1c0f0a-41c2-4763-96ca-c01749d68ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:32.174845 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 973/1958] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:31 2022] DELETE /identity/v3/projects/e015c1a4a7224635a150c5a619b6c54c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:32.179203 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c0f0a-41c2-4763-96ca-c01749d68ec4 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:32.180587 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2e1c0f0a-41c2-4763-96ca-c01749d68ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:32.219768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c2018-3d3e-4465-8397-81afb52135cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:32.221561 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c2018-3d3e-4465-8397-81afb52135cb service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:32.233833 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 986/1959] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:25:32.287809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c0f0a-41c2-4763-96ca-c01749d68ec4 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:32.292781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afda570-c01e-452e-a428-afb82fcb730e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:32.293663 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afda570-c01e-452e-a428-afb82fcb730e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:32.293952 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afda570-c01e-452e-a428-afb82fcb730e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:32.294234 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afda570-c01e-452e-a428-afb82fcb730e admin admin] PATH_INFO: `/v3/users/4c555a6c90824a40af0bcd3a68e7788a` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:32.296055 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afda570-c01e-452e-a428-afb82fcb730e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c555a6c90824a40af0bcd3a68e7788a)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:32.298024 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afda570-c01e-452e-a428-afb82fcb730e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:32.346395 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6afda570-c01e-452e-a428-afb82fcb730e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c555a6c90824a40af0bcd3a68e7788a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:32.354156 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6afda570-c01e-452e-a428-afb82fcb730e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c555a6c90824a40af0bcd3a68e7788a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:32.362417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6afda570-c01e-452e-a428-afb82fcb730e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c555a6c90824a40af0bcd3a68e7788a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:32.363079 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6afda570-c01e-452e-a428-afb82fcb730e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c555a6c90824a40af0bcd3a68e7788a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:32.363700 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6afda570-c01e-452e-a428-afb82fcb730e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c555a6c90824a40af0bcd3a68e7788a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:32.383242 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 974/1960] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:32 2022] DELETE /identity/v3/users/4c555a6c90824a40af0bcd3a68e7788a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:32.688060 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c2018-3d3e-4465-8397-81afb52135cb service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:32.704002 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c2018-3d3e-4465-8397-81afb52135cb service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:32.725214 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:32.775662 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09964e7a-58e0-4f43-9590-4cd7f8083399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:32.776656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09964e7a-58e0-4f43-9590-4cd7f8083399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:32.777070 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09964e7a-58e0-4f43-9590-4cd7f8083399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:32.777295 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09964e7a-58e0-4f43-9590-4cd7f8083399 admin admin] PATH_INFO: `/v3/projects/e48f2df340384ff881c12eedcf17afb6` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:32.778885 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09964e7a-58e0-4f43-9590-4cd7f8083399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e48f2df340384ff881c12eedcf17afb6)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:32.781803 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09964e7a-58e0-4f43-9590-4cd7f8083399 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:32.847740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-09964e7a-58e0-4f43-9590-4cd7f8083399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e48f2df340384ff881c12eedcf17afb6', 'request_id': 'req-09964e7a-58e0-4f43-9590-4cd7f8083399'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:32.855394 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-09964e7a-58e0-4f43-9590-4cd7f8083399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e48f2df340384ff881c12eedcf17afb6', 'request_id': 'req-09964e7a-58e0-4f43-9590-4cd7f8083399'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:32.864206 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-09964e7a-58e0-4f43-9590-4cd7f8083399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e48f2df340384ff881c12eedcf17afb6', 'request_id': 'req-09964e7a-58e0-4f43-9590-4cd7f8083399'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:32.880512 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-09964e7a-58e0-4f43-9590-4cd7f8083399 admin admin] The token cache is being invalidate because project e48f2df340384ff881c12eedcf17afb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:32.880857 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-09964e7a-58e0-4f43-9590-4cd7f8083399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:32.882269 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-09964e7a-58e0-4f43-9590-4cd7f8083399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:32.887464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 987/1961] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:32 2022] DELETE /identity/v3/projects/e48f2df340384ff881c12eedcf17afb6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:32.889742 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7fc84-98f0-475e-8399-3ed1ab2d68b6 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:32.890331 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7fc84-98f0-475e-8399-3ed1ab2d68b6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:32.890331 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7fc84-98f0-475e-8399-3ed1ab2d68b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:32.921675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ead7fc84-98f0-475e-8399-3ed1ab2d68b6 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:32.924104 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ead7fc84-98f0-475e-8399-3ed1ab2d68b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:32.949230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:32.989764 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 975/1962] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:32.996199 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefde89a-bce9-4448-bff1-84891e58689c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:32.996486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefde89a-bce9-4448-bff1-84891e58689c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:32.996774 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefde89a-bce9-4448-bff1-84891e58689c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:33.019992 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fefde89a-bce9-4448-bff1-84891e58689c None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:33.021144 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fefde89a-bce9-4448-bff1-84891e58689c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:33.030545 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 988/1963] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:33.034750 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7fc84-98f0-475e-8399-3ed1ab2d68b6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:33.045794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7fc84-98f0-475e-8399-3ed1ab2d68b6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:33.051181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58c542-58b8-4d26-a7a1-3b820cede2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:33.051852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58c542-58b8-4d26-a7a1-3b820cede2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:33.052429 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58c542-58b8-4d26-a7a1-3b820cede2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:33.052542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58c542-58b8-4d26-a7a1-3b820cede2a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:33.053255 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58c542-58b8-4d26-a7a1-3b820cede2a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:33.054060 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58c542-58b8-4d26-a7a1-3b820cede2a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:33.055894 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58c542-58b8-4d26-a7a1-3b820cede2a6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:33.071480 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 976/1964] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:33.072625 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefde89a-bce9-4448-bff1-84891e58689c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:33.082631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefde89a-bce9-4448-bff1-84891e58689c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:33.087507 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d9a16-16a5-4a43-a9c1-d54e542cf0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:33.088169 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d9a16-16a5-4a43-a9c1-d54e542cf0ac admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:33.088456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d9a16-16a5-4a43-a9c1-d54e542cf0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:33.088735 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d9a16-16a5-4a43-a9c1-d54e542cf0ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:33.089442 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d9a16-16a5-4a43-a9c1-d54e542cf0ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:33.091439 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d9a16-16a5-4a43-a9c1-d54e542cf0ac admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:33.118808 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 989/1965] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:33 2022] POST /identity/v3/projects => generated 407 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:33.123589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58c542-58b8-4d26-a7a1-3b820cede2a6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:33.133974 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58c542-58b8-4d26-a7a1-3b820cede2a6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:33.192199 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5899bd-c124-4358-912f-7ec1084ccaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:33.192894 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5899bd-c124-4358-912f-7ec1084ccaf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:33.193176 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5899bd-c124-4358-912f-7ec1084ccaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:33.193449 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5899bd-c124-4358-912f-7ec1084ccaf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:33.194124 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5899bd-c124-4358-912f-7ec1084ccaf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:33.196076 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5899bd-c124-4358-912f-7ec1084ccaf8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:33.217718 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 977/1966] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:33 2022] POST /identity/v3/users => generated 304 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:33.221886 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d9a16-16a5-4a43-a9c1-d54e542cf0ac admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:33.232055 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d9a16-16a5-4a43-a9c1-d54e542cf0ac admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:33.236614 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba04b6e-1fa5-459a-91e9-78901f2e6b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:33.237266 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba04b6e-1fa5-459a-91e9-78901f2e6b28 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:33.237550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba04b6e-1fa5-459a-91e9-78901f2e6b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:33.237831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba04b6e-1fa5-459a-91e9-78901f2e6b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:33.238590 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba04b6e-1fa5-459a-91e9-78901f2e6b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:33.240177 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba04b6e-1fa5-459a-91e9-78901f2e6b28 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:33.250920 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 990/1967] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:33.254765 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5899bd-c124-4358-912f-7ec1084ccaf8 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:33.265274 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5899bd-c124-4358-912f-7ec1084ccaf8 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:33.269879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b756590-2157-4323-8158-6976b24eef95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:33.270631 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b756590-2157-4323-8158-6976b24eef95 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:33.270859 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b756590-2157-4323-8158-6976b24eef95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:33.271137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b756590-2157-4323-8158-6976b24eef95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:33.271861 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b756590-2157-4323-8158-6976b24eef95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:33.273436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b756590-2157-4323-8158-6976b24eef95 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:33.283734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 978/1968] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:33.288787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba04b6e-1fa5-459a-91e9-78901f2e6b28 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:33.300421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba04b6e-1fa5-459a-91e9-78901f2e6b28 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:33.306579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7067d-fdde-4423-a884-13cb781afe0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:33.307641 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7067d-fdde-4423-a884-13cb781afe0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:33.307928 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7067d-fdde-4423-a884-13cb781afe0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:33.308275 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7067d-fdde-4423-a884-13cb781afe0e admin admin] PATH_INFO: `/v3/projects/7b8de5729fdc45629124431f1d407a76/users/9611223d0e044554b47bfff799a90d7c/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:33.338550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7067d-fdde-4423-a884-13cb781afe0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8de5729fdc45629124431f1d407a76, user_id=9611223d0e044554b47bfff799a90d7c, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:33.341466 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7067d-fdde-4423-a884-13cb781afe0e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:33.358168 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 991/1969] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:33 2022] PUT /identity/v3/projects/7b8de5729fdc45629124431f1d407a76/users/9611223d0e044554b47bfff799a90d7c/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:33.368847 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a55681-4673-441d-a92e-cfb68622bdf6 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:33.369134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a55681-4673-441d-a92e-cfb68622bdf6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:33.369429 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a55681-4673-441d-a92e-cfb68622bdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:33.399180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-71a55681-4673-441d-a92e-cfb68622bdf6 None None] MFA Rules not processed for user `9611223d0e044554b47bfff799a90d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:33.400578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-71a55681-4673-441d-a92e-cfb68622bdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:33.468354 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 979/1970] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:33 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:33.472697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7067d-fdde-4423-a884-13cb781afe0e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:33.518808 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:33.538515 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7067d-fdde-4423-a884-13cb781afe0e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:33.543628 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c80a03-f469-4baa-a0c1-25a73f621927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:33.544289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c80a03-f469-4baa-a0c1-25a73f621927 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:33.544575 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c80a03-f469-4baa-a0c1-25a73f621927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:33.545488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c80a03-f469-4baa-a0c1-25a73f621927 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:33.546114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c80a03-f469-4baa-a0c1-25a73f621927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:33.548136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c80a03-f469-4baa-a0c1-25a73f621927 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:33.573787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 992/1971] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:33 2022] POST /identity/v3/projects => generated 409 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:33.577800 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a55681-4673-441d-a92e-cfb68622bdf6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:33.588665 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a55681-4673-441d-a92e-cfb68622bdf6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:33.608966 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:33.648459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010a28f-2785-48f4-aba4-67ceb50349e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:33.649160 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010a28f-2785-48f4-aba4-67ceb50349e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:33.649451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010a28f-2785-48f4-aba4-67ceb50349e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:33.649741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010a28f-2785-48f4-aba4-67ceb50349e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:33.650490 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010a28f-2785-48f4-aba4-67ceb50349e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:33.652814 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010a28f-2785-48f4-aba4-67ceb50349e4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:33.675748 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 980/1972] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:33 2022] POST /identity/v3/users => generated 311 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:33.679855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c80a03-f469-4baa-a0c1-25a73f621927 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:33.691171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c80a03-f469-4baa-a0c1-25a73f621927 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:33.696123 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961a5ef-3224-4f1f-8ef2-c021d2e86ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:33.696817 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961a5ef-3224-4f1f-8ef2-c021d2e86ddd admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:33.697106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961a5ef-3224-4f1f-8ef2-c021d2e86ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:33.697386 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961a5ef-3224-4f1f-8ef2-c021d2e86ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:33.698129 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961a5ef-3224-4f1f-8ef2-c021d2e86ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:33.699842 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961a5ef-3224-4f1f-8ef2-c021d2e86ddd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:33.712683 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 993/1973] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:33.717608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010a28f-2785-48f4-aba4-67ceb50349e4 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:33.729183 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010a28f-2785-48f4-aba4-67ceb50349e4 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:33.734106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cee42-adbe-4da4-9cf7-47705bae8320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:33.735050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cee42-adbe-4da4-9cf7-47705bae8320 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:33.735339 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cee42-adbe-4da4-9cf7-47705bae8320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:33.735619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cee42-adbe-4da4-9cf7-47705bae8320 admin admin] PATH_INFO: `/v3/projects/e7443250a2844587961cc0d45de30d5b/users/654bd1e254264b32908164f8fb955c7b/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:33.751891 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cee42-adbe-4da4-9cf7-47705bae8320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7443250a2844587961cc0d45de30d5b, user_id=654bd1e254264b32908164f8fb955c7b, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:33.754787 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cee42-adbe-4da4-9cf7-47705bae8320 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:33.769962 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 981/1974] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:33 2022] PUT /identity/v3/projects/e7443250a2844587961cc0d45de30d5b/users/654bd1e254264b32908164f8fb955c7b/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:33.774066 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961a5ef-3224-4f1f-8ef2-c021d2e86ddd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:33.785132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961a5ef-3224-4f1f-8ef2-c021d2e86ddd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:33.840667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0655c4-69cc-4149-bb94-ce5003878abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:33.841326 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0655c4-69cc-4149-bb94-ce5003878abf admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:33.841757 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0655c4-69cc-4149-bb94-ce5003878abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:33.842737 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0655c4-69cc-4149-bb94-ce5003878abf admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:33.843471 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0655c4-69cc-4149-bb94-ce5003878abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:33.845063 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0655c4-69cc-4149-bb94-ce5003878abf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:33.854624 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 994/1975] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:33.858961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cee42-adbe-4da4-9cf7-47705bae8320 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:33.870288 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cee42-adbe-4da4-9cf7-47705bae8320 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:33.875408 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326c189-ee11-4670-b26e-9a851e641881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:33.876303 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326c189-ee11-4670-b26e-9a851e641881 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:33.876587 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326c189-ee11-4670-b26e-9a851e641881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:33.876868 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326c189-ee11-4670-b26e-9a851e641881 admin admin] PATH_INFO: `/v3/projects/e7443250a2844587961cc0d45de30d5b/users/654bd1e254264b32908164f8fb955c7b/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:33.878896 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1326c189-ee11-4670-b26e-9a851e641881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7443250a2844587961cc0d45de30d5b, user_id=654bd1e254264b32908164f8fb955c7b, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:33.881526 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1326c189-ee11-4670-b26e-9a851e641881 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:33.892900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 982/1976] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:33 2022] PUT /identity/v3/projects/e7443250a2844587961cc0d45de30d5b/users/654bd1e254264b32908164f8fb955c7b/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:33.905386 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967ffda-19e4-4315-aa9e-738a890a5049 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:33.905668 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967ffda-19e4-4315-aa9e-738a890a5049 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:33.905954 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967ffda-19e4-4315-aa9e-738a890a5049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:33.933685 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f967ffda-19e4-4315-aa9e-738a890a5049 None None] MFA Rules not processed for user `654bd1e254264b32908164f8fb955c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:33.934940 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f967ffda-19e4-4315-aa9e-738a890a5049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:34.007294 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 995/1977] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:33 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:34.019842 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326c189-ee11-4670-b26e-9a851e641881 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:34.021749 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1326c189-ee11-4670-b26e-9a851e641881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:34.091262 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326c189-ee11-4670-b26e-9a851e641881 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:34.095367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d565d3-0129-475e-8a9c-c046bdc72ae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:34.096111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d565d3-0129-475e-8a9c-c046bdc72ae6 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:34.096415 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d565d3-0129-475e-8a9c-c046bdc72ae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:34.096697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d565d3-0129-475e-8a9c-c046bdc72ae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:34.108435 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d565d3-0129-475e-8a9c-c046bdc72ae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:34.109761 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d565d3-0129-475e-8a9c-c046bdc72ae6 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:34.123936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 983/1978] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:34 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:34.318815 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967ffda-19e4-4315-aa9e-738a890a5049 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:34.320602 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f967ffda-19e4-4315-aa9e-738a890a5049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:34.334639 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967ffda-19e4-4315-aa9e-738a890a5049 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:34.340707 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2c17b-e615-4185-8e4a-b2c24e0ca5f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:34.342127 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2c17b-e615-4185-8e4a-b2c24e0ca5f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:34.342475 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2c17b-e615-4185-8e4a-b2c24e0ca5f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:34.343173 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2c17b-e615-4185-8e4a-b2c24e0ca5f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:34.386942 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:34.409136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2c17b-e615-4185-8e4a-b2c24e0ca5f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:34.410616 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2c17b-e615-4185-8e4a-b2c24e0ca5f1 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:34.420512 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 996/1979] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:34 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:36.238152 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d565d3-0129-475e-8a9c-c046bdc72ae6 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:36.239587 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-85d565d3-0129-475e-8a9c-c046bdc72ae6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:36.303580 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d565d3-0129-475e-8a9c-c046bdc72ae6 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:36.308277 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acd490-5564-4fca-b3a1-f3397c022ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:36.309151 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acd490-5564-4fca-b3a1-f3397c022ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:36.309438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acd490-5564-4fca-b3a1-f3397c022ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:36.309715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acd490-5564-4fca-b3a1-f3397c022ee8 admin admin] PATH_INFO: `/v3/users/211ba82caef144d99625ba3737a96eb7` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:36.310931 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58acd490-5564-4fca-b3a1-f3397c022ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=211ba82caef144d99625ba3737a96eb7)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:36.312848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58acd490-5564-4fca-b3a1-f3397c022ee8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:36.334569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:36.362938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-58acd490-5564-4fca-b3a1-f3397c022ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '211ba82caef144d99625ba3737a96eb7'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:36.370154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-58acd490-5564-4fca-b3a1-f3397c022ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '211ba82caef144d99625ba3737a96eb7'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:36.377729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-58acd490-5564-4fca-b3a1-f3397c022ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '211ba82caef144d99625ba3737a96eb7'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:36.378472 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-58acd490-5564-4fca-b3a1-f3397c022ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '211ba82caef144d99625ba3737a96eb7'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:36.379084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-58acd490-5564-4fca-b3a1-f3397c022ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '211ba82caef144d99625ba3737a96eb7'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:36.396992 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 984/1980] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:36 2022] DELETE /identity/v3/users/211ba82caef144d99625ba3737a96eb7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:36.401725 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14131fcb-ca4c-433c-9438-4f4182d31b3f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:36.402192 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14131fcb-ca4c-433c-9438-4f4182d31b3f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:36.402287 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14131fcb-ca4c-433c-9438-4f4182d31b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:36.422403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-14131fcb-ca4c-433c-9438-4f4182d31b3f None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:36.424029 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-14131fcb-ca4c-433c-9438-4f4182d31b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:36.485102 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 997/1981] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:36.494795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acd490-5564-4fca-b3a1-f3397c022ee8 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:36.496220 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-58acd490-5564-4fca-b3a1-f3397c022ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:36.562339 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acd490-5564-4fca-b3a1-f3397c022ee8 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:36.566002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af87944-17d9-4891-989b-a90e378f94e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:36.566698 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af87944-17d9-4891-989b-a90e378f94e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:36.566986 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af87944-17d9-4891-989b-a90e378f94e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:36.567265 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af87944-17d9-4891-989b-a90e378f94e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:36.577820 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af87944-17d9-4891-989b-a90e378f94e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:36.579332 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af87944-17d9-4891-989b-a90e378f94e5 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:36.591203 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 985/1982] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:37.173435 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14131fcb-ca4c-433c-9438-4f4182d31b3f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:37.176377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-14131fcb-ca4c-433c-9438-4f4182d31b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:37.203895 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14131fcb-ca4c-433c-9438-4f4182d31b3f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:37.223725 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b6e46-f01a-4ecf-b1b8-80102a6e93bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:37.225275 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b6e46-f01a-4ecf-b1b8-80102a6e93bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:37.226199 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b6e46-f01a-4ecf-b1b8-80102a6e93bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:37.226799 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b6e46-f01a-4ecf-b1b8-80102a6e93bb admin admin] PATH_INFO: `/v3/projects/8c5cb2db8e824971954682f03a102b88` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:37.228750 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b6e46-f01a-4ecf-b1b8-80102a6e93bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c5cb2db8e824971954682f03a102b88)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:37.246788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b6e46-f01a-4ecf-b1b8-80102a6e93bb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:37.324347 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-311b6e46-f01a-4ecf-b1b8-80102a6e93bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c5cb2db8e824971954682f03a102b88', 'request_id': 'req-311b6e46-f01a-4ecf-b1b8-80102a6e93bb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:37.331467 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-311b6e46-f01a-4ecf-b1b8-80102a6e93bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c5cb2db8e824971954682f03a102b88', 'request_id': 'req-311b6e46-f01a-4ecf-b1b8-80102a6e93bb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:37.338815 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-311b6e46-f01a-4ecf-b1b8-80102a6e93bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c5cb2db8e824971954682f03a102b88', 'request_id': 'req-311b6e46-f01a-4ecf-b1b8-80102a6e93bb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:37.349100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-311b6e46-f01a-4ecf-b1b8-80102a6e93bb admin admin] The token cache is being invalidate because project 8c5cb2db8e824971954682f03a102b88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:37.349381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-311b6e46-f01a-4ecf-b1b8-80102a6e93bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:37.349996 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-311b6e46-f01a-4ecf-b1b8-80102a6e93bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:37.351573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 998/1983] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:37 2022] DELETE /identity/v3/projects/8c5cb2db8e824971954682f03a102b88 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:37.355852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af87944-17d9-4891-989b-a90e378f94e5 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:37.369331 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af87944-17d9-4891-989b-a90e378f94e5 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:37.426998 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53ea93-f992-42c2-8e06-65fa44c4b494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:37.427787 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53ea93-f992-42c2-8e06-65fa44c4b494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:37.428066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53ea93-f992-42c2-8e06-65fa44c4b494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:37.428352 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53ea93-f992-42c2-8e06-65fa44c4b494 admin admin] PATH_INFO: `/v3/users/51325c4199424ad999cea49555ca6c01` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:37.429502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53ea93-f992-42c2-8e06-65fa44c4b494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51325c4199424ad999cea49555ca6c01)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:37.431450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53ea93-f992-42c2-8e06-65fa44c4b494 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:37.474680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:37.477758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-5f53ea93-f992-42c2-8e06-65fa44c4b494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51325c4199424ad999cea49555ca6c01'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:37.486900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-5f53ea93-f992-42c2-8e06-65fa44c4b494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51325c4199424ad999cea49555ca6c01'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:37.494217 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-5f53ea93-f992-42c2-8e06-65fa44c4b494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51325c4199424ad999cea49555ca6c01'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:37.494924 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-5f53ea93-f992-42c2-8e06-65fa44c4b494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51325c4199424ad999cea49555ca6c01'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:37.495531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-5f53ea93-f992-42c2-8e06-65fa44c4b494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51325c4199424ad999cea49555ca6c01'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:37.512913 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 986/1984] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:37 2022] DELETE /identity/v3/users/51325c4199424ad999cea49555ca6c01 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:37.818570 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b6e46-f01a-4ecf-b1b8-80102a6e93bb admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:37.820131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-311b6e46-f01a-4ecf-b1b8-80102a6e93bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:37.834834 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b6e46-f01a-4ecf-b1b8-80102a6e93bb admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:37.937574 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1ff64-f34f-406e-b3e0-495436bf19dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:37.938394 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1ff64-f34f-406e-b3e0-495436bf19dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:37.938670 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1ff64-f34f-406e-b3e0-495436bf19dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:37.938946 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1ff64-f34f-406e-b3e0-495436bf19dd admin admin] PATH_INFO: `/v3/projects/8bf10fccb2c846f793304ed0ec773ab2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:37.940131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1ff64-f34f-406e-b3e0-495436bf19dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf10fccb2c846f793304ed0ec773ab2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:37.942093 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1ff64-f34f-406e-b3e0-495436bf19dd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:37.945515 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:38.011747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f0b1ff64-f34f-406e-b3e0-495436bf19dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf10fccb2c846f793304ed0ec773ab2', 'request_id': 'req-f0b1ff64-f34f-406e-b3e0-495436bf19dd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.018671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f0b1ff64-f34f-406e-b3e0-495436bf19dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf10fccb2c846f793304ed0ec773ab2', 'request_id': 'req-f0b1ff64-f34f-406e-b3e0-495436bf19dd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.028518 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f0b1ff64-f34f-406e-b3e0-495436bf19dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf10fccb2c846f793304ed0ec773ab2', 'request_id': 'req-f0b1ff64-f34f-406e-b3e0-495436bf19dd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.045990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f0b1ff64-f34f-406e-b3e0-495436bf19dd admin admin] The token cache is being invalidate because project 8bf10fccb2c846f793304ed0ec773ab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:38.046887 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f0b1ff64-f34f-406e-b3e0-495436bf19dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.048347 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f0b1ff64-f34f-406e-b3e0-495436bf19dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.051495 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 999/1985] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:37 2022] DELETE /identity/v3/projects/8bf10fccb2c846f793304ed0ec773ab2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:38.057678 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53ea93-f992-42c2-8e06-65fa44c4b494 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:38.060534 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5f53ea93-f992-42c2-8e06-65fa44c4b494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:38.077484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53ea93-f992-42c2-8e06-65fa44c4b494 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:38.161522 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2c3e1-5e91-489e-81d2-1e4d8b146a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:38.162453 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2c3e1-5e91-489e-81d2-1e4d8b146a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:38.162746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2c3e1-5e91-489e-81d2-1e4d8b146a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:38.163026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2c3e1-5e91-489e-81d2-1e4d8b146a49 admin admin] PATH_INFO: `/v3/users/3cad168e8a9c4f56819076505b6dbed4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:38.164961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2c3e1-5e91-489e-81d2-1e4d8b146a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cad168e8a9c4f56819076505b6dbed4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:38.167185 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2c3e1-5e91-489e-81d2-1e4d8b146a49 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:38.218582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1ae2c3e1-5e91-489e-81d2-1e4d8b146a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cad168e8a9c4f56819076505b6dbed4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.226043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1ae2c3e1-5e91-489e-81d2-1e4d8b146a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cad168e8a9c4f56819076505b6dbed4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.236348 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1ae2c3e1-5e91-489e-81d2-1e4d8b146a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cad168e8a9c4f56819076505b6dbed4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.238084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1ae2c3e1-5e91-489e-81d2-1e4d8b146a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cad168e8a9c4f56819076505b6dbed4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.238744 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1ae2c3e1-5e91-489e-81d2-1e4d8b146a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cad168e8a9c4f56819076505b6dbed4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.245572 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1ff64-f34f-406e-b3e0-495436bf19dd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:38.247239 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f0b1ff64-f34f-406e-b3e0-495436bf19dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:38.258959 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 987/1986] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:38 2022] DELETE /identity/v3/users/3cad168e8a9c4f56819076505b6dbed4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:38.259887 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1ff64-f34f-406e-b3e0-495436bf19dd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:38.332315 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc599a-6888-4567-b841-6e4690b55a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:38.333429 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc599a-6888-4567-b841-6e4690b55a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:38.333821 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc599a-6888-4567-b841-6e4690b55a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:38.334175 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc599a-6888-4567-b841-6e4690b55a15 admin admin] PATH_INFO: `/v3/users/52a934152dca4098b99701430a340486` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:38.335966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc599a-6888-4567-b841-6e4690b55a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52a934152dca4098b99701430a340486)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:38.338187 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc599a-6888-4567-b841-6e4690b55a15 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:38.436803 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5bbc599a-6888-4567-b841-6e4690b55a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52a934152dca4098b99701430a340486'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.451853 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5bbc599a-6888-4567-b841-6e4690b55a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52a934152dca4098b99701430a340486'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.472536 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5bbc599a-6888-4567-b841-6e4690b55a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52a934152dca4098b99701430a340486'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.485930 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5bbc599a-6888-4567-b841-6e4690b55a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52a934152dca4098b99701430a340486'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.487591 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5bbc599a-6888-4567-b841-6e4690b55a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52a934152dca4098b99701430a340486'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.502593 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1000/1987] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:38 2022] DELETE /identity/v3/users/52a934152dca4098b99701430a340486 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:38.505007 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff20d8a-51a4-43f0-809e-9d98445b404f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:38.505506 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff20d8a-51a4-43f0-809e-9d98445b404f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:38.505506 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff20d8a-51a4-43f0-809e-9d98445b404f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:38.525640 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0ff20d8a-51a4-43f0-809e-9d98445b404f None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:38.527056 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0ff20d8a-51a4-43f0-809e-9d98445b404f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:38.573770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:38.617470 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 988/1988] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:38.639164 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc599a-6888-4567-b841-6e4690b55a15 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:38.642152 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5bbc599a-6888-4567-b841-6e4690b55a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:38.664456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:38.739614 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc599a-6888-4567-b841-6e4690b55a15 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:38.743653 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad4d80-b673-4c36-a1c8-f424cc9a4c16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:38.744383 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad4d80-b673-4c36-a1c8-f424cc9a4c16 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:38.744742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad4d80-b673-4c36-a1c8-f424cc9a4c16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:38.745072 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad4d80-b673-4c36-a1c8-f424cc9a4c16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:38.757030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad4d80-b673-4c36-a1c8-f424cc9a4c16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:38.758661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad4d80-b673-4c36-a1c8-f424cc9a4c16 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:38.764973 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff20d8a-51a4-43f0-809e-9d98445b404f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:38.766496 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0ff20d8a-51a4-43f0-809e-9d98445b404f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:38.774053 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1001/1989] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:38.784833 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff20d8a-51a4-43f0-809e-9d98445b404f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:38.790953 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abcf408-d134-4301-8aeb-bffaa9c3d237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:38.792119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcf408-d134-4301-8aeb-bffaa9c3d237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:38.792612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcf408-d134-4301-8aeb-bffaa9c3d237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:38.793207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abcf408-d134-4301-8aeb-bffaa9c3d237 admin admin] PATH_INFO: `/v3/projects/aef6437854044be0879c501211201335` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:38.795008 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcf408-d134-4301-8aeb-bffaa9c3d237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aef6437854044be0879c501211201335)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:38.797391 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abcf408-d134-4301-8aeb-bffaa9c3d237 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:38.873455 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4abcf408-d134-4301-8aeb-bffaa9c3d237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aef6437854044be0879c501211201335', 'request_id': 'req-4abcf408-d134-4301-8aeb-bffaa9c3d237'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.881640 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4abcf408-d134-4301-8aeb-bffaa9c3d237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aef6437854044be0879c501211201335', 'request_id': 'req-4abcf408-d134-4301-8aeb-bffaa9c3d237'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.887998 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4abcf408-d134-4301-8aeb-bffaa9c3d237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aef6437854044be0879c501211201335', 'request_id': 'req-4abcf408-d134-4301-8aeb-bffaa9c3d237'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.904675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4abcf408-d134-4301-8aeb-bffaa9c3d237 admin admin] The token cache is being invalidate because project aef6437854044be0879c501211201335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:38.905100 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4abcf408-d134-4301-8aeb-bffaa9c3d237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.905880 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4abcf408-d134-4301-8aeb-bffaa9c3d237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:38.907718 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 989/1990] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:38 2022] DELETE /identity/v3/projects/aef6437854044be0879c501211201335 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:38.914874 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981383e6-952a-4d57-a16a-98dce5212993 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:38.915375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981383e6-952a-4d57-a16a-98dce5212993 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:38.915546 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981383e6-952a-4d57-a16a-98dce5212993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:38.937098 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-981383e6-952a-4d57-a16a-98dce5212993 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:38.938500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-981383e6-952a-4d57-a16a-98dce5212993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:39.012018 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1002/1991] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:39.022034 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b9fd5-3995-4dfa-97b1-8c06e7269514 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:39.022368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b9fd5-3995-4dfa-97b1-8c06e7269514 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:39.022652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b9fd5-3995-4dfa-97b1-8c06e7269514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:39.042293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8c0b9fd5-3995-4dfa-97b1-8c06e7269514 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:39.043530 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8c0b9fd5-3995-4dfa-97b1-8c06e7269514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:39.052199 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 990/1992] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:39.056406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981383e6-952a-4d57-a16a-98dce5212993 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:39.066410 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981383e6-952a-4d57-a16a-98dce5212993 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:39.072016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f88ce-7e0d-4903-849a-be225d8d43cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:39.072709 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f88ce-7e0d-4903-849a-be225d8d43cb admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:39.073048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f88ce-7e0d-4903-849a-be225d8d43cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:39.073316 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f88ce-7e0d-4903-849a-be225d8d43cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:39.074713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f88ce-7e0d-4903-849a-be225d8d43cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:39.075274 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f88ce-7e0d-4903-849a-be225d8d43cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:39.078231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f88ce-7e0d-4903-849a-be225d8d43cb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:39.092428 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1003/1993] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:39.096697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b9fd5-3995-4dfa-97b1-8c06e7269514 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:39.098450 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f88ce-7e0d-4903-849a-be225d8d43cb admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:39.100881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-718f88ce-7e0d-4903-849a-be225d8d43cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:39.114925 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b9fd5-3995-4dfa-97b1-8c06e7269514 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:39.119737 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f88ce-7e0d-4903-849a-be225d8d43cb admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:39.121102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bf747-4c55-4fd3-b8e0-f5910796b946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:39.123084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bf747-4c55-4fd3-b8e0-f5910796b946 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:39.123571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bf747-4c55-4fd3-b8e0-f5910796b946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:39.124050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bf747-4c55-4fd3-b8e0-f5910796b946 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:39.124975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bf747-4c55-4fd3-b8e0-f5910796b946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:39.135873 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbeda1c-031b-4926-9857-56e4517072dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:39.136723 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bf747-4c55-4fd3-b8e0-f5910796b946 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:39.138111 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbeda1c-031b-4926-9857-56e4517072dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:39.139119 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbeda1c-031b-4926-9857-56e4517072dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:39.139493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbeda1c-031b-4926-9857-56e4517072dc admin admin] PATH_INFO: `/v3/projects/295bdf47fbfb4f51a2f2e95b01d06a95` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:39.140871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbeda1c-031b-4926-9857-56e4517072dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=295bdf47fbfb4f51a2f2e95b01d06a95)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:39.143030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbeda1c-031b-4926-9857-56e4517072dc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:39.177607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 991/1994] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:39 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:39.181997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bf747-4c55-4fd3-b8e0-f5910796b946 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:39.207788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bbbeda1c-031b-4926-9857-56e4517072dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '295bdf47fbfb4f51a2f2e95b01d06a95', 'request_id': 'req-bbbeda1c-031b-4926-9857-56e4517072dc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:39.218064 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bbbeda1c-031b-4926-9857-56e4517072dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '295bdf47fbfb4f51a2f2e95b01d06a95', 'request_id': 'req-bbbeda1c-031b-4926-9857-56e4517072dc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:39.227174 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bbbeda1c-031b-4926-9857-56e4517072dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '295bdf47fbfb4f51a2f2e95b01d06a95', 'request_id': 'req-bbbeda1c-031b-4926-9857-56e4517072dc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:39.241570 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bbbeda1c-031b-4926-9857-56e4517072dc admin admin] The token cache is being invalidate because project 295bdf47fbfb4f51a2f2e95b01d06a95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:39.241899 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bbbeda1c-031b-4926-9857-56e4517072dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:39.242762 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bbbeda1c-031b-4926-9857-56e4517072dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:39.244912 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1004/1995] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:39 2022] DELETE /identity/v3/projects/295bdf47fbfb4f51a2f2e95b01d06a95 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:39.250248 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ceea2-2341-46be-8071-04e838d984e6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:39.250562 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ceea2-2341-46be-8071-04e838d984e6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:39.250846 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ceea2-2341-46be-8071-04e838d984e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:39.275593 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7a6ceea2-2341-46be-8071-04e838d984e6 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:39.276176 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bf747-4c55-4fd3-b8e0-f5910796b946 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:39.276710 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7a6ceea2-2341-46be-8071-04e838d984e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:39.304319 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:39.322697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:39.350144 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ee025-a7be-49f7-9d58-4933faed08a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:39.350941 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ee025-a7be-49f7-9d58-4933faed08a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:39.351232 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ee025-a7be-49f7-9d58-4933faed08a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:39.351532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ee025-a7be-49f7-9d58-4933faed08a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:39.352229 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ee025-a7be-49f7-9d58-4933faed08a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:39.354398 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ee025-a7be-49f7-9d58-4933faed08a2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:39.362277 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1005/1996] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:39.374050 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ce795-a1b4-49fa-a7d0-9c16612653e6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:39.374367 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ce795-a1b4-49fa-a7d0-9c16612653e6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:39.374769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ce795-a1b4-49fa-a7d0-9c16612653e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:39.384933 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 992/1997] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:39 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:39.390675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ee025-a7be-49f7-9d58-4933faed08a2 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:39.392493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-aa0ee025-a7be-49f7-9d58-4933faed08a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:39.396542 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f10ce795-a1b4-49fa-a7d0-9c16612653e6 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:39.397698 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f10ce795-a1b4-49fa-a7d0-9c16612653e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:39.405792 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ee025-a7be-49f7-9d58-4933faed08a2 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:39.407484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1006/1998] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:39.410742 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b9395-c1d7-43b2-a9cd-00c708b77486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:39.411675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b9395-c1d7-43b2-a9cd-00c708b77486 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:39.411806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ce795-a1b4-49fa-a7d0-9c16612653e6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:39.412078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b9395-c1d7-43b2-a9cd-00c708b77486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:39.412363 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b9395-c1d7-43b2-a9cd-00c708b77486 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:39.413118 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b9395-c1d7-43b2-a9cd-00c708b77486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:39.414783 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b9395-c1d7-43b2-a9cd-00c708b77486 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:39.421554 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ce795-a1b4-49fa-a7d0-9c16612653e6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:39.425722 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 993/1999] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:25:39.426481 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094ce4d-51a3-4248-806e-35bab6637f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:39.427137 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094ce4d-51a3-4248-806e-35bab6637f46 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:39.427424 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094ce4d-51a3-4248-806e-35bab6637f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:39.427702 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094ce4d-51a3-4248-806e-35bab6637f46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:39.428434 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094ce4d-51a3-4248-806e-35bab6637f46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:39.428742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094ce4d-51a3-4248-806e-35bab6637f46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:39.429656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b9395-c1d7-43b2-a9cd-00c708b77486 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:39.430787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094ce4d-51a3-4248-806e-35bab6637f46 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:39.447011 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1007/2000] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:25:39.447207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b9395-c1d7-43b2-a9cd-00c708b77486 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:39.448374 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094ce4d-51a3-4248-806e-35bab6637f46 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:39.449084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c701aab-e514-427b-8d21-ca2c32e6e91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:39.449747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c701aab-e514-427b-8d21-ca2c32e6e91c admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:39.450033 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c701aab-e514-427b-8d21-ca2c32e6e91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:39.450327 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c701aab-e514-427b-8d21-ca2c32e6e91c admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:39.451091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c701aab-e514-427b-8d21-ca2c32e6e91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:39.452774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c701aab-e514-427b-8d21-ca2c32e6e91c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:39.458150 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094ce4d-51a3-4248-806e-35bab6637f46 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:39.462837 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b0e89-90d7-4762-8c23-ecd7f2481167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:39.463476 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b0e89-90d7-4762-8c23-ecd7f2481167 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:39.463821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 994/2001] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:39.463936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b0e89-90d7-4762-8c23-ecd7f2481167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:39.464102 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b0e89-90d7-4762-8c23-ecd7f2481167 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:39.464861 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b0e89-90d7-4762-8c23-ecd7f2481167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:39.467608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b0e89-90d7-4762-8c23-ecd7f2481167 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:39.468434 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c701aab-e514-427b-8d21-ca2c32e6e91c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:39.478894 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c701aab-e514-427b-8d21-ca2c32e6e91c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:39.484603 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83e084-cd6e-47e4-99b6-41cc9e1aaf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:39.485967 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83e084-cd6e-47e4-99b6-41cc9e1aaf91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:39.486255 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83e084-cd6e-47e4-99b6-41cc9e1aaf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:39.486582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83e084-cd6e-47e4-99b6-41cc9e1aaf91 admin admin] PATH_INFO: `/v3/projects/086caf35edb2449ca5b1773ece8f65b2/users/a3347641326a41e89808b3be7b6a3beb/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:39.497785 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1008/2002] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:39 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:39.498879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b0e89-90d7-4762-8c23-ecd7f2481167 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:39.502882 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83e084-cd6e-47e4-99b6-41cc9e1aaf91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=086caf35edb2449ca5b1773ece8f65b2, user_id=a3347641326a41e89808b3be7b6a3beb, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:39.505746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83e084-cd6e-47e4-99b6-41cc9e1aaf91 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:39.519190 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 995/2003] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:39 2022] PUT /identity/v3/projects/086caf35edb2449ca5b1773ece8f65b2/users/a3347641326a41e89808b3be7b6a3beb/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:39.530981 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964fad8-e00c-4ef9-8aab-d9058f71aaa0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:39.531272 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964fad8-e00c-4ef9-8aab-d9058f71aaa0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:39.531625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964fad8-e00c-4ef9-8aab-d9058f71aaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:39.559062 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4964fad8-e00c-4ef9-8aab-d9058f71aaa0 None None] MFA Rules not processed for user `a3347641326a41e89808b3be7b6a3beb`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:39.560280 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4964fad8-e00c-4ef9-8aab-d9058f71aaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:39.575976 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b0e89-90d7-4762-8c23-ecd7f2481167 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:39.639449 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 996/2004] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:39.652811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964fad8-e00c-4ef9-8aab-d9058f71aaa0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:39.655569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4964fad8-e00c-4ef9-8aab-d9058f71aaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:39.662396 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25045e31-df2e-4402-b1d0-b9f4e9b3b2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:39.664623 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25045e31-df2e-4402-b1d0-b9f4e9b3b2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:39.664967 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25045e31-df2e-4402-b1d0-b9f4e9b3b2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:39.665514 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25045e31-df2e-4402-b1d0-b9f4e9b3b2f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:39.666233 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25045e31-df2e-4402-b1d0-b9f4e9b3b2f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:39.669039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25045e31-df2e-4402-b1d0-b9f4e9b3b2f6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:39.705344 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1009/2005] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:39 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:39.708373 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25045e31-df2e-4402-b1d0-b9f4e9b3b2f6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:39.728847 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25045e31-df2e-4402-b1d0-b9f4e9b3b2f6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:39.735363 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c205692-34c0-49b6-a62f-8611dc49a6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:39.736143 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c205692-34c0-49b6-a62f-8611dc49a6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:39.736764 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c205692-34c0-49b6-a62f-8611dc49a6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:39.737156 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c205692-34c0-49b6-a62f-8611dc49a6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:39.737959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c205692-34c0-49b6-a62f-8611dc49a6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:39.739651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c205692-34c0-49b6-a62f-8611dc49a6a7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:39.747097 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964fad8-e00c-4ef9-8aab-d9058f71aaa0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:39.751489 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10343cbf-5238-4995-abf6-d32354997fc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:39.752195 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1010/2006] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:25:39.752622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10343cbf-5238-4995-abf6-d32354997fc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:39.752979 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10343cbf-5238-4995-abf6-d32354997fc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:39.753273 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10343cbf-5238-4995-abf6-d32354997fc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:39.757348 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c205692-34c0-49b6-a62f-8611dc49a6a7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:39.764086 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10343cbf-5238-4995-abf6-d32354997fc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:39.767266 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10343cbf-5238-4995-abf6-d32354997fc9 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:39.778680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c205692-34c0-49b6-a62f-8611dc49a6a7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:39.779855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 997/2007] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:39.787514 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19640423-aa56-46cf-9b31-a7f22ffec091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:39.788533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19640423-aa56-46cf-9b31-a7f22ffec091 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:39.788971 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19640423-aa56-46cf-9b31-a7f22ffec091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:39.789588 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19640423-aa56-46cf-9b31-a7f22ffec091 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:39.790779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19640423-aa56-46cf-9b31-a7f22ffec091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:39.793278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19640423-aa56-46cf-9b31-a7f22ffec091 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:39.799943 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10343cbf-5238-4995-abf6-d32354997fc9 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:39.801232 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:39.816355 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10343cbf-5238-4995-abf6-d32354997fc9 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:39.819342 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1011/2008] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:39.822753 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19640423-aa56-46cf-9b31-a7f22ffec091 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:39.830220 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33576920-ac9a-487f-816d-35984e333e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:39.831871 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33576920-ac9a-487f-816d-35984e333e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:39.831993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33576920-ac9a-487f-816d-35984e333e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:39.832433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33576920-ac9a-487f-816d-35984e333e5d admin admin] PATH_INFO: `/v3/users/a3347641326a41e89808b3be7b6a3beb` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:39.834425 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33576920-ac9a-487f-816d-35984e333e5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3347641326a41e89808b3be7b6a3beb)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:39.837563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33576920-ac9a-487f-816d-35984e333e5d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:39.842904 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19640423-aa56-46cf-9b31-a7f22ffec091 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:39.860582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a7b3d-377e-45f8-8c30-99a2860876cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:39.861529 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a7b3d-377e-45f8-8c30-99a2860876cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:39.861830 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a7b3d-377e-45f8-8c30-99a2860876cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:39.862094 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a7b3d-377e-45f8-8c30-99a2860876cc admin admin] PATH_INFO: `/v3/projects/ae4734a79e5d4411b40e61d5dc97a0cd/users/d3bb8f0454a54519bac9d432129eb59b/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:39.866289 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:39.897470 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a7b3d-377e-45f8-8c30-99a2860876cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae4734a79e5d4411b40e61d5dc97a0cd, user_id=d3bb8f0454a54519bac9d432129eb59b, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:39.901140 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a7b3d-377e-45f8-8c30-99a2860876cc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:39.920448 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1012/2009] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:39 2022] PUT /identity/v3/projects/ae4734a79e5d4411b40e61d5dc97a0cd/users/d3bb8f0454a54519bac9d432129eb59b/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:39.932057 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bb5fe-9fbf-4db6-9ddb-deaed4048df5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:39.932323 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bb5fe-9fbf-4db6-9ddb-deaed4048df5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:39.932603 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bb5fe-9fbf-4db6-9ddb-deaed4048df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:39.956751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-33576920-ac9a-487f-816d-35984e333e5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3347641326a41e89808b3be7b6a3beb'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:39.969817 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c17bb5fe-9fbf-4db6-9ddb-deaed4048df5 None None] MFA Rules not processed for user `d3bb8f0454a54519bac9d432129eb59b`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:39.970643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-33576920-ac9a-487f-816d-35984e333e5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3347641326a41e89808b3be7b6a3beb'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:39.971232 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c17bb5fe-9fbf-4db6-9ddb-deaed4048df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:39.979618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-33576920-ac9a-487f-816d-35984e333e5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3347641326a41e89808b3be7b6a3beb'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:39.980252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-33576920-ac9a-487f-816d-35984e333e5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3347641326a41e89808b3be7b6a3beb'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:39.981155 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-33576920-ac9a-487f-816d-35984e333e5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3347641326a41e89808b3be7b6a3beb'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.004288 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 998/2010] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:39 2022] DELETE /identity/v3/users/a3347641326a41e89808b3be7b6a3beb => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:40.014582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2a504-6c75-45c0-ab13-cded3852bcf3 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:40.014969 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2a504-6c75-45c0-ab13-cded3852bcf3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:40.015366 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2a504-6c75-45c0-ab13-cded3852bcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:40.037968 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-6ea2a504-6c75-45c0-ab13-cded3852bcf3 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:40.039319 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6ea2a504-6c75-45c0-ab13-cded3852bcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:40.050873 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1013/2011] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:40.063486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bb5fe-9fbf-4db6-9ddb-deaed4048df5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:40.065568 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c17bb5fe-9fbf-4db6-9ddb-deaed4048df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:40.125855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 999/2012] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:40.136467 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bb5fe-9fbf-4db6-9ddb-deaed4048df5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:40.139835 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2a504-6c75-45c0-ab13-cded3852bcf3 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:40.142328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6ea2a504-6c75-45c0-ab13-cded3852bcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:40.219982 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cee0a-65ca-4e55-b083-0cb6ba834c20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:40.221260 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cee0a-65ca-4e55-b083-0cb6ba834c20 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:40.221778 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cee0a-65ca-4e55-b083-0cb6ba834c20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:40.222499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cee0a-65ca-4e55-b083-0cb6ba834c20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:40.249065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2a504-6c75-45c0-ab13-cded3852bcf3 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:40.253608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c9fb8-0916-4b9c-a13f-5dd480dafe39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:40.254458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c9fb8-0916-4b9c-a13f-5dd480dafe39 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:40.254736 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c9fb8-0916-4b9c-a13f-5dd480dafe39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:40.255085 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c9fb8-0916-4b9c-a13f-5dd480dafe39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:40.265359 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c9fb8-0916-4b9c-a13f-5dd480dafe39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:40.269013 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c9fb8-0916-4b9c-a13f-5dd480dafe39 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:40.280945 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1000/2013] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:25:40.294269 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:40.400533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cee0a-65ca-4e55-b083-0cb6ba834c20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:40.411307 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cee0a-65ca-4e55-b083-0cb6ba834c20 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:40.462901 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1014/2014] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:25:40.740253 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c9fb8-0916-4b9c-a13f-5dd480dafe39 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:40.741515 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6d8c9fb8-0916-4b9c-a13f-5dd480dafe39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:40.771391 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c9fb8-0916-4b9c-a13f-5dd480dafe39 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:40.776357 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c795d4-0bdb-40b4-97a2-b3419a703fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:40.777479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c795d4-0bdb-40b4-97a2-b3419a703fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:40.778210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c795d4-0bdb-40b4-97a2-b3419a703fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:40.778525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c795d4-0bdb-40b4-97a2-b3419a703fbc admin admin] PATH_INFO: `/v3/projects/086caf35edb2449ca5b1773ece8f65b2` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:40.780433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c795d4-0bdb-40b4-97a2-b3419a703fbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=086caf35edb2449ca5b1773ece8f65b2)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:40.782784 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c795d4-0bdb-40b4-97a2-b3419a703fbc admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:40.823986 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:40.854706 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f3c795d4-0bdb-40b4-97a2-b3419a703fbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '086caf35edb2449ca5b1773ece8f65b2', 'request_id': 'req-f3c795d4-0bdb-40b4-97a2-b3419a703fbc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.862163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f3c795d4-0bdb-40b4-97a2-b3419a703fbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '086caf35edb2449ca5b1773ece8f65b2', 'request_id': 'req-f3c795d4-0bdb-40b4-97a2-b3419a703fbc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.868140 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f3c795d4-0bdb-40b4-97a2-b3419a703fbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '086caf35edb2449ca5b1773ece8f65b2', 'request_id': 'req-f3c795d4-0bdb-40b4-97a2-b3419a703fbc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.882268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f3c795d4-0bdb-40b4-97a2-b3419a703fbc admin admin] The token cache is being invalidate because project 086caf35edb2449ca5b1773ece8f65b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:40.882892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f3c795d4-0bdb-40b4-97a2-b3419a703fbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.883310 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f3c795d4-0bdb-40b4-97a2-b3419a703fbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:40.884939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1001/2015] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:40 2022] DELETE /identity/v3/projects/086caf35edb2449ca5b1773ece8f65b2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:40.890054 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054abbe0-d5b5-4609-8017-ecfd09b79395 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:40.890415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054abbe0-d5b5-4609-8017-ecfd09b79395 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:40.890679 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054abbe0-d5b5-4609-8017-ecfd09b79395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:40.910272 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-054abbe0-d5b5-4609-8017-ecfd09b79395 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:40.911803 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-054abbe0-d5b5-4609-8017-ecfd09b79395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:40.975359 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1015/2016] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:40.985830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008098e-c239-426c-ae9b-65e1fa93b879 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:40.985830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008098e-c239-426c-ae9b-65e1fa93b879 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:40.985830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008098e-c239-426c-ae9b-65e1fa93b879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.006790 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9008098e-c239-426c-ae9b-65e1fa93b879 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:41.008616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9008098e-c239-426c-ae9b-65e1fa93b879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:41.022748 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1002/2017] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:41.024300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054abbe0-d5b5-4609-8017-ecfd09b79395 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.039073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054abbe0-d5b5-4609-8017-ecfd09b79395 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.044498 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0366537-c5ca-4e2c-b444-a94cf48528c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.045680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0366537-c5ca-4e2c-b444-a94cf48528c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.045963 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0366537-c5ca-4e2c-b444-a94cf48528c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.046246 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0366537-c5ca-4e2c-b444-a94cf48528c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.047205 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0366537-c5ca-4e2c-b444-a94cf48528c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:41.047545 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0366537-c5ca-4e2c-b444-a94cf48528c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.050603 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0366537-c5ca-4e2c-b444-a94cf48528c7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.072624 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1016/2018] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:41.074650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008098e-c239-426c-ae9b-65e1fa93b879 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.087001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008098e-c239-426c-ae9b-65e1fa93b879 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.094178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5ed12-7d66-4bc8-9fc8-353ff3a474ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.094992 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5ed12-7d66-4bc8-9fc8-353ff3a474ff admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.095282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5ed12-7d66-4bc8-9fc8-353ff3a474ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.095594 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5ed12-7d66-4bc8-9fc8-353ff3a474ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.096297 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5ed12-7d66-4bc8-9fc8-353ff3a474ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.098356 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5ed12-7d66-4bc8-9fc8-353ff3a474ff admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.140830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1003/2019] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:41 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:41.144972 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0366537-c5ca-4e2c-b444-a94cf48528c7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.167959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0366537-c5ca-4e2c-b444-a94cf48528c7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.308246 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4710146-b8ef-4aab-99f8-aa2e3b77f4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.308934 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4710146-b8ef-4aab-99f8-aa2e3b77f4f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.309218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4710146-b8ef-4aab-99f8-aa2e3b77f4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.309532 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4710146-b8ef-4aab-99f8-aa2e3b77f4f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.311557 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4710146-b8ef-4aab-99f8-aa2e3b77f4f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.313757 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4710146-b8ef-4aab-99f8-aa2e3b77f4f8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.342411 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1017/2020] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:41 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:41.345606 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5ed12-7d66-4bc8-9fc8-353ff3a474ff admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.357334 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5ed12-7d66-4bc8-9fc8-353ff3a474ff admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.364112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c67e6-9442-4424-94c2-7400d0d76914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.365060 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c67e6-9442-4424-94c2-7400d0d76914 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.365357 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c67e6-9442-4424-94c2-7400d0d76914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.366125 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c67e6-9442-4424-94c2-7400d0d76914 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.367275 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c67e6-9442-4424-94c2-7400d0d76914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.369243 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c67e6-9442-4424-94c2-7400d0d76914 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.392436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1004/2021] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:41.399759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4710146-b8ef-4aab-99f8-aa2e3b77f4f8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.414448 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4710146-b8ef-4aab-99f8-aa2e3b77f4f8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.419896 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3d663-ce09-4328-89e0-d641f76449f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.420560 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3d663-ce09-4328-89e0-d641f76449f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.420843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3d663-ce09-4328-89e0-d641f76449f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.421118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3d663-ce09-4328-89e0-d641f76449f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.421938 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3d663-ce09-4328-89e0-d641f76449f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.425439 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3d663-ce09-4328-89e0-d641f76449f8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.444087 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1018/2022] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:41.452833 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c67e6-9442-4424-94c2-7400d0d76914 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.454868 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3d663-ce09-4328-89e0-d641f76449f8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.456660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-52b3d663-ce09-4328-89e0-d641f76449f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:41.471208 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c67e6-9442-4424-94c2-7400d0d76914 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.471922 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3d663-ce09-4328-89e0-d641f76449f8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.476224 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354d02d-8900-43c1-b114-fdecca934581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.476501 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d96709-0c3a-4229-8375-440eae6a6c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.477116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354d02d-8900-43c1-b114-fdecca934581 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.477368 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d96709-0c3a-4229-8375-440eae6a6c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.477477 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354d02d-8900-43c1-b114-fdecca934581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.477653 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d96709-0c3a-4229-8375-440eae6a6c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.477782 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354d02d-8900-43c1-b114-fdecca934581 admin admin] PATH_INFO: `/v3/projects/fbe6c9972c1b43888c59a2b6603c5dea/users/4af386cb510f4186852b01f84a2f224f/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.477926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d96709-0c3a-4229-8375-440eae6a6c74 admin admin] PATH_INFO: `/v3/users/9611223d0e044554b47bfff799a90d7c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.479149 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d96709-0c3a-4229-8375-440eae6a6c74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9611223d0e044554b47bfff799a90d7c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.481054 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d96709-0c3a-4229-8375-440eae6a6c74 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.492922 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354d02d-8900-43c1-b114-fdecca934581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe6c9972c1b43888c59a2b6603c5dea, user_id=4af386cb510f4186852b01f84a2f224f, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.495590 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354d02d-8900-43c1-b114-fdecca934581 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.509838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1005/2023] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:41 2022] PUT /identity/v3/projects/fbe6c9972c1b43888c59a2b6603c5dea/users/4af386cb510f4186852b01f84a2f224f/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:41.520763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13578a39-7497-41cf-9d24-19b6f505c24e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.521068 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13578a39-7497-41cf-9d24-19b6f505c24e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.521334 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13578a39-7497-41cf-9d24-19b6f505c24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.525077 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:41.538561 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-60d96709-0c3a-4229-8375-440eae6a6c74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9611223d0e044554b47bfff799a90d7c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:41.545793 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-60d96709-0c3a-4229-8375-440eae6a6c74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9611223d0e044554b47bfff799a90d7c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:41.548829 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-13578a39-7497-41cf-9d24-19b6f505c24e None None] MFA Rules not processed for user `4af386cb510f4186852b01f84a2f224f`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:41.550123 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-13578a39-7497-41cf-9d24-19b6f505c24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:41.564616 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-60d96709-0c3a-4229-8375-440eae6a6c74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9611223d0e044554b47bfff799a90d7c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:41.572718 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-60d96709-0c3a-4229-8375-440eae6a6c74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9611223d0e044554b47bfff799a90d7c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:41.573432 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-60d96709-0c3a-4229-8375-440eae6a6c74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9611223d0e044554b47bfff799a90d7c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:41.585828 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1019/2024] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:41 2022] DELETE /identity/v3/users/9611223d0e044554b47bfff799a90d7c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:41.591932 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22501f21-1955-4729-8ce5-adceceae4dff None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.592382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22501f21-1955-4729-8ce5-adceceae4dff None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.592730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22501f21-1955-4729-8ce5-adceceae4dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.609978 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-22501f21-1955-4729-8ce5-adceceae4dff None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:41.611211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-22501f21-1955-4729-8ce5-adceceae4dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:41.618204 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1006/2025] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:41.623297 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13578a39-7497-41cf-9d24-19b6f505c24e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.624819 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-13578a39-7497-41cf-9d24-19b6f505c24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:41.670468 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1020/2026] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:41.671675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:41.682082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22501f21-1955-4729-8ce5-adceceae4dff None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.683562 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-22501f21-1955-4729-8ce5-adceceae4dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:41.693492 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13578a39-7497-41cf-9d24-19b6f505c24e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.702564 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8524741-e983-454d-951e-04976bfb0e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.703235 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8524741-e983-454d-951e-04976bfb0e72 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.703517 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8524741-e983-454d-951e-04976bfb0e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.703799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8524741-e983-454d-951e-04976bfb0e72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.704489 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8524741-e983-454d-951e-04976bfb0e72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.706424 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8524741-e983-454d-951e-04976bfb0e72 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.742797 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1007/2027] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:41 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:41.747009 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8524741-e983-454d-951e-04976bfb0e72 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.754409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22501f21-1955-4729-8ce5-adceceae4dff None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.816372 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ca932-f797-4943-a41e-0ba7d241c914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.817196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ca932-f797-4943-a41e-0ba7d241c914 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.817498 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ca932-f797-4943-a41e-0ba7d241c914 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.817765 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ca932-f797-4943-a41e-0ba7d241c914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.819567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8524741-e983-454d-951e-04976bfb0e72 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.824356 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a2487-2f45-462f-a756-60784f49a999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.825098 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a2487-2f45-462f-a756-60784f49a999 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.825456 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a2487-2f45-462f-a756-60784f49a999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.825994 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a2487-2f45-462f-a756-60784f49a999 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.826791 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a2487-2f45-462f-a756-60784f49a999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.828336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ca932-f797-4943-a41e-0ba7d241c914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.828895 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a2487-2f45-462f-a756-60784f49a999 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.830500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ca932-f797-4943-a41e-0ba7d241c914 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.842710 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1021/2028] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:25:41.854245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1008/2029] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:41 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:41.858279 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ca932-f797-4943-a41e-0ba7d241c914 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.871617 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ca932-f797-4943-a41e-0ba7d241c914 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.877048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec62e8-aa9f-4775-8179-d44202dbbd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.877793 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec62e8-aa9f-4775-8179-d44202dbbd52 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.878366 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec62e8-aa9f-4775-8179-d44202dbbd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.878655 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec62e8-aa9f-4775-8179-d44202dbbd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.880536 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec62e8-aa9f-4775-8179-d44202dbbd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.881315 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec62e8-aa9f-4775-8179-d44202dbbd52 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.888829 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:41.899112 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1022/2030] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:25:41.899959 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a2487-2f45-462f-a756-60784f49a999 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:41.913588 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a2487-2f45-462f-a756-60784f49a999 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:41.918789 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dc767-39b6-4809-8c2e-b6b243f0da59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:41.920007 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dc767-39b6-4809-8c2e-b6b243f0da59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:41.920288 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dc767-39b6-4809-8c2e-b6b243f0da59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:41.920562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576dc767-39b6-4809-8c2e-b6b243f0da59 admin admin] PATH_INFO: `/v3/projects/621af0635af94ee9a720d0c3b5439bcc/users/cd73d15c20cd45eb92d8849195e8a284/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:41.957517 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576dc767-39b6-4809-8c2e-b6b243f0da59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=621af0635af94ee9a720d0c3b5439bcc, user_id=cd73d15c20cd45eb92d8849195e8a284, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:41.965457 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576dc767-39b6-4809-8c2e-b6b243f0da59 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:41.999772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec62e8-aa9f-4775-8179-d44202dbbd52 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:42.001161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1009/2031] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:41 2022] PUT /identity/v3/projects/621af0635af94ee9a720d0c3b5439bcc/users/cd73d15c20cd45eb92d8849195e8a284/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:42.013202 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec62e8-aa9f-4775-8179-d44202dbbd52 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:42.114764 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02d84e-507d-4f1b-8ee3-dba127430e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:42.116006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02d84e-507d-4f1b-8ee3-dba127430e38 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:42.116569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02d84e-507d-4f1b-8ee3-dba127430e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:42.117027 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02d84e-507d-4f1b-8ee3-dba127430e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:42.118702 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02d84e-507d-4f1b-8ee3-dba127430e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:42.120873 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e02d84e-507d-4f1b-8ee3-dba127430e38 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:42.134073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1023/2032] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:42.139557 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dc767-39b6-4809-8c2e-b6b243f0da59 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:42.199109 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576dc767-39b6-4809-8c2e-b6b243f0da59 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:42.211577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73402b-e606-4edf-add8-d3b5f695a24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:42.212950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73402b-e606-4edf-add8-d3b5f695a24f admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:42.214638 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73402b-e606-4edf-add8-d3b5f695a24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:42.214933 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73402b-e606-4edf-add8-d3b5f695a24f admin admin] PATH_INFO: `/v3/projects/621af0635af94ee9a720d0c3b5439bcc/users/cd73d15c20cd45eb92d8849195e8a284/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:42.220560 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73402b-e606-4edf-add8-d3b5f695a24f admin admin] RBAC: Authorizing `identity:create_grant(project_id=621af0635af94ee9a720d0c3b5439bcc, user_id=cd73d15c20cd45eb92d8849195e8a284, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:42.227870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73402b-e606-4edf-add8-d3b5f695a24f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:42.264704 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1010/2033] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:42 2022] PUT /identity/v3/projects/621af0635af94ee9a720d0c3b5439bcc/users/cd73d15c20cd45eb92d8849195e8a284/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:42.275773 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee2077-8d0c-4142-a7ef-3ead7af6c781 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:42.276060 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee2077-8d0c-4142-a7ef-3ead7af6c781 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:42.276418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee2077-8d0c-4142-a7ef-3ead7af6c781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:42.345042 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-38ee2077-8d0c-4142-a7ef-3ead7af6c781 None None] MFA Rules not processed for user `cd73d15c20cd45eb92d8849195e8a284`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:42.346456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-38ee2077-8d0c-4142-a7ef-3ead7af6c781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:42.462885 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73402b-e606-4edf-add8-d3b5f695a24f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:42.464774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5a73402b-e606-4edf-add8-d3b5f695a24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:42.506826 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1024/2034] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:42.538609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee2077-8d0c-4142-a7ef-3ead7af6c781 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:42.539220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-38ee2077-8d0c-4142-a7ef-3ead7af6c781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:42.574662 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73402b-e606-4edf-add8-d3b5f695a24f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:42.586662 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1238d5e-a1d0-4a8d-9599-40a14449ca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:42.587749 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1238d5e-a1d0-4a8d-9599-40a14449ca16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:42.588195 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1238d5e-a1d0-4a8d-9599-40a14449ca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:42.588631 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1238d5e-a1d0-4a8d-9599-40a14449ca16 admin admin] PATH_INFO: `/v3/projects/7b8de5729fdc45629124431f1d407a76` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:42.589996 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1238d5e-a1d0-4a8d-9599-40a14449ca16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b8de5729fdc45629124431f1d407a76)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:42.592678 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1238d5e-a1d0-4a8d-9599-40a14449ca16 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:42.625669 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:42.670558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee2077-8d0c-4142-a7ef-3ead7af6c781 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:42.682111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d1238d5e-a1d0-4a8d-9599-40a14449ca16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b8de5729fdc45629124431f1d407a76', 'request_id': 'req-d1238d5e-a1d0-4a8d-9599-40a14449ca16'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:42.695032 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d1238d5e-a1d0-4a8d-9599-40a14449ca16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b8de5729fdc45629124431f1d407a76', 'request_id': 'req-d1238d5e-a1d0-4a8d-9599-40a14449ca16'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:42.726108 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d1238d5e-a1d0-4a8d-9599-40a14449ca16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b8de5729fdc45629124431f1d407a76', 'request_id': 'req-d1238d5e-a1d0-4a8d-9599-40a14449ca16'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:42.760784 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d1238d5e-a1d0-4a8d-9599-40a14449ca16 admin admin] The token cache is being invalidate because project 7b8de5729fdc45629124431f1d407a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:42.760784 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d1238d5e-a1d0-4a8d-9599-40a14449ca16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:42.763921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d1238d5e-a1d0-4a8d-9599-40a14449ca16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:42.767825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1011/2035] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:42 2022] DELETE /identity/v3/projects/7b8de5729fdc45629124431f1d407a76 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:42.772234 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1238d5e-a1d0-4a8d-9599-40a14449ca16 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:42.776835 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d1238d5e-a1d0-4a8d-9599-40a14449ca16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:42.780370 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:42.826902 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a6a06-cbb6-42b7-ab7a-20758d60be15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:42.827587 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a6a06-cbb6-42b7-ab7a-20758d60be15 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:42.827873 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a6a06-cbb6-42b7-ab7a-20758d60be15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:42.828159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a6a06-cbb6-42b7-ab7a-20758d60be15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:42.838181 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-079a6a06-cbb6-42b7-ab7a-20758d60be15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:42.929574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1238d5e-a1d0-4a8d-9599-40a14449ca16 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:42.943278 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80cf2b-75ec-444f-987a-f2acfca36bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:42.944425 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80cf2b-75ec-444f-987a-f2acfca36bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:42.944814 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80cf2b-75ec-444f-987a-f2acfca36bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:42.945184 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80cf2b-75ec-444f-987a-f2acfca36bc4 admin admin] PATH_INFO: `/v3/users/654bd1e254264b32908164f8fb955c7b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:42.946619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80cf2b-75ec-444f-987a-f2acfca36bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=654bd1e254264b32908164f8fb955c7b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:42.949089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80cf2b-75ec-444f-987a-f2acfca36bc4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:42.962879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a6a06-cbb6-42b7-ab7a-20758d60be15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:42.964388 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a6a06-cbb6-42b7-ab7a-20758d60be15 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:42.977217 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1025/2036] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:25:43.033984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bd80cf2b-75ec-444f-987a-f2acfca36bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '654bd1e254264b32908164f8fb955c7b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:43.042643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bd80cf2b-75ec-444f-987a-f2acfca36bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '654bd1e254264b32908164f8fb955c7b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:43.058837 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bd80cf2b-75ec-444f-987a-f2acfca36bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '654bd1e254264b32908164f8fb955c7b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:43.059462 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bd80cf2b-75ec-444f-987a-f2acfca36bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '654bd1e254264b32908164f8fb955c7b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:43.060754 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bd80cf2b-75ec-444f-987a-f2acfca36bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '654bd1e254264b32908164f8fb955c7b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:43.085843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1012/2037] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:42 2022] DELETE /identity/v3/users/654bd1e254264b32908164f8fb955c7b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:43.470019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a6a06-cbb6-42b7-ab7a-20758d60be15 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:43.485229 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a6a06-cbb6-42b7-ab7a-20758d60be15 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:43.594592 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87230d4-5120-461f-8de5-95e318df24c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:43.595468 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87230d4-5120-461f-8de5-95e318df24c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:43.595920 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87230d4-5120-461f-8de5-95e318df24c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:43.596202 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87230d4-5120-461f-8de5-95e318df24c2 admin admin] PATH_INFO: `/v3/projects/e7443250a2844587961cc0d45de30d5b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:43.599393 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87230d4-5120-461f-8de5-95e318df24c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7443250a2844587961cc0d45de30d5b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:43.613004 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87230d4-5120-461f-8de5-95e318df24c2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:43.681996 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d87230d4-5120-461f-8de5-95e318df24c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7443250a2844587961cc0d45de30d5b', 'request_id': 'req-d87230d4-5120-461f-8de5-95e318df24c2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:43.690407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d87230d4-5120-461f-8de5-95e318df24c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7443250a2844587961cc0d45de30d5b', 'request_id': 'req-d87230d4-5120-461f-8de5-95e318df24c2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:43.704613 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d87230d4-5120-461f-8de5-95e318df24c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7443250a2844587961cc0d45de30d5b', 'request_id': 'req-d87230d4-5120-461f-8de5-95e318df24c2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:43.718156 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d87230d4-5120-461f-8de5-95e318df24c2 admin admin] The token cache is being invalidate because project e7443250a2844587961cc0d45de30d5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:43.722555 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d87230d4-5120-461f-8de5-95e318df24c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:43.724877 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d87230d4-5120-461f-8de5-95e318df24c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:43.726579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1026/2038] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:43 2022] DELETE /identity/v3/projects/e7443250a2844587961cc0d45de30d5b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:43.731557 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab105351-a816-4d32-95a9-906512122add None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:43.732322 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab105351-a816-4d32-95a9-906512122add None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:43.732807 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab105351-a816-4d32-95a9-906512122add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:43.755933 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ab105351-a816-4d32-95a9-906512122add None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:43.757163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ab105351-a816-4d32-95a9-906512122add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:43.783676 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:43.827853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1013/2039] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:43.835754 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ad042-d0fe-4c57-ac55-df0436edfef6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:43.836037 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ad042-d0fe-4c57-ac55-df0436edfef6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:43.836311 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ad042-d0fe-4c57-ac55-df0436edfef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:43.858422 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c09ad042-d0fe-4c57-ac55-df0436edfef6 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:43.859724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c09ad042-d0fe-4c57-ac55-df0436edfef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:43.869094 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1027/2040] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:43.873903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab105351-a816-4d32-95a9-906512122add None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:43.883626 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab105351-a816-4d32-95a9-906512122add None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:43.888948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e916386-3098-4e88-9155-0e981c8203d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:43.889929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e916386-3098-4e88-9155-0e981c8203d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:43.889929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e916386-3098-4e88-9155-0e981c8203d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:43.890206 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e916386-3098-4e88-9155-0e981c8203d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:43.890971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e916386-3098-4e88-9155-0e981c8203d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:43.891283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e916386-3098-4e88-9155-0e981c8203d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:43.892891 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e916386-3098-4e88-9155-0e981c8203d9 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:43.907647 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1014/2041] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:43.913981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ad042-d0fe-4c57-ac55-df0436edfef6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:43.924571 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ad042-d0fe-4c57-ac55-df0436edfef6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:43.929347 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54429de-54be-472c-8624-9ef7789ccaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:43.930004 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54429de-54be-472c-8624-9ef7789ccaf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:43.930291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54429de-54be-472c-8624-9ef7789ccaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:43.930620 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54429de-54be-472c-8624-9ef7789ccaf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:43.931314 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54429de-54be-472c-8624-9ef7789ccaf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:43.933237 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54429de-54be-472c-8624-9ef7789ccaf0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:43.947293 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:43.968286 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1028/2042] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:43 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:43.973389 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e916386-3098-4e88-9155-0e981c8203d9 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:43.985989 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e916386-3098-4e88-9155-0e981c8203d9 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:44.059030 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c300bb-5794-4aeb-a6b1-ff43d57732da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:44.060047 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c300bb-5794-4aeb-a6b1-ff43d57732da admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:44.060423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c300bb-5794-4aeb-a6b1-ff43d57732da admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:44.060954 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c300bb-5794-4aeb-a6b1-ff43d57732da admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:44.061866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c300bb-5794-4aeb-a6b1-ff43d57732da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:44.064041 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c300bb-5794-4aeb-a6b1-ff43d57732da admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:44.089451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1015/2043] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:43 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:44.094167 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54429de-54be-472c-8624-9ef7789ccaf0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:44.105068 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54429de-54be-472c-8624-9ef7789ccaf0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:44.110833 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0daa30-dda7-4d00-894a-a8f78dcd30d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:44.111629 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0daa30-dda7-4d00-894a-a8f78dcd30d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:44.111994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0daa30-dda7-4d00-894a-a8f78dcd30d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:44.112273 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0daa30-dda7-4d00-894a-a8f78dcd30d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:44.113017 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0daa30-dda7-4d00-894a-a8f78dcd30d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:44.114733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0daa30-dda7-4d00-894a-a8f78dcd30d6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:44.126352 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1029/2044] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:44.133024 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c300bb-5794-4aeb-a6b1-ff43d57732da admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:44.144716 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c300bb-5794-4aeb-a6b1-ff43d57732da admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:44.150686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4f87f-01e2-49a6-8224-59a2a10a2af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:44.151454 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4f87f-01e2-49a6-8224-59a2a10a2af8 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:44.151811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4f87f-01e2-49a6-8224-59a2a10a2af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:44.152161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4f87f-01e2-49a6-8224-59a2a10a2af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:44.152992 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4f87f-01e2-49a6-8224-59a2a10a2af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:44.154679 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d4f87f-01e2-49a6-8224-59a2a10a2af8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:44.165855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1016/2045] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:44.170725 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0daa30-dda7-4d00-894a-a8f78dcd30d6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:44.181064 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0daa30-dda7-4d00-894a-a8f78dcd30d6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:44.189982 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70fcee-6e94-488e-9ef1-f48a2bbe337e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:44.190414 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70fcee-6e94-488e-9ef1-f48a2bbe337e admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:44.190654 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70fcee-6e94-488e-9ef1-f48a2bbe337e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:44.191059 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70fcee-6e94-488e-9ef1-f48a2bbe337e admin admin] PATH_INFO: `/v3/projects/c3a80c480107493ab8f5e1759072e194/users/5ecd92f9c47d4ec4b25b209d21c4fd7b/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:44.212802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70fcee-6e94-488e-9ef1-f48a2bbe337e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3a80c480107493ab8f5e1759072e194, user_id=5ecd92f9c47d4ec4b25b209d21c4fd7b, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:44.219931 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e70fcee-6e94-488e-9ef1-f48a2bbe337e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:44.242345 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1030/2046] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:44 2022] PUT /identity/v3/projects/c3a80c480107493ab8f5e1759072e194/users/5ecd92f9c47d4ec4b25b209d21c4fd7b/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:44.253984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4688b7f-0689-4c48-8415-2329b41f7083 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:44.254280 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4688b7f-0689-4c48-8415-2329b41f7083 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:44.254598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4688b7f-0689-4c48-8415-2329b41f7083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:44.289337 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a4688b7f-0689-4c48-8415-2329b41f7083 None None] MFA Rules not processed for user `5ecd92f9c47d4ec4b25b209d21c4fd7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:44.290594 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a4688b7f-0689-4c48-8415-2329b41f7083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:44.368188 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1017/2047] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:44.373319 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70fcee-6e94-488e-9ef1-f48a2bbe337e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:44.443127 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70fcee-6e94-488e-9ef1-f48a2bbe337e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:44.447879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f9092-11f8-4adf-a557-8e2ea3255b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:44.448553 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f9092-11f8-4adf-a557-8e2ea3255b19 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:44.448874 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f9092-11f8-4adf-a557-8e2ea3255b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:44.449166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f9092-11f8-4adf-a557-8e2ea3255b19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:44.449878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f9092-11f8-4adf-a557-8e2ea3255b19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:44.451881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f9092-11f8-4adf-a557-8e2ea3255b19 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:44.478963 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1031/2048] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:44 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:44.483800 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4688b7f-0689-4c48-8415-2329b41f7083 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:44.494719 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4688b7f-0689-4c48-8415-2329b41f7083 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:44.518595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:44.562754 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dff499-491c-4049-8afa-60ea8f5a1beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:44.563542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dff499-491c-4049-8afa-60ea8f5a1beb admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:44.563828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dff499-491c-4049-8afa-60ea8f5a1beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:44.564190 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dff499-491c-4049-8afa-60ea8f5a1beb admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:44.564826 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dff499-491c-4049-8afa-60ea8f5a1beb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:44.566899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dff499-491c-4049-8afa-60ea8f5a1beb admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:44.590003 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1018/2049] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:44 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:44.595089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f9092-11f8-4adf-a557-8e2ea3255b19 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:44.605982 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f9092-11f8-4adf-a557-8e2ea3255b19 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:44.610914 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9eb2d-4f18-4333-977c-5da2354e772e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:44.611612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9eb2d-4f18-4333-977c-5da2354e772e admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:44.611900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9eb2d-4f18-4333-977c-5da2354e772e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:44.612180 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9eb2d-4f18-4333-977c-5da2354e772e admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:44.612927 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9eb2d-4f18-4333-977c-5da2354e772e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:44.614591 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9eb2d-4f18-4333-977c-5da2354e772e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:44.627618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1032/2050] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:44.632138 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dff499-491c-4049-8afa-60ea8f5a1beb admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:44.643085 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dff499-491c-4049-8afa-60ea8f5a1beb admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:44.648016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba7daa-b675-4258-bde6-205248b6845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:44.648962 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba7daa-b675-4258-bde6-205248b6845b admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:44.649245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba7daa-b675-4258-bde6-205248b6845b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:44.649517 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba7daa-b675-4258-bde6-205248b6845b admin admin] PATH_INFO: `/v3/projects/5e8066138de744129e54ff7358fe71b2/users/80986be65e0b46b89f9999a15ccedb31/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:44.671965 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba7daa-b675-4258-bde6-205248b6845b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e8066138de744129e54ff7358fe71b2, user_id=80986be65e0b46b89f9999a15ccedb31, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:44.676483 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba7daa-b675-4258-bde6-205248b6845b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:44.708200 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1019/2051] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:44 2022] PUT /identity/v3/projects/5e8066138de744129e54ff7358fe71b2/users/80986be65e0b46b89f9999a15ccedb31/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:44.712143 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9eb2d-4f18-4333-977c-5da2354e772e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:44.730478 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9eb2d-4f18-4333-977c-5da2354e772e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:44.817348 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d525e-aec6-43a4-84f3-90589eb46506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:44.818036 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d525e-aec6-43a4-84f3-90589eb46506 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:44.818334 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d525e-aec6-43a4-84f3-90589eb46506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:44.818627 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d525e-aec6-43a4-84f3-90589eb46506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:44.819367 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d525e-aec6-43a4-84f3-90589eb46506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:44.821021 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d525e-aec6-43a4-84f3-90589eb46506 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:44.837554 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1033/2052] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:44.841737 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba7daa-b675-4258-bde6-205248b6845b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:44.855746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba7daa-b675-4258-bde6-205248b6845b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:44.860520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08f2ed-24c3-4296-9da2-074d6dc03feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:44.861601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08f2ed-24c3-4296-9da2-074d6dc03feb admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:44.862037 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08f2ed-24c3-4296-9da2-074d6dc03feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:44.862494 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08f2ed-24c3-4296-9da2-074d6dc03feb admin admin] PATH_INFO: `/v3/projects/5e8066138de744129e54ff7358fe71b2/users/80986be65e0b46b89f9999a15ccedb31/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:44.864792 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08f2ed-24c3-4296-9da2-074d6dc03feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e8066138de744129e54ff7358fe71b2, user_id=80986be65e0b46b89f9999a15ccedb31, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:44.868080 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08f2ed-24c3-4296-9da2-074d6dc03feb admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:44.879666 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1020/2053] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:44 2022] PUT /identity/v3/projects/5e8066138de744129e54ff7358fe71b2/users/80986be65e0b46b89f9999a15ccedb31/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:44.890991 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee4de0-160d-4799-9fa8-ea4aeae8b26b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:44.891360 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee4de0-160d-4799-9fa8-ea4aeae8b26b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:44.891737 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee4de0-160d-4799-9fa8-ea4aeae8b26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:44.933210 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-75ee4de0-160d-4799-9fa8-ea4aeae8b26b None None] MFA Rules not processed for user `80986be65e0b46b89f9999a15ccedb31`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:44.934578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-75ee4de0-160d-4799-9fa8-ea4aeae8b26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:44.959561 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:45.013650 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1034/2054] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:45.025343 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08f2ed-24c3-4296-9da2-074d6dc03feb admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:45.027171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6d08f2ed-24c3-4296-9da2-074d6dc03feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:45.085586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08f2ed-24c3-4296-9da2-074d6dc03feb admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:45.089453 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cce0f3-fee5-4d63-bd74-2c53261d29d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:45.090103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cce0f3-fee5-4d63-bd74-2c53261d29d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:45.090440 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cce0f3-fee5-4d63-bd74-2c53261d29d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:45.090719 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cce0f3-fee5-4d63-bd74-2c53261d29d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:45.100968 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cce0f3-fee5-4d63-bd74-2c53261d29d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:45.102424 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cce0f3-fee5-4d63-bd74-2c53261d29d3 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:45.112259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1021/2055] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:45.203236 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee4de0-160d-4799-9fa8-ea4aeae8b26b None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:45.214738 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee4de0-160d-4799-9fa8-ea4aeae8b26b None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:45.220076 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc078c5-4875-4582-bfca-1a3a17cf19a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:45.220812 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc078c5-4875-4582-bfca-1a3a17cf19a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:45.221170 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc078c5-4875-4582-bfca-1a3a17cf19a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:45.221521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc078c5-4875-4582-bfca-1a3a17cf19a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:45.300511 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc078c5-4875-4582-bfca-1a3a17cf19a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:45.302004 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc078c5-4875-4582-bfca-1a3a17cf19a1 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:45.312690 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1035/2056] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:45.363647 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cce0f3-fee5-4d63-bd74-2c53261d29d3 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:45.365116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-42cce0f3-fee5-4d63-bd74-2c53261d29d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:45.447136 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cce0f3-fee5-4d63-bd74-2c53261d29d3 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:45.452586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09eba63-428a-42a2-91ae-e43094250577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:45.455157 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eba63-428a-42a2-91ae-e43094250577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:45.455558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eba63-428a-42a2-91ae-e43094250577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:45.456137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eba63-428a-42a2-91ae-e43094250577 admin admin] PATH_INFO: `/v3/users/b3ceca9590f14b708b457d2e84678dcd` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:45.457432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09eba63-428a-42a2-91ae-e43094250577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3ceca9590f14b708b457d2e84678dcd)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:45.459450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09eba63-428a-42a2-91ae-e43094250577 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:45.488345 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:45.564207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d09eba63-428a-42a2-91ae-e43094250577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3ceca9590f14b708b457d2e84678dcd'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:45.582534 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d09eba63-428a-42a2-91ae-e43094250577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3ceca9590f14b708b457d2e84678dcd'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:45.590998 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d09eba63-428a-42a2-91ae-e43094250577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3ceca9590f14b708b457d2e84678dcd'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:45.592432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d09eba63-428a-42a2-91ae-e43094250577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3ceca9590f14b708b457d2e84678dcd'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:45.593148 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d09eba63-428a-42a2-91ae-e43094250577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3ceca9590f14b708b457d2e84678dcd'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:45.612239 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1022/2057] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:45 2022] DELETE /identity/v3/users/b3ceca9590f14b708b457d2e84678dcd => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:45.616734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900fec3-2995-4b90-b637-e0bef84196e0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:45.617226 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900fec3-2995-4b90-b637-e0bef84196e0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:45.617319 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900fec3-2995-4b90-b637-e0bef84196e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:45.637030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a900fec3-2995-4b90-b637-e0bef84196e0 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:45.638814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a900fec3-2995-4b90-b637-e0bef84196e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:45.664600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09eba63-428a-42a2-91ae-e43094250577 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:45.671753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d09eba63-428a-42a2-91ae-e43094250577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:45.749082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1036/2058] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:45.755544 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09eba63-428a-42a2-91ae-e43094250577 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:45.761043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d50115-60ba-42f3-ba1d-dc7268a500bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:45.762004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d50115-60ba-42f3-ba1d-dc7268a500bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:45.762361 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d50115-60ba-42f3-ba1d-dc7268a500bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:45.762715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d50115-60ba-42f3-ba1d-dc7268a500bb admin admin] PATH_INFO: `/v3/users/5ecd92f9c47d4ec4b25b209d21c4fd7b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:45.764798 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d50115-60ba-42f3-ba1d-dc7268a500bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ecd92f9c47d4ec4b25b209d21c4fd7b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:45.766435 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900fec3-2995-4b90-b637-e0bef84196e0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:45.766913 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d50115-60ba-42f3-ba1d-dc7268a500bb admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:45.768084 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a900fec3-2995-4b90-b637-e0bef84196e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:45.824468 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c0d50115-60ba-42f3-ba1d-dc7268a500bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ecd92f9c47d4ec4b25b209d21c4fd7b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:45.836732 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c0d50115-60ba-42f3-ba1d-dc7268a500bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ecd92f9c47d4ec4b25b209d21c4fd7b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:45.842442 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900fec3-2995-4b90-b637-e0bef84196e0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:45.845532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c0d50115-60ba-42f3-ba1d-dc7268a500bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ecd92f9c47d4ec4b25b209d21c4fd7b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:45.846488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c0d50115-60ba-42f3-ba1d-dc7268a500bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ecd92f9c47d4ec4b25b209d21c4fd7b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:45.847229 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c0d50115-60ba-42f3-ba1d-dc7268a500bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ecd92f9c47d4ec4b25b209d21c4fd7b'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:45.847553 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da68009-d79d-45e7-a6fe-670e9372fc3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:45.848715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da68009-d79d-45e7-a6fe-670e9372fc3e service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:45.849459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da68009-d79d-45e7-a6fe-670e9372fc3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:45.849883 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da68009-d79d-45e7-a6fe-670e9372fc3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:45.851940 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1da68009-d79d-45e7-a6fe-670e9372fc3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:45.868519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:45.869970 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1023/2059] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:45 2022] DELETE /identity/v3/users/5ecd92f9c47d4ec4b25b209d21c4fd7b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:45.872788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da68009-d79d-45e7-a6fe-670e9372fc3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:45.874646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da68009-d79d-45e7-a6fe-670e9372fc3e service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:45.874800 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de81f13-eef2-49fd-8fd6-ccc29160f154 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:45.874943 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de81f13-eef2-49fd-8fd6-ccc29160f154 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:45.875225 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de81f13-eef2-49fd-8fd6-ccc29160f154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:45.885893 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1037/2060] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:25:45.895179 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0de81f13-eef2-49fd-8fd6-ccc29160f154 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:45.897195 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0de81f13-eef2-49fd-8fd6-ccc29160f154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:45.912544 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:45.984428 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1024/2061] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:45.987990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da68009-d79d-45e7-a6fe-670e9372fc3e service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:45.990426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1da68009-d79d-45e7-a6fe-670e9372fc3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:46.001099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de81f13-eef2-49fd-8fd6-ccc29160f154 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:46.004243 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0de81f13-eef2-49fd-8fd6-ccc29160f154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:46.007811 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da68009-d79d-45e7-a6fe-670e9372fc3e service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:46.013061 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dccf12-e6be-46de-b60d-aeb82b4581a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:46.013837 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dccf12-e6be-46de-b60d-aeb82b4581a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:46.014167 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dccf12-e6be-46de-b60d-aeb82b4581a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:46.014545 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dccf12-e6be-46de-b60d-aeb82b4581a3 admin admin] PATH_INFO: `/v3/users/4af386cb510f4186852b01f84a2f224f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:46.016312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dccf12-e6be-46de-b60d-aeb82b4581a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4af386cb510f4186852b01f84a2f224f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:46.018267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dccf12-e6be-46de-b60d-aeb82b4581a3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:46.090135 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-56dccf12-e6be-46de-b60d-aeb82b4581a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4af386cb510f4186852b01f84a2f224f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.098986 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-56dccf12-e6be-46de-b60d-aeb82b4581a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4af386cb510f4186852b01f84a2f224f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.100321 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de81f13-eef2-49fd-8fd6-ccc29160f154 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:46.104433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860583a4-33e9-4f54-ac42-230825bd5817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:46.105158 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860583a4-33e9-4f54-ac42-230825bd5817 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:46.105509 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860583a4-33e9-4f54-ac42-230825bd5817 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:46.105793 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860583a4-33e9-4f54-ac42-230825bd5817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:46.115665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-56dccf12-e6be-46de-b60d-aeb82b4581a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4af386cb510f4186852b01f84a2f224f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.116151 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860583a4-33e9-4f54-ac42-230825bd5817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:46.117622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860583a4-33e9-4f54-ac42-230825bd5817 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:46.129074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1025/2062] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:25:46.140943 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-56dccf12-e6be-46de-b60d-aeb82b4581a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4af386cb510f4186852b01f84a2f224f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.141905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-56dccf12-e6be-46de-b60d-aeb82b4581a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4af386cb510f4186852b01f84a2f224f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.151455 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1038/2063] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:45 2022] DELETE /identity/v3/users/4af386cb510f4186852b01f84a2f224f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:46.156497 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eb7a6-551a-42e3-b967-d9a7580df45c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:46.156789 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eb7a6-551a-42e3-b967-d9a7580df45c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:46.157296 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eb7a6-551a-42e3-b967-d9a7580df45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:46.176306 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9a8eb7a6-551a-42e3-b967-d9a7580df45c None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:46.178211 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9a8eb7a6-551a-42e3-b967-d9a7580df45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:46.242686 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dccf12-e6be-46de-b60d-aeb82b4581a3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:46.244976 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-56dccf12-e6be-46de-b60d-aeb82b4581a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:46.252280 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1026/2064] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:46.265570 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dccf12-e6be-46de-b60d-aeb82b4581a3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:46.270729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7bf65-ec18-4eaa-abcc-051a8807bda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:46.271594 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7bf65-ec18-4eaa-abcc-051a8807bda9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:46.271879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7bf65-ec18-4eaa-abcc-051a8807bda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:46.272155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7bf65-ec18-4eaa-abcc-051a8807bda9 admin admin] PATH_INFO: `/v3/projects/726bd27faf5f4e6c9f0b398c281c103f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:46.273363 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7bf65-ec18-4eaa-abcc-051a8807bda9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=726bd27faf5f4e6c9f0b398c281c103f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:46.274464 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8eb7a6-551a-42e3-b967-d9a7580df45c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:46.275320 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7bf65-ec18-4eaa-abcc-051a8807bda9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:46.277238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9a8eb7a6-551a-42e3-b967-d9a7580df45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:46.356354 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8eb7a6-551a-42e3-b967-d9a7580df45c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:46.367177 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-72d7bf65-ec18-4eaa-abcc-051a8807bda9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '726bd27faf5f4e6c9f0b398c281c103f', 'request_id': 'req-72d7bf65-ec18-4eaa-abcc-051a8807bda9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.375391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-72d7bf65-ec18-4eaa-abcc-051a8807bda9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '726bd27faf5f4e6c9f0b398c281c103f', 'request_id': 'req-72d7bf65-ec18-4eaa-abcc-051a8807bda9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.384948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-72d7bf65-ec18-4eaa-abcc-051a8807bda9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '726bd27faf5f4e6c9f0b398c281c103f', 'request_id': 'req-72d7bf65-ec18-4eaa-abcc-051a8807bda9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.397756 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:46.403775 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-72d7bf65-ec18-4eaa-abcc-051a8807bda9 admin admin] The token cache is being invalidate because project 726bd27faf5f4e6c9f0b398c281c103f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:46.404054 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-72d7bf65-ec18-4eaa-abcc-051a8807bda9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.404998 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-72d7bf65-ec18-4eaa-abcc-051a8807bda9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.407775 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1039/2065] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:46 2022] DELETE /identity/v3/projects/726bd27faf5f4e6c9f0b398c281c103f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:46.409592 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7bf65-ec18-4eaa-abcc-051a8807bda9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:46.411754 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-72d7bf65-ec18-4eaa-abcc-051a8807bda9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:46.443592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faa8c7-a2c6-45b6-b169-c82b342e2b59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:46.446394 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faa8c7-a2c6-45b6-b169-c82b342e2b59 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:46.446692 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faa8c7-a2c6-45b6-b169-c82b342e2b59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:46.446970 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faa8c7-a2c6-45b6-b169-c82b342e2b59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:46.449597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-44faa8c7-a2c6-45b6-b169-c82b342e2b59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:46.475343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:46.498927 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7bf65-ec18-4eaa-abcc-051a8807bda9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:46.508911 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bc347-d413-4b74-85b4-ff669afaa730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:46.510119 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bc347-d413-4b74-85b4-ff669afaa730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:46.510526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bc347-d413-4b74-85b4-ff669afaa730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:46.510898 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bc347-d413-4b74-85b4-ff669afaa730 admin admin] PATH_INFO: `/v3/users/d3bb8f0454a54519bac9d432129eb59b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:46.512279 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bc347-d413-4b74-85b4-ff669afaa730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3bb8f0454a54519bac9d432129eb59b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:46.521403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bc347-d413-4b74-85b4-ff669afaa730 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:46.559187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44faa8c7-a2c6-45b6-b169-c82b342e2b59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:46.561222 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44faa8c7-a2c6-45b6-b169-c82b342e2b59 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:46.593142 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1027/2066] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:46.594136 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faa8c7-a2c6-45b6-b169-c82b342e2b59 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:46.597888 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-44faa8c7-a2c6-45b6-b169-c82b342e2b59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:46.620312 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faa8c7-a2c6-45b6-b169-c82b342e2b59 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:46.626956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5b74c-27fe-41ff-a252-5674d7a305c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:46.628130 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5b74c-27fe-41ff-a252-5674d7a305c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:46.628390 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7a1bc347-d413-4b74-85b4-ff669afaa730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3bb8f0454a54519bac9d432129eb59b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.628865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5b74c-27fe-41ff-a252-5674d7a305c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:46.628865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5b74c-27fe-41ff-a252-5674d7a305c2 admin admin] PATH_INFO: `/v3/users/6b75c266621d4ab498c7b11aa19ff875` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:46.635741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5b74c-27fe-41ff-a252-5674d7a305c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b75c266621d4ab498c7b11aa19ff875)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:46.637693 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7a1bc347-d413-4b74-85b4-ff669afaa730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3bb8f0454a54519bac9d432129eb59b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.637830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5b74c-27fe-41ff-a252-5674d7a305c2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:46.657638 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7a1bc347-d413-4b74-85b4-ff669afaa730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3bb8f0454a54519bac9d432129eb59b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.668414 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7a1bc347-d413-4b74-85b4-ff669afaa730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3bb8f0454a54519bac9d432129eb59b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.670026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7a1bc347-d413-4b74-85b4-ff669afaa730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3bb8f0454a54519bac9d432129eb59b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.679663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1040/2067] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:46 2022] DELETE /identity/v3/users/d3bb8f0454a54519bac9d432129eb59b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:46.680794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bc347-d413-4b74-85b4-ff669afaa730 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:46.682403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7a1bc347-d413-4b74-85b4-ff669afaa730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:46.752685 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-80a5b74c-27fe-41ff-a252-5674d7a305c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b75c266621d4ab498c7b11aa19ff875'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.764066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-80a5b74c-27fe-41ff-a252-5674d7a305c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b75c266621d4ab498c7b11aa19ff875'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.780056 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-80a5b74c-27fe-41ff-a252-5674d7a305c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b75c266621d4ab498c7b11aa19ff875'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.781092 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bc347-d413-4b74-85b4-ff669afaa730 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:46.781379 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-80a5b74c-27fe-41ff-a252-5674d7a305c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b75c266621d4ab498c7b11aa19ff875'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.782508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-80a5b74c-27fe-41ff-a252-5674d7a305c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b75c266621d4ab498c7b11aa19ff875'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.786896 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406ba68-e5e5-42d5-b79b-d98fcf8ed20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:46.787720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406ba68-e5e5-42d5-b79b-d98fcf8ed20d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:46.788080 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406ba68-e5e5-42d5-b79b-d98fcf8ed20d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:46.788473 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406ba68-e5e5-42d5-b79b-d98fcf8ed20d admin admin] PATH_INFO: `/v3/projects/c3a80c480107493ab8f5e1759072e194` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:46.789762 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406ba68-e5e5-42d5-b79b-d98fcf8ed20d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3a80c480107493ab8f5e1759072e194)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:46.791825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406ba68-e5e5-42d5-b79b-d98fcf8ed20d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:46.808293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1028/2068] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:46 2022] DELETE /identity/v3/users/6b75c266621d4ab498c7b11aa19ff875 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:46.813632 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ede14-6732-40e0-b0b2-63f89943840e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:46.813914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ede14-6732-40e0-b0b2-63f89943840e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:46.814190 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ede14-6732-40e0-b0b2-63f89943840e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:46.838644 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-993ede14-6732-40e0-b0b2-63f89943840e None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:46.839892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-993ede14-6732-40e0-b0b2-63f89943840e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:46.859274 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0406ba68-e5e5-42d5-b79b-d98fcf8ed20d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3a80c480107493ab8f5e1759072e194', 'request_id': 'req-0406ba68-e5e5-42d5-b79b-d98fcf8ed20d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.866371 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0406ba68-e5e5-42d5-b79b-d98fcf8ed20d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3a80c480107493ab8f5e1759072e194', 'request_id': 'req-0406ba68-e5e5-42d5-b79b-d98fcf8ed20d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.884028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0406ba68-e5e5-42d5-b79b-d98fcf8ed20d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3a80c480107493ab8f5e1759072e194', 'request_id': 'req-0406ba68-e5e5-42d5-b79b-d98fcf8ed20d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.887765 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:46.899808 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:46.913477 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0406ba68-e5e5-42d5-b79b-d98fcf8ed20d admin admin] The token cache is being invalidate because project c3a80c480107493ab8f5e1759072e194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:46.915252 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0406ba68-e5e5-42d5-b79b-d98fcf8ed20d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.918951 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0406ba68-e5e5-42d5-b79b-d98fcf8ed20d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:46.921948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1041/2069] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:46 2022] DELETE /identity/v3/projects/c3a80c480107493ab8f5e1759072e194 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:46.926421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406ba68-e5e5-42d5-b79b-d98fcf8ed20d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:46.929061 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0406ba68-e5e5-42d5-b79b-d98fcf8ed20d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:46.930618 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1029/2070] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:46.943468 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ede14-6732-40e0-b0b2-63f89943840e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:46.946582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406ba68-e5e5-42d5-b79b-d98fcf8ed20d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:46.948047 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-993ede14-6732-40e0-b0b2-63f89943840e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:46.958680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48997aa-ab92-41cf-9188-01ce8452d971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:46.960105 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48997aa-ab92-41cf-9188-01ce8452d971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:46.961198 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48997aa-ab92-41cf-9188-01ce8452d971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:46.962972 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48997aa-ab92-41cf-9188-01ce8452d971 admin admin] PATH_INFO: `/v3/users/80986be65e0b46b89f9999a15ccedb31` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:46.964865 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48997aa-ab92-41cf-9188-01ce8452d971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80986be65e0b46b89f9999a15ccedb31)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:46.968721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48997aa-ab92-41cf-9188-01ce8452d971 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:47.060283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ede14-6732-40e0-b0b2-63f89943840e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:47.069438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974a097-890e-4819-bc8d-6aa44d9a55ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:47.070235 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974a097-890e-4819-bc8d-6aa44d9a55ad service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:47.070554 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974a097-890e-4819-bc8d-6aa44d9a55ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:47.070830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974a097-890e-4819-bc8d-6aa44d9a55ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:47.071207 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b48997aa-ab92-41cf-9188-01ce8452d971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80986be65e0b46b89f9999a15ccedb31'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.080176 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b48997aa-ab92-41cf-9188-01ce8452d971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80986be65e0b46b89f9999a15ccedb31'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.083608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974a097-890e-4819-bc8d-6aa44d9a55ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:47.085370 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974a097-890e-4819-bc8d-6aa44d9a55ad service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:47.107448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1030/2071] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:25:47.123424 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b48997aa-ab92-41cf-9188-01ce8452d971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80986be65e0b46b89f9999a15ccedb31'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.132674 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b48997aa-ab92-41cf-9188-01ce8452d971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80986be65e0b46b89f9999a15ccedb31'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.133406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b48997aa-ab92-41cf-9188-01ce8452d971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80986be65e0b46b89f9999a15ccedb31'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.142231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1042/2072] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:46 2022] DELETE /identity/v3/users/80986be65e0b46b89f9999a15ccedb31 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:47.471596 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974a097-890e-4819-bc8d-6aa44d9a55ad service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:47.473580 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b974a097-890e-4819-bc8d-6aa44d9a55ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:47.489380 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974a097-890e-4819-bc8d-6aa44d9a55ad service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:47.510553 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48997aa-ab92-41cf-9188-01ce8452d971 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:47.512322 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b48997aa-ab92-41cf-9188-01ce8452d971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:47.625525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9905bb-0486-4022-8412-758286333dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:47.633277 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9905bb-0486-4022-8412-758286333dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:47.633832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9905bb-0486-4022-8412-758286333dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:47.634381 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9905bb-0486-4022-8412-758286333dd0 admin admin] PATH_INFO: `/v3/projects/fbe6c9972c1b43888c59a2b6603c5dea` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:47.638406 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9905bb-0486-4022-8412-758286333dd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe6c9972c1b43888c59a2b6603c5dea)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:47.642958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9905bb-0486-4022-8412-758286333dd0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:47.723169 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48997aa-ab92-41cf-9188-01ce8452d971 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:47.741682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edce95-e121-4345-8d23-27ff3fa5cbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:47.743371 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edce95-e121-4345-8d23-27ff3fa5cbb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:47.744044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edce95-e121-4345-8d23-27ff3fa5cbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:47.744543 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edce95-e121-4345-8d23-27ff3fa5cbb2 admin admin] PATH_INFO: `/v3/projects/3e49535faa7c446d9334809923c1fedb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:47.746464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edce95-e121-4345-8d23-27ff3fa5cbb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e49535faa7c446d9334809923c1fedb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:47.751358 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edce95-e121-4345-8d23-27ff3fa5cbb2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:47.764355 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4d9905bb-0486-4022-8412-758286333dd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe6c9972c1b43888c59a2b6603c5dea', 'request_id': 'req-4d9905bb-0486-4022-8412-758286333dd0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.774132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4d9905bb-0486-4022-8412-758286333dd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe6c9972c1b43888c59a2b6603c5dea', 'request_id': 'req-4d9905bb-0486-4022-8412-758286333dd0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.783107 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4d9905bb-0486-4022-8412-758286333dd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe6c9972c1b43888c59a2b6603c5dea', 'request_id': 'req-4d9905bb-0486-4022-8412-758286333dd0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.803434 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4d9905bb-0486-4022-8412-758286333dd0 admin admin] The token cache is being invalidate because project fbe6c9972c1b43888c59a2b6603c5dea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:47.803724 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4d9905bb-0486-4022-8412-758286333dd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.807452 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4d9905bb-0486-4022-8412-758286333dd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.810447 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1031/2073] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:47 2022] DELETE /identity/v3/projects/fbe6c9972c1b43888c59a2b6603c5dea => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:47.815739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9905bb-0486-4022-8412-758286333dd0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:47.817306 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4d9905bb-0486-4022-8412-758286333dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:47.828915 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-07edce95-e121-4345-8d23-27ff3fa5cbb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e49535faa7c446d9334809923c1fedb', 'request_id': 'req-07edce95-e121-4345-8d23-27ff3fa5cbb2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.838352 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:47.841901 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-07edce95-e121-4345-8d23-27ff3fa5cbb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e49535faa7c446d9334809923c1fedb', 'request_id': 'req-07edce95-e121-4345-8d23-27ff3fa5cbb2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.856492 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-07edce95-e121-4345-8d23-27ff3fa5cbb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e49535faa7c446d9334809923c1fedb', 'request_id': 'req-07edce95-e121-4345-8d23-27ff3fa5cbb2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.887458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-07edce95-e121-4345-8d23-27ff3fa5cbb2 admin admin] The token cache is being invalidate because project 3e49535faa7c446d9334809923c1fedb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:47.888576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-07edce95-e121-4345-8d23-27ff3fa5cbb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.889931 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-07edce95-e121-4345-8d23-27ff3fa5cbb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:47.895778 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1043/2074] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:47 2022] DELETE /identity/v3/projects/3e49535faa7c446d9334809923c1fedb => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:47.897476 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf249b88-15fa-4f07-9f9c-7af2b788cb37 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:47.897830 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf249b88-15fa-4f07-9f9c-7af2b788cb37 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:47.898043 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf249b88-15fa-4f07-9f9c-7af2b788cb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:47.905975 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:47.936502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bf249b88-15fa-4f07-9f9c-7af2b788cb37 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:47.938070 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bf249b88-15fa-4f07-9f9c-7af2b788cb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:47.942422 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9905bb-0486-4022-8412-758286333dd0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:48.053229 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1044/2075] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:48.054146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf249b88-15fa-4f07-9f9c-7af2b788cb37 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:48.056119 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bf249b88-15fa-4f07-9f9c-7af2b788cb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:48.072902 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf249b88-15fa-4f07-9f9c-7af2b788cb37 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:48.078673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dba2d4-b17a-44f3-a4c1-38c3842f3d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:48.080008 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dba2d4-b17a-44f3-a4c1-38c3842f3d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:48.080334 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dba2d4-b17a-44f3-a4c1-38c3842f3d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:48.080609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dba2d4-b17a-44f3-a4c1-38c3842f3d29 admin admin] PATH_INFO: `/v3/projects/ae4734a79e5d4411b40e61d5dc97a0cd` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:48.082172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dba2d4-b17a-44f3-a4c1-38c3842f3d29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae4734a79e5d4411b40e61d5dc97a0cd)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:48.084891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dba2d4-b17a-44f3-a4c1-38c3842f3d29 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:48.094550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e5115-ad41-4bab-a51e-f6e92e067a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:48.096027 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e5115-ad41-4bab-a51e-f6e92e067a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:48.096462 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e5115-ad41-4bab-a51e-f6e92e067a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:48.096747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e5115-ad41-4bab-a51e-f6e92e067a66 admin admin] PATH_INFO: `/v3/users/cd73d15c20cd45eb92d8849195e8a284` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:48.098243 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e5115-ad41-4bab-a51e-f6e92e067a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd73d15c20cd45eb92d8849195e8a284)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:48.100611 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e5115-ad41-4bab-a51e-f6e92e067a66 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:48.141703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-88dba2d4-b17a-44f3-a4c1-38c3842f3d29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae4734a79e5d4411b40e61d5dc97a0cd', 'request_id': 'req-88dba2d4-b17a-44f3-a4c1-38c3842f3d29'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.150119 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-88dba2d4-b17a-44f3-a4c1-38c3842f3d29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae4734a79e5d4411b40e61d5dc97a0cd', 'request_id': 'req-88dba2d4-b17a-44f3-a4c1-38c3842f3d29'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.159084 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-88dba2d4-b17a-44f3-a4c1-38c3842f3d29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae4734a79e5d4411b40e61d5dc97a0cd', 'request_id': 'req-88dba2d4-b17a-44f3-a4c1-38c3842f3d29'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.167358 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-734e5115-ad41-4bab-a51e-f6e92e067a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd73d15c20cd45eb92d8849195e8a284'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.172168 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-88dba2d4-b17a-44f3-a4c1-38c3842f3d29 admin admin] The token cache is being invalidate because project ae4734a79e5d4411b40e61d5dc97a0cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:48.172493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-88dba2d4-b17a-44f3-a4c1-38c3842f3d29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.173165 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-88dba2d4-b17a-44f3-a4c1-38c3842f3d29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.174878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1045/2076] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:48 2022] DELETE /identity/v3/projects/ae4734a79e5d4411b40e61d5dc97a0cd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:48.175835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dba2d4-b17a-44f3-a4c1-38c3842f3d29 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:48.177152 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-88dba2d4-b17a-44f3-a4c1-38c3842f3d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:48.178840 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-734e5115-ad41-4bab-a51e-f6e92e067a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd73d15c20cd45eb92d8849195e8a284'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.190718 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-734e5115-ad41-4bab-a51e-f6e92e067a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd73d15c20cd45eb92d8849195e8a284'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.191957 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-734e5115-ad41-4bab-a51e-f6e92e067a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd73d15c20cd45eb92d8849195e8a284'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.192961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-734e5115-ad41-4bab-a51e-f6e92e067a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd73d15c20cd45eb92d8849195e8a284'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.219373 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1032/2077] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:47 2022] DELETE /identity/v3/users/cd73d15c20cd45eb92d8849195e8a284 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:48.221692 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10565aa2-d13c-4316-9e0d-d278330acc88 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:48.222185 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10565aa2-d13c-4316-9e0d-d278330acc88 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:48.222684 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10565aa2-d13c-4316-9e0d-d278330acc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:48.245519 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-10565aa2-d13c-4316-9e0d-d278330acc88 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:48.247459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-10565aa2-d13c-4316-9e0d-d278330acc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:48.274545 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dba2d4-b17a-44f3-a4c1-38c3842f3d29 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:48.304458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:48.325812 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:48.356122 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1033/2078] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:48.360386 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8de6de-e69e-486b-a28e-54628c58940b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:48.361053 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8de6de-e69e-486b-a28e-54628c58940b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:48.361583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8de6de-e69e-486b-a28e-54628c58940b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:48.383199 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c191d1-15cd-4954-9631-a0f46f78ac9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:48.384252 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c191d1-15cd-4954-9631-a0f46f78ac9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:48.385327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c191d1-15cd-4954-9631-a0f46f78ac9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:48.386519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c191d1-15cd-4954-9631-a0f46f78ac9b admin admin] PATH_INFO: `/v3/projects/5e8066138de744129e54ff7358fe71b2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:48.388026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c191d1-15cd-4954-9631-a0f46f78ac9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e8066138de744129e54ff7358fe71b2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:48.394151 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-aa8de6de-e69e-486b-a28e-54628c58940b None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:48.395467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-aa8de6de-e69e-486b-a28e-54628c58940b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:48.403910 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c191d1-15cd-4954-9631-a0f46f78ac9b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:48.405891 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1034/2079] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:48.406816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8de6de-e69e-486b-a28e-54628c58940b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:48.422005 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8de6de-e69e-486b-a28e-54628c58940b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:48.429783 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac79258e-40f3-4e40-8026-3d6a03fbbfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:48.430640 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79258e-40f3-4e40-8026-3d6a03fbbfad admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:48.431007 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79258e-40f3-4e40-8026-3d6a03fbbfad admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:48.431359 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac79258e-40f3-4e40-8026-3d6a03fbbfad admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:48.432215 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79258e-40f3-4e40-8026-3d6a03fbbfad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:48.432641 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79258e-40f3-4e40-8026-3d6a03fbbfad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:48.435190 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac79258e-40f3-4e40-8026-3d6a03fbbfad admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:48.449689 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1035/2080] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:48.451158 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d90cda-a3ce-4f32-955e-225bb7113e57 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:48.451549 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d90cda-a3ce-4f32-955e-225bb7113e57 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:48.451909 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d90cda-a3ce-4f32-955e-225bb7113e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:48.472107 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d7d90cda-a3ce-4f32-955e-225bb7113e57 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:48.473439 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d7d90cda-a3ce-4f32-955e-225bb7113e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:48.483054 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-91c191d1-15cd-4954-9631-a0f46f78ac9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e8066138de744129e54ff7358fe71b2', 'request_id': 'req-91c191d1-15cd-4954-9631-a0f46f78ac9b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.491562 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-91c191d1-15cd-4954-9631-a0f46f78ac9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e8066138de744129e54ff7358fe71b2', 'request_id': 'req-91c191d1-15cd-4954-9631-a0f46f78ac9b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.504001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-91c191d1-15cd-4954-9631-a0f46f78ac9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e8066138de744129e54ff7358fe71b2', 'request_id': 'req-91c191d1-15cd-4954-9631-a0f46f78ac9b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.520143 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-91c191d1-15cd-4954-9631-a0f46f78ac9b admin admin] The token cache is being invalidate because project 5e8066138de744129e54ff7358fe71b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:48.520445 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-91c191d1-15cd-4954-9631-a0f46f78ac9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.521127 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-91c191d1-15cd-4954-9631-a0f46f78ac9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:48.523109 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1046/2081] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:48 2022] DELETE /identity/v3/projects/5e8066138de744129e54ff7358fe71b2 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:48.523949 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c191d1-15cd-4954-9631-a0f46f78ac9b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:48.526152 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-91c191d1-15cd-4954-9631-a0f46f78ac9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:48.556261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1036/2082] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:48.556261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853633d3-b4af-49f4-a830-9dd6383433fa None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:48.556261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853633d3-b4af-49f4-a830-9dd6383433fa None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:48.556261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853633d3-b4af-49f4-a830-9dd6383433fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:48.575766 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-853633d3-b4af-49f4-a830-9dd6383433fa None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:48.577125 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-853633d3-b4af-49f4-a830-9dd6383433fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:48.596653 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1037/2083] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:48.597919 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853633d3-b4af-49f4-a830-9dd6383433fa None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:48.610598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853633d3-b4af-49f4-a830-9dd6383433fa None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:48.618335 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb4b18-797e-4f4a-84f5-16ec1e58fa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:48.618887 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb4b18-797e-4f4a-84f5-16ec1e58fa2c admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:48.620395 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb4b18-797e-4f4a-84f5-16ec1e58fa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:48.620684 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb4b18-797e-4f4a-84f5-16ec1e58fa2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:48.621428 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb4b18-797e-4f4a-84f5-16ec1e58fa2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:48.622083 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb4b18-797e-4f4a-84f5-16ec1e58fa2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:48.623494 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb4b18-797e-4f4a-84f5-16ec1e58fa2c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:48.640668 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1038/2084] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:48.640668 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5a964-69f6-46d7-996f-ba3c18f5f332 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:48.640668 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5a964-69f6-46d7-996f-ba3c18f5f332 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:48.640668 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5a964-69f6-46d7-996f-ba3c18f5f332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:48.642249 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c191d1-15cd-4954-9631-a0f46f78ac9b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:48.648670 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102ef2a-1e83-48b5-a56a-925b3c62000f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:48.650974 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102ef2a-1e83-48b5-a56a-925b3c62000f admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:48.652064 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102ef2a-1e83-48b5-a56a-925b3c62000f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:48.652586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102ef2a-1e83-48b5-a56a-925b3c62000f admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:48.654164 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102ef2a-1e83-48b5-a56a-925b3c62000f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:48.657414 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102ef2a-1e83-48b5-a56a-925b3c62000f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:48.663512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-add5a964-69f6-46d7-996f-ba3c18f5f332 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:48.665496 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-add5a964-69f6-46d7-996f-ba3c18f5f332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:48.676881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1039/2085] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:48.677749 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5a964-69f6-46d7-996f-ba3c18f5f332 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:48.689833 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5a964-69f6-46d7-996f-ba3c18f5f332 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:48.695183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1047/2086] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:48 2022] POST /identity/v3/projects => generated 381 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:48.696100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102ef2a-1e83-48b5-a56a-925b3c62000f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:48.699708 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd5c7d-2bdc-4b50-871b-d427b432ecec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:48.701486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd5c7d-2bdc-4b50-871b-d427b432ecec admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:48.702022 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd5c7d-2bdc-4b50-871b-d427b432ecec admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:48.702147 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd5c7d-2bdc-4b50-871b-d427b432ecec admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:48.703010 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd5c7d-2bdc-4b50-871b-d427b432ecec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:48.705350 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd5c7d-2bdc-4b50-871b-d427b432ecec admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:48.744690 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1040/2087] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:48 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:48.744690 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd5c7d-2bdc-4b50-871b-d427b432ecec admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:48.807495 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:48.832824 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102ef2a-1e83-48b5-a56a-925b3c62000f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:48.878564 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd5c7d-2bdc-4b50-871b-d427b432ecec admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:48.885837 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df17e3f-a5f9-4130-8a4c-1155136905b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:48.886695 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df17e3f-a5f9-4130-8a4c-1155136905b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:48.887129 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df17e3f-a5f9-4130-8a4c-1155136905b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:48.889084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df17e3f-a5f9-4130-8a4c-1155136905b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:48.889940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df17e3f-a5f9-4130-8a4c-1155136905b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:48.892967 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df17e3f-a5f9-4130-8a4c-1155136905b9 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:48.936827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1041/2088] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:48 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:48.936827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df17e3f-a5f9-4130-8a4c-1155136905b9 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:48.945386 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:48.953307 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df17e3f-a5f9-4130-8a4c-1155136905b9 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:48.954208 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56f945-d109-4ad2-aebf-1a17c2ce311b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:48.955164 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56f945-d109-4ad2-aebf-1a17c2ce311b admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:48.955684 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56f945-d109-4ad2-aebf-1a17c2ce311b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:48.956596 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56f945-d109-4ad2-aebf-1a17c2ce311b admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:48.957558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56f945-d109-4ad2-aebf-1a17c2ce311b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:48.958038 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56f945-d109-4ad2-aebf-1a17c2ce311b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:48.960339 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56f945-d109-4ad2-aebf-1a17c2ce311b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:48.960799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10391217-34f2-437b-90d6-69c93fd877ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:48.961612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10391217-34f2-437b-90d6-69c93fd877ac admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:48.962004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10391217-34f2-437b-90d6-69c93fd877ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:48.962376 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10391217-34f2-437b-90d6-69c93fd877ac admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:48.963166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10391217-34f2-437b-90d6-69c93fd877ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:48.967971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10391217-34f2-437b-90d6-69c93fd877ac admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:48.986429 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1048/2089] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:48.987892 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56f945-d109-4ad2-aebf-1a17c2ce311b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:48.990414 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8c56f945-d109-4ad2-aebf-1a17c2ce311b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:48.994035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1042/2090] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:48 2022] POST /identity/v3/users => generated 286 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:48.999443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10391217-34f2-437b-90d6-69c93fd877ac admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:49.008019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56f945-d109-4ad2-aebf-1a17c2ce311b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.013787 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10391217-34f2-437b-90d6-69c93fd877ac admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.021504 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfeb1fc-0168-4f92-9bf2-8f344394171e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.022362 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfeb1fc-0168-4f92-9bf2-8f344394171e admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.022769 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfeb1fc-0168-4f92-9bf2-8f344394171e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.023119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfeb1fc-0168-4f92-9bf2-8f344394171e admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.023808 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56be98-351c-4128-8884-82b80b56c882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.024852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfeb1fc-0168-4f92-9bf2-8f344394171e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:49.025447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56be98-351c-4128-8884-82b80b56c882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.025882 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56be98-351c-4128-8884-82b80b56c882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.026326 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56be98-351c-4128-8884-82b80b56c882 admin admin] PATH_INFO: `/v3/projects/621af0635af94ee9a720d0c3b5439bcc` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.026896 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfeb1fc-0168-4f92-9bf2-8f344394171e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:49.027947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56be98-351c-4128-8884-82b80b56c882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=621af0635af94ee9a720d0c3b5439bcc)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:49.031083 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56be98-351c-4128-8884-82b80b56c882 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:49.047770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1043/2091] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:49.047770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfeb1fc-0168-4f92-9bf2-8f344394171e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:49.062888 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfeb1fc-0168-4f92-9bf2-8f344394171e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.068519 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de54022-48f9-45bd-8fbb-0c3a11f7006b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.069400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de54022-48f9-45bd-8fbb-0c3a11f7006b admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.070268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de54022-48f9-45bd-8fbb-0c3a11f7006b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.070516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de54022-48f9-45bd-8fbb-0c3a11f7006b admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.071623 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de54022-48f9-45bd-8fbb-0c3a11f7006b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:49.074252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de54022-48f9-45bd-8fbb-0c3a11f7006b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:49.114574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1044/2092] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:49 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:49.115425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6d56be98-351c-4128-8884-82b80b56c882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '621af0635af94ee9a720d0c3b5439bcc', 'request_id': 'req-6d56be98-351c-4128-8884-82b80b56c882'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:49.115982 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de54022-48f9-45bd-8fbb-0c3a11f7006b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:49.128022 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6d56be98-351c-4128-8884-82b80b56c882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '621af0635af94ee9a720d0c3b5439bcc', 'request_id': 'req-6d56be98-351c-4128-8884-82b80b56c882'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:49.144376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6d56be98-351c-4128-8884-82b80b56c882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '621af0635af94ee9a720d0c3b5439bcc', 'request_id': 'req-6d56be98-351c-4128-8884-82b80b56c882'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:49.167045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6d56be98-351c-4128-8884-82b80b56c882 admin admin] The token cache is being invalidate because project 621af0635af94ee9a720d0c3b5439bcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:49.167337 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6d56be98-351c-4128-8884-82b80b56c882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:49.168020 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6d56be98-351c-4128-8884-82b80b56c882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:49.170785 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1049/2093] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:48 2022] DELETE /identity/v3/projects/621af0635af94ee9a720d0c3b5439bcc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:49.174932 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56be98-351c-4128-8884-82b80b56c882 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:49.176787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6d56be98-351c-4128-8884-82b80b56c882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:49.236354 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de54022-48f9-45bd-8fbb-0c3a11f7006b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.243422 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6537b-0dd7-4949-9f97-9b650a03da28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.244546 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6537b-0dd7-4949-9f97-9b650a03da28 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.244836 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6537b-0dd7-4949-9f97-9b650a03da28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.245266 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6537b-0dd7-4949-9f97-9b650a03da28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.246609 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6537b-0dd7-4949-9f97-9b650a03da28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:49.249122 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6537b-0dd7-4949-9f97-9b650a03da28 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:49.262530 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1045/2094] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:49.264181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6537b-0dd7-4949-9f97-9b650a03da28 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:49.265116 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56be98-351c-4128-8884-82b80b56c882 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.267394 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1be6537b-0dd7-4949-9f97-9b650a03da28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:49.270701 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e267429-2191-4f20-977d-ad86a549ea87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.271382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e267429-2191-4f20-977d-ad86a549ea87 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.271762 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e267429-2191-4f20-977d-ad86a549ea87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.272048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e267429-2191-4f20-977d-ad86a549ea87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.272936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e267429-2191-4f20-977d-ad86a549ea87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:49.274876 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e267429-2191-4f20-977d-ad86a549ea87 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:49.284080 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6537b-0dd7-4949-9f97-9b650a03da28 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.286876 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1050/2095] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:49.289734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021a776-b96d-45dc-8db9-641b05f91fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.290735 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021a776-b96d-45dc-8db9-641b05f91fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.291022 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021a776-b96d-45dc-8db9-641b05f91fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.291283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1f968-2824-4cdc-b8e3-923874792bea None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.291407 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021a776-b96d-45dc-8db9-641b05f91fa5 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.291601 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1f968-2824-4cdc-b8e3-923874792bea None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.291856 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1f968-2824-4cdc-b8e3-923874792bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.291961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021a776-b96d-45dc-8db9-641b05f91fa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:49.294262 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021a776-b96d-45dc-8db9-641b05f91fa5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:49.313972 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b1b1f968-2824-4cdc-b8e3-923874792bea None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:49.315413 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b1b1f968-2824-4cdc-b8e3-923874792bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:49.320992 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1046/2096] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:49 2022] POST /identity/v3/users => generated 287 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:49.321829 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021a776-b96d-45dc-8db9-641b05f91fa5 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:49.329182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c021a776-b96d-45dc-8db9-641b05f91fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:49.333037 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1051/2097] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:49.333962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1f968-2824-4cdc-b8e3-923874792bea None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:49.339447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:49.349711 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1f968-2824-4cdc-b8e3-923874792bea None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.351379 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021a776-b96d-45dc-8db9-641b05f91fa5 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.356255 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229319e-615e-4ea6-a0eb-6495a29f6593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.356907 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c4150-8d0f-4256-a5b0-ad1c18769be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.357035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229319e-615e-4ea6-a0eb-6495a29f6593 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.357221 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229319e-615e-4ea6-a0eb-6495a29f6593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.357507 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229319e-615e-4ea6-a0eb-6495a29f6593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.358144 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c4150-8d0f-4256-a5b0-ad1c18769be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.358269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229319e-615e-4ea6-a0eb-6495a29f6593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:49.359157 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c4150-8d0f-4256-a5b0-ad1c18769be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.359518 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c4150-8d0f-4256-a5b0-ad1c18769be1 admin admin] PATH_INFO: `/v3/projects/76f5beeb0d6a49a8afcfaa6b2cff22c1/users/d73ab87fa5ce4da083f9b7d82d753cd6/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.359873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229319e-615e-4ea6-a0eb-6495a29f6593 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:49.378861 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1047/2098] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:49.383145 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229319e-615e-4ea6-a0eb-6495a29f6593 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:49.383811 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c4150-8d0f-4256-a5b0-ad1c18769be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f5beeb0d6a49a8afcfaa6b2cff22c1, user_id=d73ab87fa5ce4da083f9b7d82d753cd6, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:49.387339 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c4150-8d0f-4256-a5b0-ad1c18769be1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:49.394224 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229319e-615e-4ea6-a0eb-6495a29f6593 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.400636 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc59bf3-b140-473e-83d3-3a43ac2bd69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.401322 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc59bf3-b140-473e-83d3-3a43ac2bd69a admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.401608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc59bf3-b140-473e-83d3-3a43ac2bd69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.401886 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc59bf3-b140-473e-83d3-3a43ac2bd69a admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.402792 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc59bf3-b140-473e-83d3-3a43ac2bd69a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:49.405058 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc59bf3-b140-473e-83d3-3a43ac2bd69a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:49.416965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1052/2099] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:49 2022] PUT /identity/v3/projects/76f5beeb0d6a49a8afcfaa6b2cff22c1/users/d73ab87fa5ce4da083f9b7d82d753cd6/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:49.418317 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ffde7-8ddc-4869-9a87-99b04899caf1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.418862 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ffde7-8ddc-4869-9a87-99b04899caf1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.418942 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ffde7-8ddc-4869-9a87-99b04899caf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.437382 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1048/2100] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:49.439554 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc59bf3-b140-473e-83d3-3a43ac2bd69a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:49.444666 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c21ffde7-8ddc-4869-9a87-99b04899caf1 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:49.446070 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c21ffde7-8ddc-4869-9a87-99b04899caf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:49.466241 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc59bf3-b140-473e-83d3-3a43ac2bd69a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.526726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1053/2101] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:49.531763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525f0a7-dc91-4e86-870f-07d0af3499e9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.532593 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525f0a7-dc91-4e86-870f-07d0af3499e9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.532593 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525f0a7-dc91-4e86-870f-07d0af3499e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.592819 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9525f0a7-dc91-4e86-870f-07d0af3499e9 None None] MFA Rules not processed for user `d73ab87fa5ce4da083f9b7d82d753cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:49.594076 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9525f0a7-dc91-4e86-870f-07d0af3499e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:49.601355 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b9af2-0e36-4bdb-87eb-d85e7559b0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.602466 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b9af2-0e36-4bdb-87eb-d85e7559b0cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.602853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b9af2-0e36-4bdb-87eb-d85e7559b0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.603466 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b9af2-0e36-4bdb-87eb-d85e7559b0cc admin admin] PATH_INFO: `/v3/projects/d4127c32555b42b7ad8da78276638c48/users/5a97146a30df493182867c7609fe633f/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.628443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:49.635182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b9af2-0e36-4bdb-87eb-d85e7559b0cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4127c32555b42b7ad8da78276638c48, user_id=5a97146a30df493182867c7609fe633f, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:49.641984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b9af2-0e36-4bdb-87eb-d85e7559b0cc admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:49.664429 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1049/2102] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:49 2022] PUT /identity/v3/projects/d4127c32555b42b7ad8da78276638c48/users/5a97146a30df493182867c7609fe633f/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:49.665445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b9af2-0e36-4bdb-87eb-d85e7559b0cc admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:49.705243 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1054/2103] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:49.706696 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525f0a7-dc91-4e86-870f-07d0af3499e9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:49.719903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525f0a7-dc91-4e86-870f-07d0af3499e9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.744668 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b9af2-0e36-4bdb-87eb-d85e7559b0cc admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.752805 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d557d2a-30e6-45f7-9967-7147bdff07c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.753733 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d557d2a-30e6-45f7-9967-7147bdff07c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.754088 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d557d2a-30e6-45f7-9967-7147bdff07c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.754507 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d557d2a-30e6-45f7-9967-7147bdff07c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.755435 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d557d2a-30e6-45f7-9967-7147bdff07c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:49.757438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d557d2a-30e6-45f7-9967-7147bdff07c6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:49.774828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1050/2104] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:49.774828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0d9e8-5776-4c49-bf47-160f4726b94a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.774828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0d9e8-5776-4c49-bf47-160f4726b94a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.774828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0d9e8-5776-4c49-bf47-160f4726b94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.793109 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398b4f5-f53b-4ba7-a324-67ebd46e712c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.794708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398b4f5-f53b-4ba7-a324-67ebd46e712c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.795356 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398b4f5-f53b-4ba7-a324-67ebd46e712c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.795959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398b4f5-f53b-4ba7-a324-67ebd46e712c admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.797064 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398b4f5-f53b-4ba7-a324-67ebd46e712c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:49.797568 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398b4f5-f53b-4ba7-a324-67ebd46e712c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:49.799558 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398b4f5-f53b-4ba7-a324-67ebd46e712c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:49.802178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-91f0d9e8-5776-4c49-bf47-160f4726b94a None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:49.804171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-91f0d9e8-5776-4c49-bf47-160f4726b94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:49.816015 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1051/2105] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:49.816940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0d9e8-5776-4c49-bf47-160f4726b94a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:49.817852 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1055/2106] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:49.819609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398b4f5-f53b-4ba7-a324-67ebd46e712c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:49.827377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:49.834530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398b4f5-f53b-4ba7-a324-67ebd46e712c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.841475 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0d9e8-5776-4c49-bf47-160f4726b94a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.844943 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2cd2b-d84c-4f20-90ea-329ff23deced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.845906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2cd2b-d84c-4f20-90ea-329ff23deced admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.846119 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2cd2b-d84c-4f20-90ea-329ff23deced admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.846424 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2cd2b-d84c-4f20-90ea-329ff23deced admin admin] PATH_INFO: `/v3/projects/e544152897eb49eab859363ce2b95f46/users/ceac9c13b72a49f38f153e61382d1f36/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.851642 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9c433-3705-4b47-9fc7-6590275cbd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.852470 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9c433-3705-4b47-9fc7-6590275cbd27 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.852770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9c433-3705-4b47-9fc7-6590275cbd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.853103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9c433-3705-4b47-9fc7-6590275cbd27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:49.854000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9c433-3705-4b47-9fc7-6590275cbd27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:49.856273 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9c433-3705-4b47-9fc7-6590275cbd27 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:49.869142 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2cd2b-d84c-4f20-90ea-329ff23deced admin admin] RBAC: Authorizing `identity:create_grant(project_id=e544152897eb49eab859363ce2b95f46, user_id=ceac9c13b72a49f38f153e61382d1f36, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:49.873324 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2cd2b-d84c-4f20-90ea-329ff23deced admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:49.889781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1052/2107] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:49 2022] POST /identity/v3/projects => generated 379 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:49.896235 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1056/2108] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:49 2022] PUT /identity/v3/projects/e544152897eb49eab859363ce2b95f46/users/ceac9c13b72a49f38f153e61382d1f36/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:49.896235 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2cd2b-d84c-4f20-90ea-329ff23deced admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:49.897555 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9c433-3705-4b47-9fc7-6590275cbd27 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:49.900160 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-19b9c433-3705-4b47-9fc7-6590275cbd27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:49.972748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2cd2b-d84c-4f20-90ea-329ff23deced admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.987067 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9c433-3705-4b47-9fc7-6590275cbd27 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:49.991358 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8425a3-6738-457d-be0b-d153c9c21d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:49.992088 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8425a3-6738-457d-be0b-d153c9c21d79 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:49.992451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8425a3-6738-457d-be0b-d153c9c21d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:49.992795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8425a3-6738-457d-be0b-d153c9c21d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.048626 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753079c-8814-4116-8aa4-257b743b943f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:50.049665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753079c-8814-4116-8aa4-257b743b943f admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:50.050563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753079c-8814-4116-8aa4-257b743b943f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:50.050922 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753079c-8814-4116-8aa4-257b743b943f admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.051697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753079c-8814-4116-8aa4-257b743b943f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:50.055060 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753079c-8814-4116-8aa4-257b743b943f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:50.077693 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8425a3-6738-457d-be0b-d153c9c21d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:50.079800 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8425a3-6738-457d-be0b-d153c9c21d79 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:50.091405 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1057/2109] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:49 2022] POST /identity/v3/projects => generated 367 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:50.092083 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1053/2110] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:50.093036 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753079c-8814-4116-8aa4-257b743b943f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:50.093701 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723206f-3d97-49ce-860f-49333aff14aa None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:50.094073 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723206f-3d97-49ce-860f-49333aff14aa None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:50.094654 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723206f-3d97-49ce-860f-49333aff14aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.114678 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d723206f-3d97-49ce-860f-49333aff14aa None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:50.115932 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d723206f-3d97-49ce-860f-49333aff14aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:50.121031 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:50.261234 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1054/2111] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:50.262118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753079c-8814-4116-8aa4-257b743b943f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:50.262803 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723206f-3d97-49ce-860f-49333aff14aa None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:50.270490 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfce84-3754-4f66-a757-a3954894afef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:50.271610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfce84-3754-4f66-a757-a3954894afef admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:50.271610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfce84-3754-4f66-a757-a3954894afef admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:50.271967 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfce84-3754-4f66-a757-a3954894afef admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.272700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfce84-3754-4f66-a757-a3954894afef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:50.274927 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfce84-3754-4f66-a757-a3954894afef admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:50.289384 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723206f-3d97-49ce-860f-49333aff14aa None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:50.297881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949f5b5-d806-4f2b-9f26-de2d73a9c7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:50.298954 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949f5b5-d806-4f2b-9f26-de2d73a9c7c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:50.299634 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:50.300762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949f5b5-d806-4f2b-9f26-de2d73a9c7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:50.301125 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949f5b5-d806-4f2b-9f26-de2d73a9c7c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.301891 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949f5b5-d806-4f2b-9f26-de2d73a9c7c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:50.304389 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949f5b5-d806-4f2b-9f26-de2d73a9c7c2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:50.319874 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1058/2112] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:50 2022] POST /identity/v3/users => generated 296 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:50.321226 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfce84-3754-4f66-a757-a3954894afef admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:50.334311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1055/2113] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:50 2022] POST /identity/v3/users => generated 284 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:50.335479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949f5b5-d806-4f2b-9f26-de2d73a9c7c2 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:50.352706 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949f5b5-d806-4f2b-9f26-de2d73a9c7c2 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:50.361230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a78226-869b-4c37-961c-61a386711316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:50.362807 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a78226-869b-4c37-961c-61a386711316 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:50.363315 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a78226-869b-4c37-961c-61a386711316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:50.363805 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a78226-869b-4c37-961c-61a386711316 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.365083 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a78226-869b-4c37-961c-61a386711316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:50.381272 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a78226-869b-4c37-961c-61a386711316 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:50.394749 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfce84-3754-4f66-a757-a3954894afef admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:50.399484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c3364-eb3b-4680-9bcf-5534ebc1896d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:50.401112 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c3364-eb3b-4680-9bcf-5534ebc1896d service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:50.401402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c3364-eb3b-4680-9bcf-5534ebc1896d service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:50.402175 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c3364-eb3b-4680-9bcf-5534ebc1896d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.406702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1056/2114] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:50.407580 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a78226-869b-4c37-961c-61a386711316 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:50.419769 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a78226-869b-4c37-961c-61a386711316 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:50.426733 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba45adc-6813-4026-b557-9d786b2983a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:50.427502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba45adc-6813-4026-b557-9d786b2983a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:50.427795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba45adc-6813-4026-b557-9d786b2983a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:50.428129 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba45adc-6813-4026-b557-9d786b2983a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.429442 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba45adc-6813-4026-b557-9d786b2983a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:50.432814 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba45adc-6813-4026-b557-9d786b2983a6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:50.444680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c3364-eb3b-4680-9bcf-5534ebc1896d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:50.447681 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1057/2115] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:50.448033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c3364-eb3b-4680-9bcf-5534ebc1896d service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:50.448574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba45adc-6813-4026-b557-9d786b2983a6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:50.461853 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1059/2116] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:50.465457 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c3364-eb3b-4680-9bcf-5534ebc1896d service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:50.478327 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba45adc-6813-4026-b557-9d786b2983a6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:50.479525 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c3364-eb3b-4680-9bcf-5534ebc1896d service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:50.493375 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ccbec-3792-4f81-8256-3cf463ff8025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:50.494416 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcab9e-3957-486e-8b55-3a475d0ca038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:50.499195 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ccbec-3792-4f81-8256-3cf463ff8025 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:50.499484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ccbec-3792-4f81-8256-3cf463ff8025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:50.499755 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ccbec-3792-4f81-8256-3cf463ff8025 admin admin] PATH_INFO: `/v3/projects/6dc1cffacf7c4e4295562565bfc343f1/users/7f8997bf5f2d495d87e28e0713b161ac/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.500669 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcab9e-3957-486e-8b55-3a475d0ca038 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:50.501204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcab9e-3957-486e-8b55-3a475d0ca038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:50.501483 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dcab9e-3957-486e-8b55-3a475d0ca038 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.502349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dcab9e-3957-486e-8b55-3a475d0ca038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:50.504148 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dcab9e-3957-486e-8b55-3a475d0ca038 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:50.529211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1060/2117] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:50.535173 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcab9e-3957-486e-8b55-3a475d0ca038 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:50.538054 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ccbec-3792-4f81-8256-3cf463ff8025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc1cffacf7c4e4295562565bfc343f1, user_id=7f8997bf5f2d495d87e28e0713b161ac, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:50.542568 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ccbec-3792-4f81-8256-3cf463ff8025 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:50.556781 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dcab9e-3957-486e-8b55-3a475d0ca038 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:50.571130 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1058/2118] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:50 2022] PUT /identity/v3/projects/6dc1cffacf7c4e4295562565bfc343f1/users/7f8997bf5f2d495d87e28e0713b161ac/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:50.575086 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ccbec-3792-4f81-8256-3cf463ff8025 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:50.712966 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ccbec-3792-4f81-8256-3cf463ff8025 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:50.719029 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e0d9d-0f9c-439a-bf97-e2f6130e0ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:50.720124 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e0d9d-0f9c-439a-bf97-e2f6130e0ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:50.720452 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e0d9d-0f9c-439a-bf97-e2f6130e0ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:50.720732 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e0d9d-0f9c-439a-bf97-e2f6130e0ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.721850 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e0d9d-0f9c-439a-bf97-e2f6130e0ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:50.724304 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e0d9d-0f9c-439a-bf97-e2f6130e0ba6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:50.726707 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bfbfe-bdc0-4bba-a2f4-39c9122856c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:50.727952 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bfbfe-bdc0-4bba-a2f4-39c9122856c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:50.728446 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bfbfe-bdc0-4bba-a2f4-39c9122856c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:50.729665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bfbfe-bdc0-4bba-a2f4-39c9122856c4 admin admin] PATH_INFO: `/v3/projects/f864c23b7623460cb5ad7625c8c59c06/users/143b70081fff4b6ca44ebda299174117/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.741852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1059/2119] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:50.742995 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e0d9d-0f9c-439a-bf97-e2f6130e0ba6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:50.755263 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e0d9d-0f9c-439a-bf97-e2f6130e0ba6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:50.761676 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed070c-6393-4dba-959b-20a5deb50ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:50.764574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed070c-6393-4dba-959b-20a5deb50ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:50.765054 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed070c-6393-4dba-959b-20a5deb50ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:50.765499 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed070c-6393-4dba-959b-20a5deb50ea8 admin admin] PATH_INFO: `/v3/projects/6dc1cffacf7c4e4295562565bfc343f1/users/7f8997bf5f2d495d87e28e0713b161ac/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.767527 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bfbfe-bdc0-4bba-a2f4-39c9122856c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f864c23b7623460cb5ad7625c8c59c06, user_id=143b70081fff4b6ca44ebda299174117, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:50.768652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed070c-6393-4dba-959b-20a5deb50ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc1cffacf7c4e4295562565bfc343f1, user_id=7f8997bf5f2d495d87e28e0713b161ac, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:50.771388 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bfbfe-bdc0-4bba-a2f4-39c9122856c4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:50.771613 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed070c-6393-4dba-959b-20a5deb50ea8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:50.794678 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1060/2120] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:50 2022] PUT /identity/v3/projects/6dc1cffacf7c4e4295562565bfc343f1/users/7f8997bf5f2d495d87e28e0713b161ac/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:50.800078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b696281-3e9d-4116-8d87-547de3c5b5c7 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:50.800755 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b696281-3e9d-4116-8d87-547de3c5b5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:50.801692 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b696281-3e9d-4116-8d87-547de3c5b5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.824490 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1061/2121] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:50 2022] PUT /identity/v3/projects/f864c23b7623460cb5ad7625c8c59c06/users/143b70081fff4b6ca44ebda299174117/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:50.835585 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a23a2-dddb-4e0d-89c7-b22af6cd00ec None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:50.835960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a23a2-dddb-4e0d-89c7-b22af6cd00ec None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:50.836159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a23a2-dddb-4e0d-89c7-b22af6cd00ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:50.869907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2b696281-3e9d-4116-8d87-547de3c5b5c7 None None] MFA Rules not processed for user `7f8997bf5f2d495d87e28e0713b161ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:50.871626 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2b696281-3e9d-4116-8d87-547de3c5b5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:50.876442 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f73a23a2-dddb-4e0d-89c7-b22af6cd00ec None None] MFA Rules not processed for user `143b70081fff4b6ca44ebda299174117`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:50.877704 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f73a23a2-dddb-4e0d-89c7-b22af6cd00ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:50.902114 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:51.038487 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1061/2122] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:51.039552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b696281-3e9d-4116-8d87-547de3c5b5c7 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:51.046533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2b696281-3e9d-4116-8d87-547de3c5b5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:51.048530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1062/2123] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:51.056723 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a23a2-dddb-4e0d-89c7-b22af6cd00ec None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:51.059090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f73a23a2-dddb-4e0d-89c7-b22af6cd00ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:51.070806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:51.142098 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b696281-3e9d-4116-8d87-547de3c5b5c7 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:51.145561 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4f6eb-f9e5-4d12-af67-e8f268b56730 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:51.146283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4f6eb-f9e5-4d12-af67-e8f268b56730 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:51.146642 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4f6eb-f9e5-4d12-af67-e8f268b56730 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:51.147092 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a4f6eb-f9e5-4d12-af67-e8f268b56730 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:51.160863 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4f6eb-f9e5-4d12-af67-e8f268b56730 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:51.161853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a4f6eb-f9e5-4d12-af67-e8f268b56730 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:51.179857 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1062/2124] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:51.259064 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a23a2-dddb-4e0d-89c7-b22af6cd00ec None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:51.271100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1c599-025d-4873-9593-547ef452a1f2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f646c526a044e8b5b6e74aa64cf6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:51.271843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1c599-025d-4873-9593-547ef452a1f2 service glance] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:51.272128 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1c599-025d-4873-9593-547ef452a1f2 service glance] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:51.272405 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1c599-025d-4873-9593-547ef452a1f2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:51.293571 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1c599-025d-4873-9593-547ef452a1f2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:51.297573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1c599-025d-4873-9593-547ef452a1f2 service glance] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:51.324475 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1063/2125] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:51 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:25:52.496047 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4f6eb-f9e5-4d12-af67-e8f268b56730 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:52.705524 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a4f6eb-f9e5-4d12-af67-e8f268b56730 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:52.720007 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095be56a-6a2d-4622-aee4-8141bd8968e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:52.721215 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095be56a-6a2d-4622-aee4-8141bd8968e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:52.721886 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095be56a-6a2d-4622-aee4-8141bd8968e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:52.722334 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095be56a-6a2d-4622-aee4-8141bd8968e1 admin admin] PATH_INFO: `/v3/users/d73ab87fa5ce4da083f9b7d82d753cd6` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:52.725205 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095be56a-6a2d-4622-aee4-8141bd8968e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d73ab87fa5ce4da083f9b7d82d753cd6)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:52.727766 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095be56a-6a2d-4622-aee4-8141bd8968e1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:52.829173 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-095be56a-6a2d-4622-aee4-8141bd8968e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd73ab87fa5ce4da083f9b7d82d753cd6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:52.843136 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-095be56a-6a2d-4622-aee4-8141bd8968e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd73ab87fa5ce4da083f9b7d82d753cd6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:52.847265 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:52.857184 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-095be56a-6a2d-4622-aee4-8141bd8968e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd73ab87fa5ce4da083f9b7d82d753cd6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:52.858707 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-095be56a-6a2d-4622-aee4-8141bd8968e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd73ab87fa5ce4da083f9b7d82d753cd6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:52.860017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-095be56a-6a2d-4622-aee4-8141bd8968e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd73ab87fa5ce4da083f9b7d82d753cd6'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:52.901072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1063/2126] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:52 2022] DELETE /identity/v3/users/d73ab87fa5ce4da083f9b7d82d753cd6 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:52.902732 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb7d7d-1157-484c-bf00-3f126593ccb8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:52.903240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb7d7d-1157-484c-bf00-3f126593ccb8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:52.903324 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb7d7d-1157-484c-bf00-3f126593ccb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:52.935260 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12249898-6d01-4e4d-971c-e279a114b29c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:52.935498 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12249898-6d01-4e4d-971c-e279a114b29c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:52.936134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12249898-6d01-4e4d-971c-e279a114b29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:52.942259 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3ecb7d7d-1157-484c-bf00-3f126593ccb8 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:52.945267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3ecb7d7d-1157-484c-bf00-3f126593ccb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:52.988486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-12249898-6d01-4e4d-971c-e279a114b29c None None] MFA Rules not processed for user `ceac9c13b72a49f38f153e61382d1f36`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:52.992866 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-12249898-6d01-4e4d-971c-e279a114b29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:53.072333 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1064/2127] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:53.073689 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e64663-cc41-4de2-84d5-adfcec5394e6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.073986 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e64663-cc41-4de2-84d5-adfcec5394e6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.074512 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e64663-cc41-4de2-84d5-adfcec5394e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.112196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-37e64663-cc41-4de2-84d5-adfcec5394e6 None None] MFA Rules not processed for user `5a97146a30df493182867c7609fe633f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:53.113564 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-37e64663-cc41-4de2-84d5-adfcec5394e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:53.124780 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1064/2128] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:53.125709 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12249898-6d01-4e4d-971c-e279a114b29c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:53.127334 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-12249898-6d01-4e4d-971c-e279a114b29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:53.195282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1065/2129] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:53.196426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e64663-cc41-4de2-84d5-adfcec5394e6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:53.198288 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-37e64663-cc41-4de2-84d5-adfcec5394e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:53.204575 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12249898-6d01-4e4d-971c-e279a114b29c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:53.209040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dd2ca-aa7e-489a-b0fe-6305cd34929e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:53.209862 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dd2ca-aa7e-489a-b0fe-6305cd34929e service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.210060 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dd2ca-aa7e-489a-b0fe-6305cd34929e service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.210399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dd2ca-aa7e-489a-b0fe-6305cd34929e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.215944 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e64663-cc41-4de2-84d5-adfcec5394e6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:53.220619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dd2ca-aa7e-489a-b0fe-6305cd34929e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:53.221362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261c3bf-8cfb-4ed3-8c60-4be99c1dbed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:53.222090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dd2ca-aa7e-489a-b0fe-6305cd34929e service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:53.222271 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261c3bf-8cfb-4ed3-8c60-4be99c1dbed0 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.222673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261c3bf-8cfb-4ed3-8c60-4be99c1dbed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.223135 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261c3bf-8cfb-4ed3-8c60-4be99c1dbed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.223958 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261c3bf-8cfb-4ed3-8c60-4be99c1dbed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:53.225961 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261c3bf-8cfb-4ed3-8c60-4be99c1dbed0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:53.232306 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1065/2130] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:53.232968 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dd2ca-aa7e-489a-b0fe-6305cd34929e service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:53.234414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-fc6dd2ca-aa7e-489a-b0fe-6305cd34929e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:53.257771 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1066/2131] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:53 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:53.261600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261c3bf-8cfb-4ed3-8c60-4be99c1dbed0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:53.285302 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:53.316857 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dd2ca-aa7e-489a-b0fe-6305cd34929e service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:53.353883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:53.358590 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261c3bf-8cfb-4ed3-8c60-4be99c1dbed0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:53.363937 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44921a23-ba01-4ae7-96ff-7b7d4fd2af56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:53.365502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44921a23-ba01-4ae7-96ff-7b7d4fd2af56 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.365942 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44921a23-ba01-4ae7-96ff-7b7d4fd2af56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.366225 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44921a23-ba01-4ae7-96ff-7b7d4fd2af56 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.368289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44921a23-ba01-4ae7-96ff-7b7d4fd2af56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:53.370840 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44921a23-ba01-4ae7-96ff-7b7d4fd2af56 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:53.403122 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32d319-ef57-499b-b47d-f07515f924f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:53.404561 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32d319-ef57-499b-b47d-f07515f924f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.405117 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32d319-ef57-499b-b47d-f07515f924f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.405634 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32d319-ef57-499b-b47d-f07515f924f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.412383 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1067/2132] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:53 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:25:53.415935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44921a23-ba01-4ae7-96ff-7b7d4fd2af56 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:53.441387 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44921a23-ba01-4ae7-96ff-7b7d4fd2af56 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:53.462175 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22526fd-9acd-48a4-a10a-d0a6740ee71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:53.462957 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22526fd-9acd-48a4-a10a-d0a6740ee71d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.463236 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22526fd-9acd-48a4-a10a-d0a6740ee71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.463523 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22526fd-9acd-48a4-a10a-d0a6740ee71d admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.464663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22526fd-9acd-48a4-a10a-d0a6740ee71d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:53.466634 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22526fd-9acd-48a4-a10a-d0a6740ee71d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:53.484372 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1068/2133] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:53.485634 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22526fd-9acd-48a4-a10a-d0a6740ee71d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:53.496051 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22526fd-9acd-48a4-a10a-d0a6740ee71d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:53.501577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69219001-65e6-418f-bf26-d44e51c1c14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:53.502592 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69219001-65e6-418f-bf26-d44e51c1c14f admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.502890 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69219001-65e6-418f-bf26-d44e51c1c14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.503166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69219001-65e6-418f-bf26-d44e51c1c14f admin admin] PATH_INFO: `/v3/projects/9db577256c1a4e64872594b130900956/users/2b8627b1754a43899588edff5d6b6c52/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.518467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32d319-ef57-499b-b47d-f07515f924f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:53.522407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69219001-65e6-418f-bf26-d44e51c1c14f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9db577256c1a4e64872594b130900956, user_id=2b8627b1754a43899588edff5d6b6c52, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:53.522565 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32d319-ef57-499b-b47d-f07515f924f2 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:53.523292 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69219001-65e6-418f-bf26-d44e51c1c14f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:53.534091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1066/2134] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:53.538939 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1069/2135] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:53 2022] PUT /identity/v3/projects/9db577256c1a4e64872594b130900956/users/2b8627b1754a43899588edff5d6b6c52/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:53.547325 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32d319-ef57-499b-b47d-f07515f924f2 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:53.558555 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32d319-ef57-499b-b47d-f07515f924f2 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:53.605846 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69219001-65e6-418f-bf26-d44e51c1c14f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:53.609474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-69219001-65e6-418f-bf26-d44e51c1c14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:53.656971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5f9dd-1785-45c1-bb16-cea604ea4948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:53.658917 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5f9dd-1785-45c1-bb16-cea604ea4948 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.659356 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5f9dd-1785-45c1-bb16-cea604ea4948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.659790 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5f9dd-1785-45c1-bb16-cea604ea4948 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.661804 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5f9dd-1785-45c1-bb16-cea604ea4948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:53.664407 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5f9dd-1785-45c1-bb16-cea604ea4948 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:53.683646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1067/2136] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:53.688985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5f9dd-1785-45c1-bb16-cea604ea4948 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:53.696611 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69219001-65e6-418f-bf26-d44e51c1c14f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:53.699531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5f9dd-1785-45c1-bb16-cea604ea4948 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:53.702575 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6386e-72d9-417e-95a4-735e621d16ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:53.703902 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6386e-72d9-417e-95a4-735e621d16ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.704024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6386e-72d9-417e-95a4-735e621d16ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.704246 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6386e-72d9-417e-95a4-735e621d16ca admin admin] PATH_INFO: `/v3/projects/76f5beeb0d6a49a8afcfaa6b2cff22c1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.705879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6386e-72d9-417e-95a4-735e621d16ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=76f5beeb0d6a49a8afcfaa6b2cff22c1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:53.707155 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47351788-d4b2-4071-9743-921b959f99c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:53.708326 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6386e-72d9-417e-95a4-735e621d16ca admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:53.708642 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47351788-d4b2-4071-9743-921b959f99c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.708931 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47351788-d4b2-4071-9743-921b959f99c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.709212 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47351788-d4b2-4071-9743-921b959f99c8 admin admin] PATH_INFO: `/v3/projects/9db577256c1a4e64872594b130900956/users/2b8627b1754a43899588edff5d6b6c52/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.712843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47351788-d4b2-4071-9743-921b959f99c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9db577256c1a4e64872594b130900956, user_id=2b8627b1754a43899588edff5d6b6c52, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:53.717381 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47351788-d4b2-4071-9743-921b959f99c8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:53.733235 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1068/2137] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:53 2022] PUT /identity/v3/projects/9db577256c1a4e64872594b130900956/users/2b8627b1754a43899588edff5d6b6c52/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:53.768744 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0cc6386e-72d9-417e-95a4-735e621d16ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76f5beeb0d6a49a8afcfaa6b2cff22c1', 'request_id': 'req-0cc6386e-72d9-417e-95a4-735e621d16ca'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:53.775776 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0cc6386e-72d9-417e-95a4-735e621d16ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76f5beeb0d6a49a8afcfaa6b2cff22c1', 'request_id': 'req-0cc6386e-72d9-417e-95a4-735e621d16ca'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:53.786442 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0cc6386e-72d9-417e-95a4-735e621d16ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76f5beeb0d6a49a8afcfaa6b2cff22c1', 'request_id': 'req-0cc6386e-72d9-417e-95a4-735e621d16ca'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:53.800210 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:53.805761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0cc6386e-72d9-417e-95a4-735e621d16ca admin admin] The token cache is being invalidate because project 76f5beeb0d6a49a8afcfaa6b2cff22c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:53.806687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0cc6386e-72d9-417e-95a4-735e621d16ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:53.808674 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0cc6386e-72d9-417e-95a4-735e621d16ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:53.812118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1070/2138] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:53 2022] DELETE /identity/v3/projects/76f5beeb0d6a49a8afcfaa6b2cff22c1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:53.816972 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47351788-d4b2-4071-9743-921b959f99c8 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:53.818901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-47351788-d4b2-4071-9743-921b959f99c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:53.893774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47351788-d4b2-4071-9743-921b959f99c8 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:53.903845 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:53.994998 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c7cc1-afba-4194-9fcf-8afc7a4ed7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:53.997473 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c7cc1-afba-4194-9fcf-8afc7a4ed7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:53.997782 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c7cc1-afba-4194-9fcf-8afc7a4ed7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:53.998070 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c7cc1-afba-4194-9fcf-8afc7a4ed7d9 admin admin] PATH_INFO: `/v3/users/7f8997bf5f2d495d87e28e0713b161ac` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:53.999858 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c7cc1-afba-4194-9fcf-8afc7a4ed7d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f8997bf5f2d495d87e28e0713b161ac)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:54.003733 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c7cc1-afba-4194-9fcf-8afc7a4ed7d9 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:54.081245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-289c7cc1-afba-4194-9fcf-8afc7a4ed7d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f8997bf5f2d495d87e28e0713b161ac'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:54.089906 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-289c7cc1-afba-4194-9fcf-8afc7a4ed7d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f8997bf5f2d495d87e28e0713b161ac'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:54.100872 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-289c7cc1-afba-4194-9fcf-8afc7a4ed7d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f8997bf5f2d495d87e28e0713b161ac'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:54.101535 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-289c7cc1-afba-4194-9fcf-8afc7a4ed7d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f8997bf5f2d495d87e28e0713b161ac'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:54.102328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-289c7cc1-afba-4194-9fcf-8afc7a4ed7d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f8997bf5f2d495d87e28e0713b161ac'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:54.123530 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1069/2139] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:25:53 2022] DELETE /identity/v3/users/7f8997bf5f2d495d87e28e0713b161ac => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:54.675247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6386e-72d9-417e-95a4-735e621d16ca admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:54.689951 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6386e-72d9-417e-95a4-735e621d16ca admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:54.767830 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23cbc0-618c-4d3a-9e0e-11428eefe3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:54.768712 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23cbc0-618c-4d3a-9e0e-11428eefe3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:54.768994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23cbc0-618c-4d3a-9e0e-11428eefe3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:54.769409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23cbc0-618c-4d3a-9e0e-11428eefe3ee admin admin] PATH_INFO: `/v3/projects/6dc1cffacf7c4e4295562565bfc343f1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:54.770885 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23cbc0-618c-4d3a-9e0e-11428eefe3ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc1cffacf7c4e4295562565bfc343f1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:54.772990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23cbc0-618c-4d3a-9e0e-11428eefe3ee admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:54.848327 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62665d0-89d1-4e45-9977-6a3e23d267c9 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:54.848901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62665d0-89d1-4e45-9977-6a3e23d267c9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:54.848901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62665d0-89d1-4e45-9977-6a3e23d267c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:54.863256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4a23cbc0-618c-4d3a-9e0e-11428eefe3ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc1cffacf7c4e4295562565bfc343f1', 'request_id': 'req-4a23cbc0-618c-4d3a-9e0e-11428eefe3ee'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:54.869861 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4a23cbc0-618c-4d3a-9e0e-11428eefe3ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc1cffacf7c4e4295562565bfc343f1', 'request_id': 'req-4a23cbc0-618c-4d3a-9e0e-11428eefe3ee'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:54.880129 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4a23cbc0-618c-4d3a-9e0e-11428eefe3ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc1cffacf7c4e4295562565bfc343f1', 'request_id': 'req-4a23cbc0-618c-4d3a-9e0e-11428eefe3ee'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:54.891351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f62665d0-89d1-4e45-9977-6a3e23d267c9 None None] MFA Rules not processed for user `2b8627b1754a43899588edff5d6b6c52`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:54.892568 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f62665d0-89d1-4e45-9977-6a3e23d267c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:54.894240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4a23cbc0-618c-4d3a-9e0e-11428eefe3ee admin admin] The token cache is being invalidate because project 6dc1cffacf7c4e4295562565bfc343f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:25:54.894715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4a23cbc0-618c-4d3a-9e0e-11428eefe3ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:54.895425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4a23cbc0-618c-4d3a-9e0e-11428eefe3ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:25:54.897309 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1071/2140] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:25:54 2022] DELETE /identity/v3/projects/6dc1cffacf7c4e4295562565bfc343f1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:25:54.902000 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4632e-364f-4647-902b-a22c3a624a8d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:54.902672 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4632e-364f-4647-902b-a22c3a624a8d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:54.902953 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4632e-364f-4647-902b-a22c3a624a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:54.923187 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fea4632e-364f-4647-902b-a22c3a624a8d None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:54.924510 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fea4632e-364f-4647-902b-a22c3a624a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:54.979615 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1070/2141] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:54.990567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6c986-7b62-42b2-a122-94e9fe5c5221 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:54.991535 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6c986-7b62-42b2-a122-94e9fe5c5221 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:54.991850 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6c986-7b62-42b2-a122-94e9fe5c5221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:54.998917 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1072/2142] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:25:55.011344 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b5413-1848-45ba-b365-a86e5e8b0f23 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.011533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b5413-1848-45ba-b365-a86e5e8b0f23 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.011964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b5413-1848-45ba-b365-a86e5e8b0f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.018230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2ad6c986-7b62-42b2-a122-94e9fe5c5221 None None] MFA Rules not processed for user `ceac9c13b72a49f38f153e61382d1f36`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:55.019767 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2ad6c986-7b62-42b2-a122-94e9fe5c5221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:55.033265 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b36b5413-1848-45ba-b365-a86e5e8b0f23 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:55.034562 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b36b5413-1848-45ba-b365-a86e5e8b0f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:55.044518 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1073/2143] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:55.045502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1755b5e-5859-43ec-82d0-3af0425dd476 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.046149 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1755b5e-5859-43ec-82d0-3af0425dd476 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.046149 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1755b5e-5859-43ec-82d0-3af0425dd476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.049967 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:55.069407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e1755b5e-5859-43ec-82d0-3af0425dd476 None None] MFA Rules not processed for user `5a97146a30df493182867c7609fe633f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:55.070782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e1755b5e-5859-43ec-82d0-3af0425dd476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:55.094669 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:55.108464 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1071/2144] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:55.109425 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6c986-7b62-42b2-a122-94e9fe5c5221 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:55.123551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6c986-7b62-42b2-a122-94e9fe5c5221 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:55.128323 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312a9db-80c6-4b90-83d4-e87f882909ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:55.128977 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312a9db-80c6-4b90-83d4-e87f882909ad admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.129271 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312a9db-80c6-4b90-83d4-e87f882909ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.129533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312a9db-80c6-4b90-83d4-e87f882909ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.130261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312a9db-80c6-4b90-83d4-e87f882909ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:25:55.130601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312a9db-80c6-4b90-83d4-e87f882909ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:55.132207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312a9db-80c6-4b90-83d4-e87f882909ad admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:55.133817 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1074/2145] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:55.134685 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1755b5e-5859-43ec-82d0-3af0425dd476 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:55.135941 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e1755b5e-5859-43ec-82d0-3af0425dd476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:55.148797 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1072/2146] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:25:55.160326 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312a9db-80c6-4b90-83d4-e87f882909ad admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:55.173986 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312a9db-80c6-4b90-83d4-e87f882909ad admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:55.180077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93e516-0c76-4921-b000-e8e10e9979d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:55.180887 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93e516-0c76-4921-b000-e8e10e9979d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.181241 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93e516-0c76-4921-b000-e8e10e9979d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.181701 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93e516-0c76-4921-b000-e8e10e9979d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.182555 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93e516-0c76-4921-b000-e8e10e9979d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:55.185207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93e516-0c76-4921-b000-e8e10e9979d3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:55.230873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1073/2147] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:25:55 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:55.236186 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93e516-0c76-4921-b000-e8e10e9979d3 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:55.272051 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1755b5e-5859-43ec-82d0-3af0425dd476 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:55.319472 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93e516-0c76-4921-b000-e8e10e9979d3 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:55.325388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d962b1-d7ab-4954-af52-11940a25cb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:55.326553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d962b1-d7ab-4954-af52-11940a25cb87 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.327117 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d962b1-d7ab-4954-af52-11940a25cb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.327631 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d962b1-d7ab-4954-af52-11940a25cb87 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.328662 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d962b1-d7ab-4954-af52-11940a25cb87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:55.330896 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d962b1-d7ab-4954-af52-11940a25cb87 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:55.359764 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1074/2148] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:25:55 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:25:55.365101 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a71972-e25f-427f-9a8d-0d6889197313 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:55.365847 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d962b1-d7ab-4954-af52-11940a25cb87 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:55.366163 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a71972-e25f-427f-9a8d-0d6889197313 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.366752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a71972-e25f-427f-9a8d-0d6889197313 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.367083 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a71972-e25f-427f-9a8d-0d6889197313 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.369146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d3a71972-e25f-427f-9a8d-0d6889197313 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:55.379570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d962b1-d7ab-4954-af52-11940a25cb87 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:55.385369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2ed3d-b359-41d1-9bfc-dce86d618b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:55.386761 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2ed3d-b359-41d1-9bfc-dce86d618b8b admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.387271 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2ed3d-b359-41d1-9bfc-dce86d618b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.387747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2ed3d-b359-41d1-9bfc-dce86d618b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.388647 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2ed3d-b359-41d1-9bfc-dce86d618b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:55.390920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2ed3d-b359-41d1-9bfc-dce86d618b8b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:55.405358 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1075/2149] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:55.415480 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2ed3d-b359-41d1-9bfc-dce86d618b8b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:55.429037 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2ed3d-b359-41d1-9bfc-dce86d618b8b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:55.436365 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a2798-e4d2-4501-a6a2-01af10ebf5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:55.437320 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a2798-e4d2-4501-a6a2-01af10ebf5ee admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.437790 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a2798-e4d2-4501-a6a2-01af10ebf5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.438223 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a2798-e4d2-4501-a6a2-01af10ebf5ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.439124 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a2798-e4d2-4501-a6a2-01af10ebf5ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:55.440915 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a2798-e4d2-4501-a6a2-01af10ebf5ee admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:55.456326 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1076/2150] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:25:55.460091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a2798-e4d2-4501-a6a2-01af10ebf5ee admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:55.460232 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a71972-e25f-427f-9a8d-0d6889197313 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:55.461777 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a71972-e25f-427f-9a8d-0d6889197313 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:55.474358 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1075/2151] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:25:55.478567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a2798-e4d2-4501-a6a2-01af10ebf5ee admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:55.484348 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf729c71-714e-41b1-b684-0432505b9761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:55.485182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf729c71-714e-41b1-b684-0432505b9761 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.485472 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf729c71-714e-41b1-b684-0432505b9761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.485754 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf729c71-714e-41b1-b684-0432505b9761 admin admin] PATH_INFO: `/v3/projects/985eeeb9506d4990a62a26a3aa5adf6c/users/0d4acbe504b34faa8c6b192d9258331d/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.502533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf729c71-714e-41b1-b684-0432505b9761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=985eeeb9506d4990a62a26a3aa5adf6c, user_id=0d4acbe504b34faa8c6b192d9258331d, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:55.505485 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf729c71-714e-41b1-b684-0432505b9761 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:55.530394 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1077/2152] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:25:55 2022] PUT /identity/v3/projects/985eeeb9506d4990a62a26a3aa5adf6c/users/0d4acbe504b34faa8c6b192d9258331d/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:25:55.538203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67576b-5777-4bb0-ad6a-311735ebcb12 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.538603 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67576b-5777-4bb0-ad6a-311735ebcb12 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.538781 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67576b-5777-4bb0-ad6a-311735ebcb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.552859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:55.597389 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-dc67576b-5777-4bb0-ad6a-311735ebcb12 None None] MFA Rules not processed for user `0d4acbe504b34faa8c6b192d9258331d`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:25:55.598649 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dc67576b-5777-4bb0-ad6a-311735ebcb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:55.675488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1076/2153] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:25:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:25:55.688647 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf729c71-714e-41b1-b684-0432505b9761 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:25:55.690430 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cf729c71-714e-41b1-b684-0432505b9761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:25:55.734859 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:25:55.774961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf729c71-714e-41b1-b684-0432505b9761 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:25:55.779945 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6b068-5473-4a2c-8db0-50dae37be7cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:25:55.780601 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6b068-5473-4a2c-8db0-50dae37be7cd service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:25:55.780882 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6b068-5473-4a2c-8db0-50dae37be7cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:25:55.781176 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6b068-5473-4a2c-8db0-50dae37be7cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:25:55.790847 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6b068-5473-4a2c-8db0-50dae37be7cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:25:55.792353 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c6b068-5473-4a2c-8db0-50dae37be7cd service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:25:55.802641 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1078/2154] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:25:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:03.917772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67576b-5777-4bb0-ad6a-311735ebcb12 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:03.919297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dc67576b-5777-4bb0-ad6a-311735ebcb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:03.988031 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67576b-5777-4bb0-ad6a-311735ebcb12 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:03.992442 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20267ee2-0379-4c82-8f68-1b5550e62516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:03.993317 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20267ee2-0379-4c82-8f68-1b5550e62516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:03.993606 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20267ee2-0379-4c82-8f68-1b5550e62516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:03.993884 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20267ee2-0379-4c82-8f68-1b5550e62516 admin admin] PATH_INFO: `/v3/users/cfe9fd0569ee499e89184127f4399aba` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:03.995301 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20267ee2-0379-4c82-8f68-1b5550e62516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe9fd0569ee499e89184127f4399aba)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:03.997911 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20267ee2-0379-4c82-8f68-1b5550e62516 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:04.048873 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-20267ee2-0379-4c82-8f68-1b5550e62516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe9fd0569ee499e89184127f4399aba'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:04.055723 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-20267ee2-0379-4c82-8f68-1b5550e62516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe9fd0569ee499e89184127f4399aba'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:04.073809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-20267ee2-0379-4c82-8f68-1b5550e62516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe9fd0569ee499e89184127f4399aba'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:04.083023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-20267ee2-0379-4c82-8f68-1b5550e62516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe9fd0569ee499e89184127f4399aba'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:04.083984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-20267ee2-0379-4c82-8f68-1b5550e62516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe9fd0569ee499e89184127f4399aba'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:04.096164 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1077/2155] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:26:03 2022] DELETE /identity/v3/users/cfe9fd0569ee499e89184127f4399aba => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:04.312514 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6b068-5473-4a2c-8db0-50dae37be7cd service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:04.326496 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6b068-5473-4a2c-8db0-50dae37be7cd service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:04.414018 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51005ae5-c4f6-42b3-a32d-1b6a19ef69cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:04.414922 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51005ae5-c4f6-42b3-a32d-1b6a19ef69cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:04.415217 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51005ae5-c4f6-42b3-a32d-1b6a19ef69cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:04.415499 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51005ae5-c4f6-42b3-a32d-1b6a19ef69cc admin admin] PATH_INFO: `/v3/projects/f73f103a43004caa8c4cddfa2cd8d51b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:04.416690 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51005ae5-c4f6-42b3-a32d-1b6a19ef69cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f73f103a43004caa8c4cddfa2cd8d51b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:04.419342 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51005ae5-c4f6-42b3-a32d-1b6a19ef69cc admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:04.468464 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-51005ae5-c4f6-42b3-a32d-1b6a19ef69cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f73f103a43004caa8c4cddfa2cd8d51b', 'request_id': 'req-51005ae5-c4f6-42b3-a32d-1b6a19ef69cc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:04.474639 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-51005ae5-c4f6-42b3-a32d-1b6a19ef69cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f73f103a43004caa8c4cddfa2cd8d51b', 'request_id': 'req-51005ae5-c4f6-42b3-a32d-1b6a19ef69cc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:04.480624 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-51005ae5-c4f6-42b3-a32d-1b6a19ef69cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f73f103a43004caa8c4cddfa2cd8d51b', 'request_id': 'req-51005ae5-c4f6-42b3-a32d-1b6a19ef69cc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:04.493395 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-51005ae5-c4f6-42b3-a32d-1b6a19ef69cc admin admin] The token cache is being invalidate because project f73f103a43004caa8c4cddfa2cd8d51b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:04.493684 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-51005ae5-c4f6-42b3-a32d-1b6a19ef69cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:04.494323 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-51005ae5-c4f6-42b3-a32d-1b6a19ef69cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:04.495860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1079/2156] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:04 2022] DELETE /identity/v3/projects/f73f103a43004caa8c4cddfa2cd8d51b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:04.500847 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6494b-3c12-451a-820d-14fc03a0d20a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:04.501139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6494b-3c12-451a-820d-14fc03a0d20a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:04.501419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6494b-3c12-451a-820d-14fc03a0d20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:04.519862 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-07b6494b-3c12-451a-820d-14fc03a0d20a None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:04.521085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-07b6494b-3c12-451a-820d-14fc03a0d20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:04.529951 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:04.587518 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1078/2157] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:04.597810 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94d05e-f3bf-4640-9179-5d601e06c415 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:04.598507 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94d05e-f3bf-4640-9179-5d601e06c415 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:04.598960 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94d05e-f3bf-4640-9179-5d601e06c415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:04.623344 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0a94d05e-f3bf-4640-9179-5d601e06c415 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:04.624588 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0a94d05e-f3bf-4640-9179-5d601e06c415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:04.632994 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1080/2158] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:04.637254 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6494b-3c12-451a-820d-14fc03a0d20a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:04.647470 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6494b-3c12-451a-820d-14fc03a0d20a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:04.652158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a006e69-b01d-4110-bb9a-ed8e0c2ebe13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:04.653279 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a006e69-b01d-4110-bb9a-ed8e0c2ebe13 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:04.653559 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a006e69-b01d-4110-bb9a-ed8e0c2ebe13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:04.653906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a006e69-b01d-4110-bb9a-ed8e0c2ebe13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:04.654748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a006e69-b01d-4110-bb9a-ed8e0c2ebe13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:26:04.655056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a006e69-b01d-4110-bb9a-ed8e0c2ebe13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:04.656713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a006e69-b01d-4110-bb9a-ed8e0c2ebe13 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:04.672735 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1079/2159] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:26:04.674229 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94d05e-f3bf-4640-9179-5d601e06c415 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:04.683641 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94d05e-f3bf-4640-9179-5d601e06c415 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:04.688523 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f5cc3-0cb9-4291-86d7-022d5eb88590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:04.689294 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f5cc3-0cb9-4291-86d7-022d5eb88590 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:04.689499 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f5cc3-0cb9-4291-86d7-022d5eb88590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:04.689773 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f5cc3-0cb9-4291-86d7-022d5eb88590 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:04.690614 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f5cc3-0cb9-4291-86d7-022d5eb88590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:04.692569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f5cc3-0cb9-4291-86d7-022d5eb88590 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:04.721901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1081/2160] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:26:04 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:26:04.724892 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a006e69-b01d-4110-bb9a-ed8e0c2ebe13 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:04.735547 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a006e69-b01d-4110-bb9a-ed8e0c2ebe13 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:04.806082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b612d-edf3-4e22-ae5e-e1f2158deb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:04.806796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b612d-edf3-4e22-ae5e-e1f2158deb5d admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:04.807105 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b612d-edf3-4e22-ae5e-e1f2158deb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:04.807404 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b612d-edf3-4e22-ae5e-e1f2158deb5d admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:04.808157 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b612d-edf3-4e22-ae5e-e1f2158deb5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:04.810165 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b612d-edf3-4e22-ae5e-e1f2158deb5d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:04.835648 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1080/2161] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:26:04 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:26:04.836786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f5cc3-0cb9-4291-86d7-022d5eb88590 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:04.847954 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f5cc3-0cb9-4291-86d7-022d5eb88590 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:04.852505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96ba97-f0a6-4632-a325-798676d68d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:04.853160 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96ba97-f0a6-4632-a325-798676d68d4b admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:04.853439 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96ba97-f0a6-4632-a325-798676d68d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:04.853718 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96ba97-f0a6-4632-a325-798676d68d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:04.854501 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96ba97-f0a6-4632-a325-798676d68d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:04.856117 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96ba97-f0a6-4632-a325-798676d68d4b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:04.866412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1082/2162] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:26:04.870381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b612d-edf3-4e22-ae5e-e1f2158deb5d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:04.881086 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b612d-edf3-4e22-ae5e-e1f2158deb5d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:04.885897 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42948646-3e74-45d7-8177-9d13ff2a56e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:04.886585 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42948646-3e74-45d7-8177-9d13ff2a56e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:04.886900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42948646-3e74-45d7-8177-9d13ff2a56e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:04.887904 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42948646-3e74-45d7-8177-9d13ff2a56e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:04.888667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42948646-3e74-45d7-8177-9d13ff2a56e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:04.890443 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42948646-3e74-45d7-8177-9d13ff2a56e4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:04.900829 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1081/2163] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:26:04.905553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96ba97-f0a6-4632-a325-798676d68d4b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:04.916272 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96ba97-f0a6-4632-a325-798676d68d4b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:04.921036 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230e9c0-cefa-4b0f-b1d4-b7c627989dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:04.921920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230e9c0-cefa-4b0f-b1d4-b7c627989dac admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:04.922205 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230e9c0-cefa-4b0f-b1d4-b7c627989dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:04.922517 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230e9c0-cefa-4b0f-b1d4-b7c627989dac admin admin] PATH_INFO: `/v3/projects/d0f50812c08741a9be23b584fe708821/users/1198a00eb02c41bc9f3b511f14e4503b/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:04.938774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230e9c0-cefa-4b0f-b1d4-b7c627989dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0f50812c08741a9be23b584fe708821, user_id=1198a00eb02c41bc9f3b511f14e4503b, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:04.941424 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230e9c0-cefa-4b0f-b1d4-b7c627989dac admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:04.944521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:04.956955 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1083/2164] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:26:04 2022] PUT /identity/v3/projects/d0f50812c08741a9be23b584fe708821/users/1198a00eb02c41bc9f3b511f14e4503b/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:04.962082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b2446-46b7-4000-bc2f-84b25edb7b5a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:04.962614 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b2446-46b7-4000-bc2f-84b25edb7b5a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:04.962707 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b2446-46b7-4000-bc2f-84b25edb7b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:04.981181 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-334b2446-46b7-4000-bc2f-84b25edb7b5a None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:04.982527 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-334b2446-46b7-4000-bc2f-84b25edb7b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:05.042652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1082/2165] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:05.052178 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230e9c0-cefa-4b0f-b1d4-b7c627989dac admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:05.053878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5230e9c0-cefa-4b0f-b1d4-b7c627989dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:05.112732 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230e9c0-cefa-4b0f-b1d4-b7c627989dac admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:05.116343 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728699d1-3153-45a7-b19f-edae2d946273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:05.116978 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728699d1-3153-45a7-b19f-edae2d946273 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:05.117260 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728699d1-3153-45a7-b19f-edae2d946273 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:05.117535 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728699d1-3153-45a7-b19f-edae2d946273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:05.127050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728699d1-3153-45a7-b19f-edae2d946273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:05.128458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728699d1-3153-45a7-b19f-edae2d946273 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:05.138806 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1084/2166] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:10.217131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83b3f0-a929-4863-bea5-034fcdec46f0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:10.217685 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83b3f0-a929-4863-bea5-034fcdec46f0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:10.217833 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83b3f0-a929-4863-bea5-034fcdec46f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:10.248910 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3f83b3f0-a929-4863-bea5-034fcdec46f0 None None] MFA Rules not processed for user `1198a00eb02c41bc9f3b511f14e4503b`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:10.251212 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3f83b3f0-a929-4863-bea5-034fcdec46f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:10.266084 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:10.348384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1083/2167] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:26:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:10.363418 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728699d1-3153-45a7-b19f-edae2d946273 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:10.364995 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-728699d1-3153-45a7-b19f-edae2d946273 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:10.511942 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728699d1-3153-45a7-b19f-edae2d946273 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:10.519760 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea1b7d-ea9b-4520-b30e-3f0404a6efa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:10.520814 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea1b7d-ea9b-4520-b30e-3f0404a6efa8 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:10.521333 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea1b7d-ea9b-4520-b30e-3f0404a6efa8 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:10.521757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea1b7d-ea9b-4520-b30e-3f0404a6efa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:10.535609 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea1b7d-ea9b-4520-b30e-3f0404a6efa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:10.537947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea1b7d-ea9b-4520-b30e-3f0404a6efa8 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:10.550968 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1085/2168] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:12.165228 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83b3f0-a929-4863-bea5-034fcdec46f0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:12.166809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3f83b3f0-a929-4863-bea5-034fcdec46f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:12.181729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83b3f0-a929-4863-bea5-034fcdec46f0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:12.186997 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617f301-6c97-47fa-a69c-3b9cb6621cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:12.187865 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617f301-6c97-47fa-a69c-3b9cb6621cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:12.188144 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617f301-6c97-47fa-a69c-3b9cb6621cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:12.188415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617f301-6c97-47fa-a69c-3b9cb6621cb7 admin admin] PATH_INFO: `/v3/users/0d4acbe504b34faa8c6b192d9258331d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:12.189602 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617f301-6c97-47fa-a69c-3b9cb6621cb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d4acbe504b34faa8c6b192d9258331d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:12.191529 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617f301-6c97-47fa-a69c-3b9cb6621cb7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:12.299980 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d617f301-6c97-47fa-a69c-3b9cb6621cb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d4acbe504b34faa8c6b192d9258331d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:12.312375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d617f301-6c97-47fa-a69c-3b9cb6621cb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d4acbe504b34faa8c6b192d9258331d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:12.345937 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d617f301-6c97-47fa-a69c-3b9cb6621cb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d4acbe504b34faa8c6b192d9258331d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:12.364314 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d617f301-6c97-47fa-a69c-3b9cb6621cb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d4acbe504b34faa8c6b192d9258331d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:12.365237 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d617f301-6c97-47fa-a69c-3b9cb6621cb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d4acbe504b34faa8c6b192d9258331d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:12.374662 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1084/2169] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:26:12 2022] DELETE /identity/v3/users/0d4acbe504b34faa8c6b192d9258331d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:12.380547 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47eea3-2f64-422f-a923-207ddc807399 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:12.381060 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47eea3-2f64-422f-a923-207ddc807399 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:12.381166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47eea3-2f64-422f-a923-207ddc807399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:12.401083 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7e47eea3-2f64-422f-a923-207ddc807399 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:12.402482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7e47eea3-2f64-422f-a923-207ddc807399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:12.506798 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1086/2170] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:12.529979 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617f301-6c97-47fa-a69c-3b9cb6621cb7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:12.531742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d617f301-6c97-47fa-a69c-3b9cb6621cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:12.652682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617f301-6c97-47fa-a69c-3b9cb6621cb7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:12.664363 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88aa182-9f66-433c-954e-41a81d7ccb9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:12.666674 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88aa182-9f66-433c-954e-41a81d7ccb9d service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:12.670956 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88aa182-9f66-433c-954e-41a81d7ccb9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:12.671148 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88aa182-9f66-433c-954e-41a81d7ccb9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:12.691255 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88aa182-9f66-433c-954e-41a81d7ccb9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:12.693144 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88aa182-9f66-433c-954e-41a81d7ccb9d service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:12.709975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91cbde-878d-47c4-8624-0ae3bfc94b69 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:12.710269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91cbde-878d-47c4-8624-0ae3bfc94b69 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:12.710611 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91cbde-878d-47c4-8624-0ae3bfc94b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:12.714176 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1085/2171] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:12.738834 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9a91cbde-878d-47c4-8624-0ae3bfc94b69 None None] MFA Rules not processed for user `1198a00eb02c41bc9f3b511f14e4503b`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:12.740083 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9a91cbde-878d-47c4-8624-0ae3bfc94b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:12.762838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:12.818452 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1087/2172] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:26:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:26:13.047944 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88aa182-9f66-433c-954e-41a81d7ccb9d service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:13.049523 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d88aa182-9f66-433c-954e-41a81d7ccb9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:13.074507 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88aa182-9f66-433c-954e-41a81d7ccb9d service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:13.080261 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235d7b2-8f4c-482c-b2c4-b7d166b51b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:13.081461 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235d7b2-8f4c-482c-b2c4-b7d166b51b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:13.081977 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235d7b2-8f4c-482c-b2c4-b7d166b51b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:13.082259 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235d7b2-8f4c-482c-b2c4-b7d166b51b76 admin admin] PATH_INFO: `/v3/projects/985eeeb9506d4990a62a26a3aa5adf6c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:13.083726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235d7b2-8f4c-482c-b2c4-b7d166b51b76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=985eeeb9506d4990a62a26a3aa5adf6c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:13.085888 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235d7b2-8f4c-482c-b2c4-b7d166b51b76 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:13.111584 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:13.165969 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e235d7b2-8f4c-482c-b2c4-b7d166b51b76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '985eeeb9506d4990a62a26a3aa5adf6c', 'request_id': 'req-e235d7b2-8f4c-482c-b2c4-b7d166b51b76'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:13.196561 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e235d7b2-8f4c-482c-b2c4-b7d166b51b76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '985eeeb9506d4990a62a26a3aa5adf6c', 'request_id': 'req-e235d7b2-8f4c-482c-b2c4-b7d166b51b76'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:13.214559 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e235d7b2-8f4c-482c-b2c4-b7d166b51b76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '985eeeb9506d4990a62a26a3aa5adf6c', 'request_id': 'req-e235d7b2-8f4c-482c-b2c4-b7d166b51b76'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:13.236901 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e235d7b2-8f4c-482c-b2c4-b7d166b51b76 admin admin] The token cache is being invalidate because project 985eeeb9506d4990a62a26a3aa5adf6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:13.237511 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e235d7b2-8f4c-482c-b2c4-b7d166b51b76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:13.238924 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e235d7b2-8f4c-482c-b2c4-b7d166b51b76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:13.241615 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1086/2173] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:13 2022] DELETE /identity/v3/projects/985eeeb9506d4990a62a26a3aa5adf6c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:13.250616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb2147-f239-4e9c-8ff6-c50ee5de16cc None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:13.251135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb2147-f239-4e9c-8ff6-c50ee5de16cc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:13.251660 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb2147-f239-4e9c-8ff6-c50ee5de16cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:13.274164 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-70bb2147-f239-4e9c-8ff6-c50ee5de16cc None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:13.275660 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-70bb2147-f239-4e9c-8ff6-c50ee5de16cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:13.379493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1088/2174] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:13.380283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3bb52-d0ac-45f3-897a-dcd572c3fc63 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:13.380581 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3bb52-d0ac-45f3-897a-dcd572c3fc63 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:13.380868 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3bb52-d0ac-45f3-897a-dcd572c3fc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:13.424355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c8f3bb52-d0ac-45f3-897a-dcd572c3fc63 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:13.426167 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c8f3bb52-d0ac-45f3-897a-dcd572c3fc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:13.445836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1087/2175] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:13.447081 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb2147-f239-4e9c-8ff6-c50ee5de16cc None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:13.461468 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb2147-f239-4e9c-8ff6-c50ee5de16cc None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:13.467228 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678ae62-7746-47b9-a0e9-b5162fbe923c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:13.468203 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678ae62-7746-47b9-a0e9-b5162fbe923c admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:13.469053 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678ae62-7746-47b9-a0e9-b5162fbe923c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:13.469931 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678ae62-7746-47b9-a0e9-b5162fbe923c admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:13.471209 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678ae62-7746-47b9-a0e9-b5162fbe923c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:26:13.471905 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678ae62-7746-47b9-a0e9-b5162fbe923c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:13.474976 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678ae62-7746-47b9-a0e9-b5162fbe923c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:13.492328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1089/2176] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:26:13.499483 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3bb52-d0ac-45f3-897a-dcd572c3fc63 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:13.514770 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3bb52-d0ac-45f3-897a-dcd572c3fc63 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:13.520481 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b2a12-15fe-4982-9124-d7209603753c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:13.521371 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b2a12-15fe-4982-9124-d7209603753c admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:13.521664 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b2a12-15fe-4982-9124-d7209603753c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:13.521951 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b2a12-15fe-4982-9124-d7209603753c admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:13.522701 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b2a12-15fe-4982-9124-d7209603753c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:13.524767 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b2a12-15fe-4982-9124-d7209603753c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:13.577375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1088/2177] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:26:13 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:26:13.581567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678ae62-7746-47b9-a0e9-b5162fbe923c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:13.605780 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678ae62-7746-47b9-a0e9-b5162fbe923c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:13.739526 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f69ee-6348-49cd-83b0-eefc0b28c086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:13.740214 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f69ee-6348-49cd-83b0-eefc0b28c086 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:13.740505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f69ee-6348-49cd-83b0-eefc0b28c086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:13.743189 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f69ee-6348-49cd-83b0-eefc0b28c086 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:13.743921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f69ee-6348-49cd-83b0-eefc0b28c086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:13.752530 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f69ee-6348-49cd-83b0-eefc0b28c086 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:13.798778 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b2a12-15fe-4982-9124-d7209603753c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:13.799759 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1090/2178] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:26:13 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:26:13.810086 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b2a12-15fe-4982-9124-d7209603753c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:13.815472 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96338e8a-68e8-49f8-b547-8f93d14ed870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:13.816148 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96338e8a-68e8-49f8-b547-8f93d14ed870 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:13.816439 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96338e8a-68e8-49f8-b547-8f93d14ed870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:13.816720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96338e8a-68e8-49f8-b547-8f93d14ed870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:13.817465 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96338e8a-68e8-49f8-b547-8f93d14ed870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:13.819148 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96338e8a-68e8-49f8-b547-8f93d14ed870 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:13.836962 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f69ee-6348-49cd-83b0-eefc0b28c086 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:13.848605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f69ee-6348-49cd-83b0-eefc0b28c086 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:13.849532 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1089/2179] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:26:13.857284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1fc5e-21c6-4add-ae61-9b52a6ec2893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:13.858586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1fc5e-21c6-4add-ae61-9b52a6ec2893 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:13.859197 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1fc5e-21c6-4add-ae61-9b52a6ec2893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:13.859770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1fc5e-21c6-4add-ae61-9b52a6ec2893 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:13.862412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1fc5e-21c6-4add-ae61-9b52a6ec2893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:13.864704 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1fc5e-21c6-4add-ae61-9b52a6ec2893 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:13.883721 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1091/2180] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:26:13.887579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96338e8a-68e8-49f8-b547-8f93d14ed870 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:13.901387 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96338e8a-68e8-49f8-b547-8f93d14ed870 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:13.912054 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ee7cb-15b1-406b-a357-6462820a4854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:13.913342 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ee7cb-15b1-406b-a357-6462820a4854 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:13.913871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ee7cb-15b1-406b-a357-6462820a4854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:13.914384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ee7cb-15b1-406b-a357-6462820a4854 admin admin] PATH_INFO: `/v3/projects/e43805fc83f443bc944a8e58bfe77ab0/users/afe43372113b413b8b00e4d873b6e0f2/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:13.953828 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ee7cb-15b1-406b-a357-6462820a4854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e43805fc83f443bc944a8e58bfe77ab0, user_id=afe43372113b413b8b00e4d873b6e0f2, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:13.957802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ee7cb-15b1-406b-a357-6462820a4854 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:13.977468 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1090/2181] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:26:13 2022] PUT /identity/v3/projects/e43805fc83f443bc944a8e58bfe77ab0/users/afe43372113b413b8b00e4d873b6e0f2/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:13.988008 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadf1f0-7962-4f68-8a52-daa4c7085b08 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:13.988328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadf1f0-7962-4f68-8a52-daa4c7085b08 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:13.988669 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadf1f0-7962-4f68-8a52-daa4c7085b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:14.052102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-adadf1f0-7962-4f68-8a52-daa4c7085b08 None None] MFA Rules not processed for user `afe43372113b413b8b00e4d873b6e0f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:14.054032 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-adadf1f0-7962-4f68-8a52-daa4c7085b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:14.131499 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:14.223455 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1092/2182] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:26:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:26:14.247340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ee7cb-15b1-406b-a357-6462820a4854 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:14.249128 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1b3ee7cb-15b1-406b-a357-6462820a4854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:14.456801 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ee7cb-15b1-406b-a357-6462820a4854 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:14.468033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea959937-aabb-4e23-8e1c-c845561c46be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:14.468831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea959937-aabb-4e23-8e1c-c845561c46be service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:14.469121 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea959937-aabb-4e23-8e1c-c845561c46be service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:14.469399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea959937-aabb-4e23-8e1c-c845561c46be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:14.485316 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea959937-aabb-4e23-8e1c-c845561c46be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:14.486898 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea959937-aabb-4e23-8e1c-c845561c46be service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:14.504642 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1091/2183] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:17.320162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadf1f0-7962-4f68-8a52-daa4c7085b08 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:17.321643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-adadf1f0-7962-4f68-8a52-daa4c7085b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:17.336110 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadf1f0-7962-4f68-8a52-daa4c7085b08 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:17.340123 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d03c17-f4d7-4b7f-811d-03258e385515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:17.340906 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d03c17-f4d7-4b7f-811d-03258e385515 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:17.341277 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d03c17-f4d7-4b7f-811d-03258e385515 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:17.341624 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d03c17-f4d7-4b7f-811d-03258e385515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:17.343696 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-72d03c17-f4d7-4b7f-811d-03258e385515 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:17.421780 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d03c17-f4d7-4b7f-811d-03258e385515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:17.423270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d03c17-f4d7-4b7f-811d-03258e385515 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:17.435925 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1093/2184] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:19.616290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea959937-aabb-4e23-8e1c-c845561c46be service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:19.664968 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:19.682616 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea959937-aabb-4e23-8e1c-c845561c46be service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:19.687850 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fab1f5-ad7c-4fc9-9484-bdbda63afd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:19.688731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fab1f5-ad7c-4fc9-9484-bdbda63afd7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:19.689014 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fab1f5-ad7c-4fc9-9484-bdbda63afd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:19.689290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fab1f5-ad7c-4fc9-9484-bdbda63afd7c admin admin] PATH_INFO: `/v3/users/afe43372113b413b8b00e4d873b6e0f2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:19.690534 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fab1f5-ad7c-4fc9-9484-bdbda63afd7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe43372113b413b8b00e4d873b6e0f2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:19.692483 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fab1f5-ad7c-4fc9-9484-bdbda63afd7c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:19.742429 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b2fab1f5-ad7c-4fc9-9484-bdbda63afd7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe43372113b413b8b00e4d873b6e0f2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:19.750820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b2fab1f5-ad7c-4fc9-9484-bdbda63afd7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe43372113b413b8b00e4d873b6e0f2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:19.763528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b2fab1f5-ad7c-4fc9-9484-bdbda63afd7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe43372113b413b8b00e4d873b6e0f2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:19.771344 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b2fab1f5-ad7c-4fc9-9484-bdbda63afd7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe43372113b413b8b00e4d873b6e0f2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:19.774514 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b2fab1f5-ad7c-4fc9-9484-bdbda63afd7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe43372113b413b8b00e4d873b6e0f2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:19.782187 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1092/2185] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:26:19 2022] DELETE /identity/v3/users/afe43372113b413b8b00e4d873b6e0f2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:19.787136 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b627f-da0e-4e4d-92bf-ace1a9f34958 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:19.787626 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b627f-da0e-4e4d-92bf-ace1a9f34958 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:19.787719 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b627f-da0e-4e4d-92bf-ace1a9f34958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:19.806706 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-787b627f-da0e-4e4d-92bf-ace1a9f34958 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:19.807929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-787b627f-da0e-4e4d-92bf-ace1a9f34958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:19.866391 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1094/2186] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:19.875960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fab1f5-ad7c-4fc9-9484-bdbda63afd7c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:19.877403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b2fab1f5-ad7c-4fc9-9484-bdbda63afd7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:19.937189 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fab1f5-ad7c-4fc9-9484-bdbda63afd7c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:19.941099 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8f195-3f28-4919-88e9-425d805b6ea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:19.941826 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8f195-3f28-4919-88e9-425d805b6ea6 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:19.942131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8f195-3f28-4919-88e9-425d805b6ea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:19.942541 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8f195-3f28-4919-88e9-425d805b6ea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:19.953899 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8f195-3f28-4919-88e9-425d805b6ea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:19.955374 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8f195-3f28-4919-88e9-425d805b6ea6 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:19.965980 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1093/2187] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:20.475093 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b627f-da0e-4e4d-92bf-ace1a9f34958 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:20.476737 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-787b627f-da0e-4e4d-92bf-ace1a9f34958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:20.516989 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b627f-da0e-4e4d-92bf-ace1a9f34958 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:20.522991 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc223fa-e8b4-4c6f-a3de-a4ae05c015aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:20.523882 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc223fa-e8b4-4c6f-a3de-a4ae05c015aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:20.524163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc223fa-e8b4-4c6f-a3de-a4ae05c015aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:20.524523 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc223fa-e8b4-4c6f-a3de-a4ae05c015aa admin admin] PATH_INFO: `/v3/projects/e43805fc83f443bc944a8e58bfe77ab0` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:20.525653 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc223fa-e8b4-4c6f-a3de-a4ae05c015aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e43805fc83f443bc944a8e58bfe77ab0)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:20.528472 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc223fa-e8b4-4c6f-a3de-a4ae05c015aa admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:20.592691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6bc223fa-e8b4-4c6f-a3de-a4ae05c015aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e43805fc83f443bc944a8e58bfe77ab0', 'request_id': 'req-6bc223fa-e8b4-4c6f-a3de-a4ae05c015aa'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:20.604113 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6bc223fa-e8b4-4c6f-a3de-a4ae05c015aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e43805fc83f443bc944a8e58bfe77ab0', 'request_id': 'req-6bc223fa-e8b4-4c6f-a3de-a4ae05c015aa'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:20.605407 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:20.612333 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6bc223fa-e8b4-4c6f-a3de-a4ae05c015aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e43805fc83f443bc944a8e58bfe77ab0', 'request_id': 'req-6bc223fa-e8b4-4c6f-a3de-a4ae05c015aa'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:20.630906 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6bc223fa-e8b4-4c6f-a3de-a4ae05c015aa admin admin] The token cache is being invalidate because project e43805fc83f443bc944a8e58bfe77ab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:20.631270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6bc223fa-e8b4-4c6f-a3de-a4ae05c015aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:20.632888 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6bc223fa-e8b4-4c6f-a3de-a4ae05c015aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:20.637963 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1095/2188] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:20 2022] DELETE /identity/v3/projects/e43805fc83f443bc944a8e58bfe77ab0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:20.639724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b460a-f0e5-437a-9680-cf1594cff110 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:20.640187 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b460a-f0e5-437a-9680-cf1594cff110 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:20.640296 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b460a-f0e5-437a-9680-cf1594cff110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:20.669604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-554b460a-f0e5-437a-9680-cf1594cff110 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:20.672013 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-554b460a-f0e5-437a-9680-cf1594cff110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:20.764253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1094/2189] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:20.774402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922c2a4-94a1-4ece-a70a-5548e64b12af None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:20.774689 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922c2a4-94a1-4ece-a70a-5548e64b12af None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:20.774964 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922c2a4-94a1-4ece-a70a-5548e64b12af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:20.809648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a922c2a4-94a1-4ece-a70a-5548e64b12af None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:20.810910 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a922c2a4-94a1-4ece-a70a-5548e64b12af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:20.820653 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1096/2190] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:20.825832 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b460a-f0e5-437a-9680-cf1594cff110 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:20.838110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b460a-f0e5-437a-9680-cf1594cff110 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:20.845616 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd057b-62d8-47c1-9df0-9fa4b0b7ba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:20.846968 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd057b-62d8-47c1-9df0-9fa4b0b7ba3f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:20.846968 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd057b-62d8-47c1-9df0-9fa4b0b7ba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:20.846968 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dd057b-62d8-47c1-9df0-9fa4b0b7ba3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:20.847682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd057b-62d8-47c1-9df0-9fa4b0b7ba3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:26:20.847915 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd057b-62d8-47c1-9df0-9fa4b0b7ba3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:20.849761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dd057b-62d8-47c1-9df0-9fa4b0b7ba3f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:20.853192 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:20.867723 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1095/2191] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:26:20.870869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922c2a4-94a1-4ece-a70a-5548e64b12af None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:20.881354 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922c2a4-94a1-4ece-a70a-5548e64b12af None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:20.886657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731f9ae-e475-47af-931c-a40f0ea8c3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:20.887780 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731f9ae-e475-47af-931c-a40f0ea8c3b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:20.888278 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731f9ae-e475-47af-931c-a40f0ea8c3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:20.888524 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731f9ae-e475-47af-931c-a40f0ea8c3b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:20.889232 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731f9ae-e475-47af-931c-a40f0ea8c3b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:20.891196 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731f9ae-e475-47af-931c-a40f0ea8c3b3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:20.924055 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1097/2192] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:26:20 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:26:20.928131 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd057b-62d8-47c1-9df0-9fa4b0b7ba3f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:20.941957 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dd057b-62d8-47c1-9df0-9fa4b0b7ba3f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:21.005268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8e82d-b7ae-4cad-93aa-be26f4864fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:21.005988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8e82d-b7ae-4cad-93aa-be26f4864fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:21.006255 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8e82d-b7ae-4cad-93aa-be26f4864fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:21.006570 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8e82d-b7ae-4cad-93aa-be26f4864fc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:21.007392 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8e82d-b7ae-4cad-93aa-be26f4864fc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:21.009396 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8e82d-b7ae-4cad-93aa-be26f4864fc6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:21.031382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1096/2193] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:26:20 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:26:21.036119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731f9ae-e475-47af-931c-a40f0ea8c3b3 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:21.049564 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731f9ae-e475-47af-931c-a40f0ea8c3b3 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:21.054246 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e3188-becf-41ea-a4fe-c7674b5b735f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:21.054940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e3188-becf-41ea-a4fe-c7674b5b735f admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:21.055228 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e3188-becf-41ea-a4fe-c7674b5b735f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:21.055508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e3188-becf-41ea-a4fe-c7674b5b735f admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:21.056244 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e3188-becf-41ea-a4fe-c7674b5b735f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:21.057846 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e3188-becf-41ea-a4fe-c7674b5b735f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:21.068351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1098/2194] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:26:21.072319 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8e82d-b7ae-4cad-93aa-be26f4864fc6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:21.082651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8e82d-b7ae-4cad-93aa-be26f4864fc6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:21.087275 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876716e-7f41-4d5e-a201-8807a99eed3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:21.087927 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876716e-7f41-4d5e-a201-8807a99eed3a admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:21.088211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876716e-7f41-4d5e-a201-8807a99eed3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:21.088490 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876716e-7f41-4d5e-a201-8807a99eed3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:21.089216 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876716e-7f41-4d5e-a201-8807a99eed3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:21.091311 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876716e-7f41-4d5e-a201-8807a99eed3a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:21.101191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1097/2195] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:26:21.105317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e3188-becf-41ea-a4fe-c7674b5b735f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:21.116213 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e3188-becf-41ea-a4fe-c7674b5b735f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:21.120899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35494cf-020e-468a-a45e-823d7e276de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:21.121773 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35494cf-020e-468a-a45e-823d7e276de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:21.122126 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35494cf-020e-468a-a45e-823d7e276de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:21.122624 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35494cf-020e-468a-a45e-823d7e276de3 admin admin] PATH_INFO: `/v3/projects/efb4a8d109b04557abf549231a70ad98/users/b9daf80901df487a99d83f84a303995d/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:21.138574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35494cf-020e-468a-a45e-823d7e276de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb4a8d109b04557abf549231a70ad98, user_id=b9daf80901df487a99d83f84a303995d, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:21.141246 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35494cf-020e-468a-a45e-823d7e276de3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:21.154885 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1099/2196] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:26:21 2022] PUT /identity/v3/projects/efb4a8d109b04557abf549231a70ad98/users/b9daf80901df487a99d83f84a303995d/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:21.159963 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1c38a-e840-488b-8a04-1fb0beb00de6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:21.160286 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1c38a-e840-488b-8a04-1fb0beb00de6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:21.160574 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1c38a-e840-488b-8a04-1fb0beb00de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:21.178818 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a3e1c38a-e840-488b-8a04-1fb0beb00de6 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:21.180044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a3e1c38a-e840-488b-8a04-1fb0beb00de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:21.245832 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1098/2197] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:21.255551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35494cf-020e-468a-a45e-823d7e276de3 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:21.257237 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e35494cf-020e-468a-a45e-823d7e276de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:21.317641 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35494cf-020e-468a-a45e-823d7e276de3 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:21.321363 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8e73f-4c92-4f83-83a7-053f50d12b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:21.322007 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8e73f-4c92-4f83-83a7-053f50d12b02 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:21.322295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8e73f-4c92-4f83-83a7-053f50d12b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:21.322599 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8e73f-4c92-4f83-83a7-053f50d12b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:21.333557 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8e73f-4c92-4f83-83a7-053f50d12b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:21.335192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8e73f-4c92-4f83-83a7-053f50d12b02 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:21.347116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1100/2198] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:22.245572 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ed632-5e82-4166-b21c-81ec1e11d296 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:22.246254 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ed632-5e82-4166-b21c-81ec1e11d296 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:22.246254 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ed632-5e82-4166-b21c-81ec1e11d296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:22.274490 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-af1ed632-5e82-4166-b21c-81ec1e11d296 None None] MFA Rules not processed for user `b9daf80901df487a99d83f84a303995d`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:22.275704 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-af1ed632-5e82-4166-b21c-81ec1e11d296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:22.348229 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1099/2199] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:26:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:22.360725 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8e73f-4c92-4f83-83a7-053f50d12b02 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:22.362170 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-44a8e73f-4c92-4f83-83a7-053f50d12b02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:22.436457 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8e73f-4c92-4f83-83a7-053f50d12b02 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:22.440586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e942be-822b-4e0c-947c-cd29597f0544 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:22.441241 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e942be-822b-4e0c-947c-cd29597f0544 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:22.441969 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e942be-822b-4e0c-947c-cd29597f0544 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:22.441969 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e942be-822b-4e0c-947c-cd29597f0544 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:22.451869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e942be-822b-4e0c-947c-cd29597f0544 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:22.453693 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e942be-822b-4e0c-947c-cd29597f0544 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:22.470401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1101/2200] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:23.931055 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa7959-2771-4f17-acf8-b2bf83e76657 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:23.931587 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa7959-2771-4f17-acf8-b2bf83e76657 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:23.931587 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa7959-2771-4f17-acf8-b2bf83e76657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:23.938354 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:23.949755 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-38aa7959-2771-4f17-acf8-b2bf83e76657 None None] MFA Rules not processed for user `b9daf80901df487a99d83f84a303995d`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:23.951048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-38aa7959-2771-4f17-acf8-b2bf83e76657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:23.959603 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1100/2201] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:26:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:24.730689 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41932c-8b8f-4fd7-b9a7-40fce79a1943 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:24.731221 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41932c-8b8f-4fd7-b9a7-40fce79a1943 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:24.731830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41932c-8b8f-4fd7-b9a7-40fce79a1943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:24.754935 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9f41932c-8b8f-4fd7-b9a7-40fce79a1943 None None] MFA Rules not processed for user `5a97146a30df493182867c7609fe633f`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:24.756411 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9f41932c-8b8f-4fd7-b9a7-40fce79a1943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:24.811525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:24.881470 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1102/2202] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:26:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:26:27.023410 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa7959-2771-4f17-acf8-b2bf83e76657 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:27.024854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-38aa7959-2771-4f17-acf8-b2bf83e76657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:27.039717 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa7959-2771-4f17-acf8-b2bf83e76657 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:27.044777 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d4994-93d2-4356-af66-b9432869d35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:27.045632 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d4994-93d2-4356-af66-b9432869d35c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:27.045910 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d4994-93d2-4356-af66-b9432869d35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:27.046189 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d4994-93d2-4356-af66-b9432869d35c admin admin] PATH_INFO: `/v3/users/143b70081fff4b6ca44ebda299174117` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:27.047386 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d4994-93d2-4356-af66-b9432869d35c admin admin] RBAC: Authorizing `identity:delete_user(user_id=143b70081fff4b6ca44ebda299174117)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:27.049261 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d4994-93d2-4356-af66-b9432869d35c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:27.095051 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-139d4994-93d2-4356-af66-b9432869d35c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '143b70081fff4b6ca44ebda299174117'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:27.101909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-139d4994-93d2-4356-af66-b9432869d35c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '143b70081fff4b6ca44ebda299174117'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:27.117783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-139d4994-93d2-4356-af66-b9432869d35c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '143b70081fff4b6ca44ebda299174117'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:27.127383 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-139d4994-93d2-4356-af66-b9432869d35c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '143b70081fff4b6ca44ebda299174117'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:27.128357 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-139d4994-93d2-4356-af66-b9432869d35c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '143b70081fff4b6ca44ebda299174117'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:27.140179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1101/2203] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:26:27 2022] DELETE /identity/v3/users/143b70081fff4b6ca44ebda299174117 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:26:27.145301 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229dd7b-17db-48e8-8081-e44f77a6d22e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:27.145935 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229dd7b-17db-48e8-8081-e44f77a6d22e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:27.148216 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229dd7b-17db-48e8-8081-e44f77a6d22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:27.170711 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1229dd7b-17db-48e8-8081-e44f77a6d22e None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:27.172064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1229dd7b-17db-48e8-8081-e44f77a6d22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:27.243899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1103/2204] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:27.253897 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d4994-93d2-4356-af66-b9432869d35c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:27.255406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-139d4994-93d2-4356-af66-b9432869d35c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:27.321104 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d4994-93d2-4356-af66-b9432869d35c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:27.325178 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbc274-e705-4b44-80e5-bb36cc5191b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:27.325848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbc274-e705-4b44-80e5-bb36cc5191b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:27.326128 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbc274-e705-4b44-80e5-bb36cc5191b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:27.326435 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbc274-e705-4b44-80e5-bb36cc5191b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:27.336352 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbc274-e705-4b44-80e5-bb36cc5191b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:27.337816 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbc274-e705-4b44-80e5-bb36cc5191b6 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:27.347965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1102/2205] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:27.619611 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229dd7b-17db-48e8-8081-e44f77a6d22e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:27.621661 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1229dd7b-17db-48e8-8081-e44f77a6d22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:27.637438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229dd7b-17db-48e8-8081-e44f77a6d22e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:27.642026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1b4ea-212c-4516-bdc6-63d497ba400c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:27.642979 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1b4ea-212c-4516-bdc6-63d497ba400c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:27.643250 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1b4ea-212c-4516-bdc6-63d497ba400c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:27.643527 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1b4ea-212c-4516-bdc6-63d497ba400c admin admin] PATH_INFO: `/v3/projects/f864c23b7623460cb5ad7625c8c59c06` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:27.644728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1b4ea-212c-4516-bdc6-63d497ba400c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f864c23b7623460cb5ad7625c8c59c06)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:27.646691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1b4ea-212c-4516-bdc6-63d497ba400c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:27.693230 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-43f1b4ea-212c-4516-bdc6-63d497ba400c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f864c23b7623460cb5ad7625c8c59c06', 'request_id': 'req-43f1b4ea-212c-4516-bdc6-63d497ba400c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:27.699914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-43f1b4ea-212c-4516-bdc6-63d497ba400c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f864c23b7623460cb5ad7625c8c59c06', 'request_id': 'req-43f1b4ea-212c-4516-bdc6-63d497ba400c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:27.705500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-43f1b4ea-212c-4516-bdc6-63d497ba400c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f864c23b7623460cb5ad7625c8c59c06', 'request_id': 'req-43f1b4ea-212c-4516-bdc6-63d497ba400c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:27.718209 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-43f1b4ea-212c-4516-bdc6-63d497ba400c admin admin] The token cache is being invalidate because project f864c23b7623460cb5ad7625c8c59c06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:27.718537 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-43f1b4ea-212c-4516-bdc6-63d497ba400c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:27.719546 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-43f1b4ea-212c-4516-bdc6-63d497ba400c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:27.721187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1104/2206] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:27 2022] DELETE /identity/v3/projects/f864c23b7623460cb5ad7625c8c59c06 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:26:37.343651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=56,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:37.714998 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=68,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:45.228357 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbc274-e705-4b44-80e5-bb36cc5191b6 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:45.230551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-35bbc274-e705-4b44-80e5-bb36cc5191b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:45.249914 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbc274-e705-4b44-80e5-bb36cc5191b6 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:45.314962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b5e02-6345-4356-8585-acfdc41dd141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:45.315922 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b5e02-6345-4356-8585-acfdc41dd141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:45.316259 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b5e02-6345-4356-8585-acfdc41dd141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:45.316511 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b5e02-6345-4356-8585-acfdc41dd141 admin admin] PATH_INFO: `/v3/users/ceac9c13b72a49f38f153e61382d1f36` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:45.317809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b5e02-6345-4356-8585-acfdc41dd141 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceac9c13b72a49f38f153e61382d1f36)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:45.320012 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b5e02-6345-4356-8585-acfdc41dd141 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:45.371181 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-715b5e02-6345-4356-8585-acfdc41dd141 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceac9c13b72a49f38f153e61382d1f36'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:45.378557 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-715b5e02-6345-4356-8585-acfdc41dd141 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceac9c13b72a49f38f153e61382d1f36'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:45.391454 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-715b5e02-6345-4356-8585-acfdc41dd141 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceac9c13b72a49f38f153e61382d1f36'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:45.399709 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-715b5e02-6345-4356-8585-acfdc41dd141 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceac9c13b72a49f38f153e61382d1f36'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:45.400525 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-715b5e02-6345-4356-8585-acfdc41dd141 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceac9c13b72a49f38f153e61382d1f36'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:45.406956 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1103/2207] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:26:45 2022] DELETE /identity/v3/users/ceac9c13b72a49f38f153e61382d1f36 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:45.587129 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1b4ea-212c-4516-bdc6-63d497ba400c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:45.589128 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-43f1b4ea-212c-4516-bdc6-63d497ba400c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:45.603138 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1b4ea-212c-4516-bdc6-63d497ba400c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:45.668265 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73def9-9843-44ba-a61a-77a08ef6e742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:45.669137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73def9-9843-44ba-a61a-77a08ef6e742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:45.669546 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73def9-9843-44ba-a61a-77a08ef6e742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:45.669832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73def9-9843-44ba-a61a-77a08ef6e742 admin admin] PATH_INFO: `/v3/projects/e544152897eb49eab859363ce2b95f46` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:45.671197 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73def9-9843-44ba-a61a-77a08ef6e742 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e544152897eb49eab859363ce2b95f46)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:45.673119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73def9-9843-44ba-a61a-77a08ef6e742 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:45.730347 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7e73def9-9843-44ba-a61a-77a08ef6e742 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e544152897eb49eab859363ce2b95f46', 'request_id': 'req-7e73def9-9843-44ba-a61a-77a08ef6e742'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:45.738996 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7e73def9-9843-44ba-a61a-77a08ef6e742 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e544152897eb49eab859363ce2b95f46', 'request_id': 'req-7e73def9-9843-44ba-a61a-77a08ef6e742'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:45.744561 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7e73def9-9843-44ba-a61a-77a08ef6e742 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e544152897eb49eab859363ce2b95f46', 'request_id': 'req-7e73def9-9843-44ba-a61a-77a08ef6e742'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:45.757669 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7e73def9-9843-44ba-a61a-77a08ef6e742 admin admin] The token cache is being invalidate because project e544152897eb49eab859363ce2b95f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:45.758539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7e73def9-9843-44ba-a61a-77a08ef6e742 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:45.758718 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7e73def9-9843-44ba-a61a-77a08ef6e742 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:45.762249 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1105/2208] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:45 2022] DELETE /identity/v3/projects/e544152897eb49eab859363ce2b95f46 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:45.765992 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b5e02-6345-4356-8585-acfdc41dd141 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:45.767439 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-715b5e02-6345-4356-8585-acfdc41dd141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:45.781144 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b5e02-6345-4356-8585-acfdc41dd141 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:45.843550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd32b8-7405-4ef4-8f2d-b82e545486d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:45.844485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd32b8-7405-4ef4-8f2d-b82e545486d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:45.844775 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd32b8-7405-4ef4-8f2d-b82e545486d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:45.845049 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd32b8-7405-4ef4-8f2d-b82e545486d7 admin admin] PATH_INFO: `/v3/users/2b8627b1754a43899588edff5d6b6c52` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:45.846238 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd32b8-7405-4ef4-8f2d-b82e545486d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8627b1754a43899588edff5d6b6c52)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:45.848172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd32b8-7405-4ef4-8f2d-b82e545486d7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:45.869177 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:45.896151 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-90fd32b8-7405-4ef4-8f2d-b82e545486d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8627b1754a43899588edff5d6b6c52'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:45.903436 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-90fd32b8-7405-4ef4-8f2d-b82e545486d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8627b1754a43899588edff5d6b6c52'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:45.915715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-90fd32b8-7405-4ef4-8f2d-b82e545486d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8627b1754a43899588edff5d6b6c52'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:45.924799 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-90fd32b8-7405-4ef4-8f2d-b82e545486d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8627b1754a43899588edff5d6b6c52'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:45.925837 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-90fd32b8-7405-4ef4-8f2d-b82e545486d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8627b1754a43899588edff5d6b6c52'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:45.933349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1104/2209] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:26:45 2022] DELETE /identity/v3/users/2b8627b1754a43899588edff5d6b6c52 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:46.124608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73def9-9843-44ba-a61a-77a08ef6e742 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:46.126496 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7e73def9-9843-44ba-a61a-77a08ef6e742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:46.162813 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73def9-9843-44ba-a61a-77a08ef6e742 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:46.237037 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d046a-1162-4732-9ea4-d381b4a80a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:46.238016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d046a-1162-4732-9ea4-d381b4a80a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:46.238650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d046a-1162-4732-9ea4-d381b4a80a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:46.240499 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d046a-1162-4732-9ea4-d381b4a80a47 admin admin] PATH_INFO: `/v3/projects/9db577256c1a4e64872594b130900956` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:46.241667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d046a-1162-4732-9ea4-d381b4a80a47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9db577256c1a4e64872594b130900956)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:46.243715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d046a-1162-4732-9ea4-d381b4a80a47 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:46.287982 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:46.303798 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-787d046a-1162-4732-9ea4-d381b4a80a47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9db577256c1a4e64872594b130900956', 'request_id': 'req-787d046a-1162-4732-9ea4-d381b4a80a47'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:46.310742 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-787d046a-1162-4732-9ea4-d381b4a80a47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9db577256c1a4e64872594b130900956', 'request_id': 'req-787d046a-1162-4732-9ea4-d381b4a80a47'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:46.316343 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-787d046a-1162-4732-9ea4-d381b4a80a47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9db577256c1a4e64872594b130900956', 'request_id': 'req-787d046a-1162-4732-9ea4-d381b4a80a47'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:46.329799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-787d046a-1162-4732-9ea4-d381b4a80a47 admin admin] The token cache is being invalidate because project 9db577256c1a4e64872594b130900956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:46.330090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-787d046a-1162-4732-9ea4-d381b4a80a47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:46.330743 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-787d046a-1162-4732-9ea4-d381b4a80a47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:46.332283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1106/2210] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:46 2022] DELETE /identity/v3/projects/9db577256c1a4e64872594b130900956 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:46.337453 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18880d6-2e0a-4743-bc6c-a8137295ddf9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:46.337917 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18880d6-2e0a-4743-bc6c-a8137295ddf9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:46.338025 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18880d6-2e0a-4743-bc6c-a8137295ddf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:46.357582 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d18880d6-2e0a-4743-bc6c-a8137295ddf9 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:46.358883 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d18880d6-2e0a-4743-bc6c-a8137295ddf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:46.418128 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1105/2211] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:46.425564 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324816dd-4c7f-4564-b575-c9f3fbc9788a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:46.425858 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324816dd-4c7f-4564-b575-c9f3fbc9788a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:46.426140 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324816dd-4c7f-4564-b575-c9f3fbc9788a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:46.449251 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-324816dd-4c7f-4564-b575-c9f3fbc9788a None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:46.450615 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-324816dd-4c7f-4564-b575-c9f3fbc9788a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:46.459801 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1107/2212] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:46.463827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18880d6-2e0a-4743-bc6c-a8137295ddf9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:46.473670 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18880d6-2e0a-4743-bc6c-a8137295ddf9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:46.478770 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66012418-f690-423c-bdc3-232f7eef6a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:46.479944 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66012418-f690-423c-bdc3-232f7eef6a08 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:46.480789 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66012418-f690-423c-bdc3-232f7eef6a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:46.480789 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66012418-f690-423c-bdc3-232f7eef6a08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:46.481579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66012418-f690-423c-bdc3-232f7eef6a08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:26:46.481579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66012418-f690-423c-bdc3-232f7eef6a08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:46.483112 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66012418-f690-423c-bdc3-232f7eef6a08 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:46.495948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1106/2213] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:26:46.500092 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324816dd-4c7f-4564-b575-c9f3fbc9788a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:46.519202 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324816dd-4c7f-4564-b575-c9f3fbc9788a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:46.524432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988a1f3-097d-4f65-b45d-c9df8efe93f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:46.525098 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988a1f3-097d-4f65-b45d-c9df8efe93f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:46.525383 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988a1f3-097d-4f65-b45d-c9df8efe93f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:46.525668 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988a1f3-097d-4f65-b45d-c9df8efe93f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:46.527530 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988a1f3-097d-4f65-b45d-c9df8efe93f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:46.528417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988a1f3-097d-4f65-b45d-c9df8efe93f2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:46.561834 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1108/2214] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:26:46 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:26:46.562899 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66012418-f690-423c-bdc3-232f7eef6a08 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:46.573840 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66012418-f690-423c-bdc3-232f7eef6a08 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:46.632875 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20e176-2a72-4adc-b240-67f71e90895a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:46.633554 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20e176-2a72-4adc-b240-67f71e90895a admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:46.633842 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20e176-2a72-4adc-b240-67f71e90895a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:46.634118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20e176-2a72-4adc-b240-67f71e90895a admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:46.634856 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20e176-2a72-4adc-b240-67f71e90895a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:46.636831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20e176-2a72-4adc-b240-67f71e90895a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:46.660848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1107/2215] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:26:46 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:26:46.662228 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988a1f3-097d-4f65-b45d-c9df8efe93f2 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:46.674760 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988a1f3-097d-4f65-b45d-c9df8efe93f2 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:46.680000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f209371-192a-4ec1-b0f9-03d400d6265a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:46.680864 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f209371-192a-4ec1-b0f9-03d400d6265a admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:46.681327 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f209371-192a-4ec1-b0f9-03d400d6265a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:46.681662 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f209371-192a-4ec1-b0f9-03d400d6265a admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:46.682629 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f209371-192a-4ec1-b0f9-03d400d6265a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:46.684801 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f209371-192a-4ec1-b0f9-03d400d6265a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:46.695959 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1109/2216] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:26:46.700541 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20e176-2a72-4adc-b240-67f71e90895a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:46.711381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20e176-2a72-4adc-b240-67f71e90895a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:46.718437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71822938-8d5b-4587-957e-c4c1b001b252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:46.719120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71822938-8d5b-4587-957e-c4c1b001b252 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:46.719387 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71822938-8d5b-4587-957e-c4c1b001b252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:46.719664 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71822938-8d5b-4587-957e-c4c1b001b252 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:46.720400 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71822938-8d5b-4587-957e-c4c1b001b252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:46.722056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71822938-8d5b-4587-957e-c4c1b001b252 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:46.735855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1108/2217] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:26:46.737184 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f209371-192a-4ec1-b0f9-03d400d6265a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:46.748950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f209371-192a-4ec1-b0f9-03d400d6265a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:46.753938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fab561-18ff-4faa-83f5-154986f2250a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:46.755054 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fab561-18ff-4faa-83f5-154986f2250a admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:46.755457 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fab561-18ff-4faa-83f5-154986f2250a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:46.755832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fab561-18ff-4faa-83f5-154986f2250a admin admin] PATH_INFO: `/v3/projects/d7bc3053528247379cd1a2529ba63cf5/users/4ae51807cd6e4f358d59b6cdae678e57/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:46.771413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fab561-18ff-4faa-83f5-154986f2250a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7bc3053528247379cd1a2529ba63cf5, user_id=4ae51807cd6e4f358d59b6cdae678e57, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:46.774101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fab561-18ff-4faa-83f5-154986f2250a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:46.790553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1110/2218] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:26:46 2022] PUT /identity/v3/projects/d7bc3053528247379cd1a2529ba63cf5/users/4ae51807cd6e4f358d59b6cdae678e57/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:46.801608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f013e-7234-4377-97bb-3025a8cfb469 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:46.801910 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f013e-7234-4377-97bb-3025a8cfb469 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:46.802196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f013e-7234-4377-97bb-3025a8cfb469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:46.809838 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:46.831415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-242f013e-7234-4377-97bb-3025a8cfb469 None None] MFA Rules not processed for user `4ae51807cd6e4f358d59b6cdae678e57`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:46.832688 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-242f013e-7234-4377-97bb-3025a8cfb469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:46.913348 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1109/2219] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:26:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:46.918584 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fab561-18ff-4faa-83f5-154986f2250a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:47.008576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fab561-18ff-4faa-83f5-154986f2250a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:47.013406 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b72abe-63ba-4ab4-b887-877cda75f775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:47.014147 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b72abe-63ba-4ab4-b887-877cda75f775 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:47.014472 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b72abe-63ba-4ab4-b887-877cda75f775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:47.014747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b72abe-63ba-4ab4-b887-877cda75f775 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:47.015435 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b72abe-63ba-4ab4-b887-877cda75f775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:47.017421 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b72abe-63ba-4ab4-b887-877cda75f775 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:47.044678 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1111/2220] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:26:46 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:26:47.048892 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f013e-7234-4377-97bb-3025a8cfb469 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:47.060212 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f013e-7234-4377-97bb-3025a8cfb469 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:47.127713 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07983a9a-9de2-4ade-b1a6-fd6927d2f9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:47.128399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07983a9a-9de2-4ade-b1a6-fd6927d2f9a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:47.128685 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07983a9a-9de2-4ade-b1a6-fd6927d2f9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:47.128962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07983a9a-9de2-4ade-b1a6-fd6927d2f9a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:47.129679 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07983a9a-9de2-4ade-b1a6-fd6927d2f9a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:47.131795 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07983a9a-9de2-4ade-b1a6-fd6927d2f9a6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:47.164537 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1110/2221] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:26:47 2022] POST /identity/v3/users => generated 298 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:26:47.168850 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b72abe-63ba-4ab4-b887-877cda75f775 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:47.189546 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b72abe-63ba-4ab4-b887-877cda75f775 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:47.194414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7a892-ea05-4e18-94b4-188c084c3cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:47.195085 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7a892-ea05-4e18-94b4-188c084c3cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:47.195382 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7a892-ea05-4e18-94b4-188c084c3cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:47.195661 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7a892-ea05-4e18-94b4-188c084c3cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:47.196388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7a892-ea05-4e18-94b4-188c084c3cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:47.198565 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7a892-ea05-4e18-94b4-188c084c3cd0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:47.210029 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1112/2222] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:26:47.215287 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07983a9a-9de2-4ade-b1a6-fd6927d2f9a6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:47.226973 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07983a9a-9de2-4ade-b1a6-fd6927d2f9a6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:47.231747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a21d9e-d0c6-408a-ac5e-64c0d572551e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:47.232624 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a21d9e-d0c6-408a-ac5e-64c0d572551e admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:47.232907 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a21d9e-d0c6-408a-ac5e-64c0d572551e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:47.233233 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a21d9e-d0c6-408a-ac5e-64c0d572551e admin admin] PATH_INFO: `/v3/projects/1e8f33ec9fe541359445a6d82e742318/users/5e3db0454bc541e9b60d3022a198466b/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:47.251787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a21d9e-d0c6-408a-ac5e-64c0d572551e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e8f33ec9fe541359445a6d82e742318, user_id=5e3db0454bc541e9b60d3022a198466b, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:47.254754 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a21d9e-d0c6-408a-ac5e-64c0d572551e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:47.268362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1111/2223] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:26:47 2022] PUT /identity/v3/projects/1e8f33ec9fe541359445a6d82e742318/users/5e3db0454bc541e9b60d3022a198466b/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:26:47.272304 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7a892-ea05-4e18-94b4-188c084c3cd0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:47.283076 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7a892-ea05-4e18-94b4-188c084c3cd0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:47.311252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:47.346570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af351151-e4ff-4acd-a0a6-706e8199f689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:47.347277 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af351151-e4ff-4acd-a0a6-706e8199f689 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:47.347571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af351151-e4ff-4acd-a0a6-706e8199f689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:47.347871 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af351151-e4ff-4acd-a0a6-706e8199f689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:47.348600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af351151-e4ff-4acd-a0a6-706e8199f689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:47.350209 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af351151-e4ff-4acd-a0a6-706e8199f689 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:47.361038 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1113/2224] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:26:47.365184 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a21d9e-d0c6-408a-ac5e-64c0d572551e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:47.376216 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a21d9e-d0c6-408a-ac5e-64c0d572551e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:47.381354 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875a78f-803e-4274-b0ca-ac3dc4a48c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:47.382546 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875a78f-803e-4274-b0ca-ac3dc4a48c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:47.382836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875a78f-803e-4274-b0ca-ac3dc4a48c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:47.383115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875a78f-803e-4274-b0ca-ac3dc4a48c37 admin admin] PATH_INFO: `/v3/projects/1e8f33ec9fe541359445a6d82e742318/users/5e3db0454bc541e9b60d3022a198466b/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:47.385350 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875a78f-803e-4274-b0ca-ac3dc4a48c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e8f33ec9fe541359445a6d82e742318, user_id=5e3db0454bc541e9b60d3022a198466b, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:47.388512 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875a78f-803e-4274-b0ca-ac3dc4a48c37 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:47.399063 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1112/2225] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:26:47 2022] PUT /identity/v3/projects/1e8f33ec9fe541359445a6d82e742318/users/5e3db0454bc541e9b60d3022a198466b/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:47.411153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf4d84-d4e7-4c17-a02b-049538ff9453 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:47.411695 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf4d84-d4e7-4c17-a02b-049538ff9453 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:47.412198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf4d84-d4e7-4c17-a02b-049538ff9453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:47.440570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-72cf4d84-d4e7-4c17-a02b-049538ff9453 None None] MFA Rules not processed for user `5e3db0454bc541e9b60d3022a198466b`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:47.442326 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-72cf4d84-d4e7-4c17-a02b-049538ff9453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:47.514942 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1114/2226] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:26:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:47.525967 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875a78f-803e-4274-b0ca-ac3dc4a48c37 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:47.528706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0875a78f-803e-4274-b0ca-ac3dc4a48c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:47.582033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:47.588757 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875a78f-803e-4274-b0ca-ac3dc4a48c37 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:47.592791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60470575-d9c8-4672-a549-b621e57702d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:47.593441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60470575-d9c8-4672-a549-b621e57702d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:47.593737 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60470575-d9c8-4672-a549-b621e57702d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:47.594035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60470575-d9c8-4672-a549-b621e57702d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:47.650133 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60470575-d9c8-4672-a549-b621e57702d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:47.651920 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60470575-d9c8-4672-a549-b621e57702d7 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:47.661145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1113/2227] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:51.941018 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf4d84-d4e7-4c17-a02b-049538ff9453 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:51.942609 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-72cf4d84-d4e7-4c17-a02b-049538ff9453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:51.955736 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf4d84-d4e7-4c17-a02b-049538ff9453 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:51.959303 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a7d48-2203-46ed-b9c3-6f3286a7a61c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:51.959950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a7d48-2203-46ed-b9c3-6f3286a7a61c service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:51.960269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a7d48-2203-46ed-b9c3-6f3286a7a61c service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:51.960544 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a7d48-2203-46ed-b9c3-6f3286a7a61c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:51.970488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a7d48-2203-46ed-b9c3-6f3286a7a61c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:51.971943 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a7d48-2203-46ed-b9c3-6f3286a7a61c service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:51.983515 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1115/2228] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:26:56.887599 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60470575-d9c8-4672-a549-b621e57702d7 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:56.953072 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60470575-d9c8-4672-a549-b621e57702d7 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:56.958438 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b9b85-b6ee-4815-bd2b-ef1d011b4079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:56.959361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b9b85-b6ee-4815-bd2b-ef1d011b4079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:56.959669 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b9b85-b6ee-4815-bd2b-ef1d011b4079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:56.959976 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b9b85-b6ee-4815-bd2b-ef1d011b4079 admin admin] PATH_INFO: `/v3/users/4ae51807cd6e4f358d59b6cdae678e57` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:56.961262 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b9b85-b6ee-4815-bd2b-ef1d011b4079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ae51807cd6e4f358d59b6cdae678e57)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:56.963379 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b9b85-b6ee-4815-bd2b-ef1d011b4079 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:57.014730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-284b9b85-b6ee-4815-bd2b-ef1d011b4079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ae51807cd6e4f358d59b6cdae678e57'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:57.022766 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-284b9b85-b6ee-4815-bd2b-ef1d011b4079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ae51807cd6e4f358d59b6cdae678e57'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:57.035709 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-284b9b85-b6ee-4815-bd2b-ef1d011b4079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ae51807cd6e4f358d59b6cdae678e57'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:57.043472 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-284b9b85-b6ee-4815-bd2b-ef1d011b4079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ae51807cd6e4f358d59b6cdae678e57'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:57.044636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-284b9b85-b6ee-4815-bd2b-ef1d011b4079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ae51807cd6e4f358d59b6cdae678e57'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:57.050820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1114/2229] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:26:56 2022] DELETE /identity/v3/users/4ae51807cd6e4f358d59b6cdae678e57 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:57.055447 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bf72d-2e24-48f9-80e8-4db312ec6b70 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:57.055938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bf72d-2e24-48f9-80e8-4db312ec6b70 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:57.056062 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bf72d-2e24-48f9-80e8-4db312ec6b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:57.075028 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8c2bf72d-2e24-48f9-80e8-4db312ec6b70 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:26:57.076235 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8c2bf72d-2e24-48f9-80e8-4db312ec6b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:57.140129 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1116/2230] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:26:57.149841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b9b85-b6ee-4815-bd2b-ef1d011b4079 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:57.151259 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-284b9b85-b6ee-4815-bd2b-ef1d011b4079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:57.173641 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:57.218069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b9b85-b6ee-4815-bd2b-ef1d011b4079 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:57.222906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044f137-3279-42fd-8f7b-26204191bccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:57.223561 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044f137-3279-42fd-8f7b-26204191bccd service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:57.223846 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044f137-3279-42fd-8f7b-26204191bccd service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:57.224151 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044f137-3279-42fd-8f7b-26204191bccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:57.237653 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044f137-3279-42fd-8f7b-26204191bccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:57.240110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044f137-3279-42fd-8f7b-26204191bccd service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:57.251941 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1115/2231] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:26:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:26:57.627345 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bf72d-2e24-48f9-80e8-4db312ec6b70 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:57.628835 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8c2bf72d-2e24-48f9-80e8-4db312ec6b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:57.647122 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bf72d-2e24-48f9-80e8-4db312ec6b70 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:57.652752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac94f6-02bd-4c86-9989-63a336dc8ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:57.654209 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac94f6-02bd-4c86-9989-63a336dc8ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:57.654582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac94f6-02bd-4c86-9989-63a336dc8ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:57.654861 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac94f6-02bd-4c86-9989-63a336dc8ce9 admin admin] PATH_INFO: `/v3/projects/d7bc3053528247379cd1a2529ba63cf5` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:57.656084 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac94f6-02bd-4c86-9989-63a336dc8ce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7bc3053528247379cd1a2529ba63cf5)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:57.658371 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac94f6-02bd-4c86-9989-63a336dc8ce9 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:57.712763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:26:57.728531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-82ac94f6-02bd-4c86-9989-63a336dc8ce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7bc3053528247379cd1a2529ba63cf5', 'request_id': 'req-82ac94f6-02bd-4c86-9989-63a336dc8ce9'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:57.736643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-82ac94f6-02bd-4c86-9989-63a336dc8ce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7bc3053528247379cd1a2529ba63cf5', 'request_id': 'req-82ac94f6-02bd-4c86-9989-63a336dc8ce9'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:57.743419 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-82ac94f6-02bd-4c86-9989-63a336dc8ce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7bc3053528247379cd1a2529ba63cf5', 'request_id': 'req-82ac94f6-02bd-4c86-9989-63a336dc8ce9'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:57.756470 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-82ac94f6-02bd-4c86-9989-63a336dc8ce9 admin admin] The token cache is being invalidate because project d7bc3053528247379cd1a2529ba63cf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:57.756762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-82ac94f6-02bd-4c86-9989-63a336dc8ce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:57.757532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-82ac94f6-02bd-4c86-9989-63a336dc8ce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:57.759412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1117/2232] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:57 2022] DELETE /identity/v3/projects/d7bc3053528247379cd1a2529ba63cf5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:57.763844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044f137-3279-42fd-8f7b-26204191bccd service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:57.774375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044f137-3279-42fd-8f7b-26204191bccd service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:57.834493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e2544-a410-446a-93cd-15881150c982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:57.835424 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e2544-a410-446a-93cd-15881150c982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:57.835644 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e2544-a410-446a-93cd-15881150c982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:57.836108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e2544-a410-446a-93cd-15881150c982 admin admin] PATH_INFO: `/v3/users/5e3db0454bc541e9b60d3022a198466b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:57.837391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e2544-a410-446a-93cd-15881150c982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e3db0454bc541e9b60d3022a198466b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:57.839345 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e2544-a410-446a-93cd-15881150c982 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:57.894794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e61e2544-a410-446a-93cd-15881150c982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e3db0454bc541e9b60d3022a198466b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:57.903139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e61e2544-a410-446a-93cd-15881150c982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e3db0454bc541e9b60d3022a198466b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:57.924947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e61e2544-a410-446a-93cd-15881150c982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e3db0454bc541e9b60d3022a198466b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:57.940369 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e61e2544-a410-446a-93cd-15881150c982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e3db0454bc541e9b60d3022a198466b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:57.941214 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e61e2544-a410-446a-93cd-15881150c982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e3db0454bc541e9b60d3022a198466b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:57.948881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1116/2233] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:26:57 2022] DELETE /identity/v3/users/5e3db0454bc541e9b60d3022a198466b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:26:58.227295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac94f6-02bd-4c86-9989-63a336dc8ce9 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:26:58.228742 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-82ac94f6-02bd-4c86-9989-63a336dc8ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:26:58.248853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac94f6-02bd-4c86-9989-63a336dc8ce9 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:26:58.318896 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cef375-f9b7-43e1-adee-19975e0d5ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:26:58.319762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cef375-f9b7-43e1-adee-19975e0d5ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:26:58.320043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cef375-f9b7-43e1-adee-19975e0d5ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:26:58.320316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cef375-f9b7-43e1-adee-19975e0d5ad0 admin admin] PATH_INFO: `/v3/projects/1e8f33ec9fe541359445a6d82e742318` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:26:58.321494 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cef375-f9b7-43e1-adee-19975e0d5ad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e8f33ec9fe541359445a6d82e742318)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:26:58.323457 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cef375-f9b7-43e1-adee-19975e0d5ad0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:26:58.369013 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-20cef375-f9b7-43e1-adee-19975e0d5ad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e8f33ec9fe541359445a6d82e742318', 'request_id': 'req-20cef375-f9b7-43e1-adee-19975e0d5ad0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:58.375968 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-20cef375-f9b7-43e1-adee-19975e0d5ad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e8f33ec9fe541359445a6d82e742318', 'request_id': 'req-20cef375-f9b7-43e1-adee-19975e0d5ad0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:58.381838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-20cef375-f9b7-43e1-adee-19975e0d5ad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e8f33ec9fe541359445a6d82e742318', 'request_id': 'req-20cef375-f9b7-43e1-adee-19975e0d5ad0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:58.394751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-20cef375-f9b7-43e1-adee-19975e0d5ad0 admin admin] The token cache is being invalidate because project 1e8f33ec9fe541359445a6d82e742318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:26:58.395041 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-20cef375-f9b7-43e1-adee-19975e0d5ad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:58.395659 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-20cef375-f9b7-43e1-adee-19975e0d5ad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:26:58.397202 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1118/2234] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:26:58 2022] DELETE /identity/v3/projects/1e8f33ec9fe541359445a6d82e742318 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:27:00.367124 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fc165-799e-4518-a365-5bc71d8a413e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:00.367768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fc165-799e-4518-a365-5bc71d8a413e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:00.367768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fc165-799e-4518-a365-5bc71d8a413e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:00.387216 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9e3fc165-799e-4518-a365-5bc71d8a413e None None] MFA Rules not processed for user `551a91b131bc4a16a40b865a0a3fb50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:00.389145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9e3fc165-799e-4518-a365-5bc71d8a413e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:00.428384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:00.448344 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1117/2235] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:27:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:00.735347 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671ac0b-2a35-4afa-88af-6c94e8a73468 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:00.736234 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671ac0b-2a35-4afa-88af-6c94e8a73468 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:00.736689 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671ac0b-2a35-4afa-88af-6c94e8a73468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:00.755971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5671ac0b-2a35-4afa-88af-6c94e8a73468 None None] MFA Rules not processed for user `e78792e617d84a7cbb384ed764c391fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:00.758656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5671ac0b-2a35-4afa-88af-6c94e8a73468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:00.813453 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:00.826143 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1119/2236] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 20 19:27:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:00.878615 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fc165-799e-4518-a365-5bc71d8a413e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:00.880691 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9e3fc165-799e-4518-a365-5bc71d8a413e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:00.962181 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fc165-799e-4518-a365-5bc71d8a413e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:00.968650 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35721d71-5954-4583-8dc4-d736a80ebe0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebd7c59f0014a3886fa75fb35a40e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:00.969374 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35721d71-5954-4583-8dc4-d736a80ebe0e service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:00.969732 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35721d71-5954-4583-8dc4-d736a80ebe0e service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:00.970143 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35721d71-5954-4583-8dc4-d736a80ebe0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:00.978812 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35721d71-5954-4583-8dc4-d736a80ebe0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:00.980407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35721d71-5954-4583-8dc4-d736a80ebe0e service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:00.989699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1118/2237] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 20 19:27:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:27:10.823436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:10.986163 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=38 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:19.011983 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9846b4-b007-4179-bd3c-9a01e45bbb34 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:19.012553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9846b4-b007-4179-bd3c-9a01e45bbb34 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:19.012553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9846b4-b007-4179-bd3c-9a01e45bbb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:19.030507 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5c9846b4-b007-4179-bd3c-9a01e45bbb34 None None] MFA Rules not processed for user `e78792e617d84a7cbb384ed764c391fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:19.031727 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5c9846b4-b007-4179-bd3c-9a01e45bbb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:19.038836 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1120/2238] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jul 20 19:27:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:19.052525 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35721d71-5954-4583-8dc4-d736a80ebe0e service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:19.063613 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35721d71-5954-4583-8dc4-d736a80ebe0e service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:19.068715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8a1a3-3d3c-438d-9645-e04b590d826b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebd7c59f0014a3886fa75fb35a40e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:19.069349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8a1a3-3d3c-438d-9645-e04b590d826b service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:19.069671 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8a1a3-3d3c-438d-9645-e04b590d826b service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:19.069962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8a1a3-3d3c-438d-9645-e04b590d826b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:19.078318 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8a1a3-3d3c-438d-9645-e04b590d826b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:19.080058 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8a1a3-3d3c-438d-9645-e04b590d826b service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:19.088645 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1119/2239] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 20 19:27:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:27:19.219049 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581545f2-0313-4309-b01c-8d7aca72812b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:19.219283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581545f2-0313-4309-b01c-8d7aca72812b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:19.219638 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581545f2-0313-4309-b01c-8d7aca72812b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:19.239214 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-581545f2-0313-4309-b01c-8d7aca72812b None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:19.240420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-581545f2-0313-4309-b01c-8d7aca72812b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:19.302536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1121/2240] 10.222.0.88 () {58 vars in 1016 bytes} [Wed Jul 20 19:27:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:19.327813 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8a1a3-3d3c-438d-9645-e04b590d826b service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:19.329190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d2b8a1a3-3d3c-438d-9645-e04b590d826b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:19.405973 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8a1a3-3d3c-438d-9645-e04b590d826b service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:19.411760 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aec24b-0b0c-4c31-8127-a66aa34ba28c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:19.412409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aec24b-0b0c-4c31-8127-a66aa34ba28c service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:19.412685 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aec24b-0b0c-4c31-8127-a66aa34ba28c service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:19.412959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aec24b-0b0c-4c31-8127-a66aa34ba28c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:19.423423 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aec24b-0b0c-4c31-8127-a66aa34ba28c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:19.424982 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aec24b-0b0c-4c31-8127-a66aa34ba28c service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:19.436024 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1120/2241] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:21.030912 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581545f2-0313-4309-b01c-8d7aca72812b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:21.032509 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-581545f2-0313-4309-b01c-8d7aca72812b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:21.050008 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581545f2-0313-4309-b01c-8d7aca72812b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:21.054733 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d547b9-48ab-4a3b-92a2-98fe68c66744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:21.055607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d547b9-48ab-4a3b-92a2-98fe68c66744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:21.055904 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d547b9-48ab-4a3b-92a2-98fe68c66744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:21.056201 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d547b9-48ab-4a3b-92a2-98fe68c66744 admin admin] PATH_INFO: `/v3/users/5a97146a30df493182867c7609fe633f` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:21.057416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d547b9-48ab-4a3b-92a2-98fe68c66744 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a97146a30df493182867c7609fe633f)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:21.059419 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d547b9-48ab-4a3b-92a2-98fe68c66744 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:21.106364 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-02d547b9-48ab-4a3b-92a2-98fe68c66744 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a97146a30df493182867c7609fe633f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:27:21.113562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-02d547b9-48ab-4a3b-92a2-98fe68c66744 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a97146a30df493182867c7609fe633f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:27:21.121499 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-02d547b9-48ab-4a3b-92a2-98fe68c66744 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a97146a30df493182867c7609fe633f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:27:21.122145 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-02d547b9-48ab-4a3b-92a2-98fe68c66744 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a97146a30df493182867c7609fe633f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:27:21.122782 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-02d547b9-48ab-4a3b-92a2-98fe68c66744 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a97146a30df493182867c7609fe633f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:27:21.140872 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1122/2242] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:27:21 2022] DELETE /identity/v3/users/5a97146a30df493182867c7609fe633f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:27:21.329480 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aec24b-0b0c-4c31-8127-a66aa34ba28c service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:21.341045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aec24b-0b0c-4c31-8127-a66aa34ba28c service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:21.402000 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296c81b-753f-4f81-ab40-ec70a9e76e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:21.402823 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296c81b-753f-4f81-ab40-ec70a9e76e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:21.403110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296c81b-753f-4f81-ab40-ec70a9e76e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:21.403387 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296c81b-753f-4f81-ab40-ec70a9e76e48 admin admin] PATH_INFO: `/v3/projects/d4127c32555b42b7ad8da78276638c48` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:21.404590 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296c81b-753f-4f81-ab40-ec70a9e76e48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4127c32555b42b7ad8da78276638c48)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:21.406577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296c81b-753f-4f81-ab40-ec70a9e76e48 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:21.454891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f296c81b-753f-4f81-ab40-ec70a9e76e48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4127c32555b42b7ad8da78276638c48', 'request_id': 'req-f296c81b-753f-4f81-ab40-ec70a9e76e48'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:27:21.461063 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f296c81b-753f-4f81-ab40-ec70a9e76e48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4127c32555b42b7ad8da78276638c48', 'request_id': 'req-f296c81b-753f-4f81-ab40-ec70a9e76e48'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:27:21.476572 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f296c81b-753f-4f81-ab40-ec70a9e76e48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4127c32555b42b7ad8da78276638c48', 'request_id': 'req-f296c81b-753f-4f81-ab40-ec70a9e76e48'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:27:21.487544 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f296c81b-753f-4f81-ab40-ec70a9e76e48 admin admin] The token cache is being invalidate because project d4127c32555b42b7ad8da78276638c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:27:21.487833 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f296c81b-753f-4f81-ab40-ec70a9e76e48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:27:21.488457 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f296c81b-753f-4f81-ab40-ec70a9e76e48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:27:21.489998 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1121/2243] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:27:21 2022] DELETE /identity/v3/projects/d4127c32555b42b7ad8da78276638c48 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:27:21.495219 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c428c8-d254-4f68-b3ae-71516fee0def None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:21.495405 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c428c8-d254-4f68-b3ae-71516fee0def None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:21.495691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c428c8-d254-4f68-b3ae-71516fee0def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:21.514410 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-02c428c8-d254-4f68-b3ae-71516fee0def None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:21.515660 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-02c428c8-d254-4f68-b3ae-71516fee0def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:21.578192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1123/2244] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:21.585763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a77057-6d14-431e-9d8b-09f4f072d7a5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:21.586050 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a77057-6d14-431e-9d8b-09f4f072d7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:21.586350 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a77057-6d14-431e-9d8b-09f4f072d7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:21.593557 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:21.609496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b2a77057-6d14-431e-9d8b-09f4f072d7a5 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:21.610767 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b2a77057-6d14-431e-9d8b-09f4f072d7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:21.618837 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1122/2245] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:21.623592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c428c8-d254-4f68-b3ae-71516fee0def None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:21.633349 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c428c8-d254-4f68-b3ae-71516fee0def None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:21.637964 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f400f-5aa8-4f4b-9ed0-d6b1ffd96c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:21.638645 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f400f-5aa8-4f4b-9ed0-d6b1ffd96c79 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:21.638927 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f400f-5aa8-4f4b-9ed0-d6b1ffd96c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:21.639208 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f400f-5aa8-4f4b-9ed0-d6b1ffd96c79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:21.639980 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f400f-5aa8-4f4b-9ed0-d6b1ffd96c79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:27:21.640283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f400f-5aa8-4f4b-9ed0-d6b1ffd96c79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:21.641883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f400f-5aa8-4f4b-9ed0-d6b1ffd96c79 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:21.643444 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:21.655693 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1124/2246] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:27:21.659638 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a77057-6d14-431e-9d8b-09f4f072d7a5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:21.669731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a77057-6d14-431e-9d8b-09f4f072d7a5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:21.674586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acaf50a-1598-47a7-989b-57c33aec5c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:21.675231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaf50a-1598-47a7-989b-57c33aec5c49 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:21.675515 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaf50a-1598-47a7-989b-57c33aec5c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:21.675790 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaf50a-1598-47a7-989b-57c33aec5c49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:21.676491 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acaf50a-1598-47a7-989b-57c33aec5c49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:21.678523 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acaf50a-1598-47a7-989b-57c33aec5c49 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:21.705855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1123/2247] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:27:21 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:27:21.709924 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f400f-5aa8-4f4b-9ed0-d6b1ffd96c79 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:21.720395 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f400f-5aa8-4f4b-9ed0-d6b1ffd96c79 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:21.776538 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f65310-05f8-4fb2-af75-014089fc443b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:21.777213 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f65310-05f8-4fb2-af75-014089fc443b admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:21.778108 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f65310-05f8-4fb2-af75-014089fc443b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:21.778412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f65310-05f8-4fb2-af75-014089fc443b admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:21.779105 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f65310-05f8-4fb2-af75-014089fc443b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:21.781018 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f65310-05f8-4fb2-af75-014089fc443b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:21.801814 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1125/2248] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:27:21 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:27:21.806041 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acaf50a-1598-47a7-989b-57c33aec5c49 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:21.816714 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acaf50a-1598-47a7-989b-57c33aec5c49 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:21.822468 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b796b13-e787-4385-8c08-dd94b64f2e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:21.823127 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b796b13-e787-4385-8c08-dd94b64f2e44 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:21.823407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b796b13-e787-4385-8c08-dd94b64f2e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:21.823686 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b796b13-e787-4385-8c08-dd94b64f2e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:21.824931 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b796b13-e787-4385-8c08-dd94b64f2e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:21.826578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b796b13-e787-4385-8c08-dd94b64f2e44 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:21.840936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1124/2249] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:27:21.844756 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f65310-05f8-4fb2-af75-014089fc443b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:21.855100 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f65310-05f8-4fb2-af75-014089fc443b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:21.859890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a38a6-79b4-49f6-89b7-4355b15d4569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:21.860542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a38a6-79b4-49f6-89b7-4355b15d4569 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:21.860831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a38a6-79b4-49f6-89b7-4355b15d4569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:21.861115 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a38a6-79b4-49f6-89b7-4355b15d4569 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:21.861848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a38a6-79b4-49f6-89b7-4355b15d4569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:21.863493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a38a6-79b4-49f6-89b7-4355b15d4569 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:21.874848 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1126/2250] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:27:21.878984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b796b13-e787-4385-8c08-dd94b64f2e44 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:21.890038 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b796b13-e787-4385-8c08-dd94b64f2e44 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:21.894862 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07221087-f012-493d-8504-2882e9e814ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:21.895746 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07221087-f012-493d-8504-2882e9e814ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:21.896034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07221087-f012-493d-8504-2882e9e814ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:21.896335 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07221087-f012-493d-8504-2882e9e814ee admin admin] PATH_INFO: `/v3/projects/c0def32a2fa04345ac599799591bf479/users/a722e800e7b148f9993aca6c6c29d3ed/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:21.911694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07221087-f012-493d-8504-2882e9e814ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0def32a2fa04345ac599799591bf479, user_id=a722e800e7b148f9993aca6c6c29d3ed, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:21.914361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07221087-f012-493d-8504-2882e9e814ee admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:21.927602 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1125/2251] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:27:21 2022] PUT /identity/v3/projects/c0def32a2fa04345ac599799591bf479/users/a722e800e7b148f9993aca6c6c29d3ed/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:27:21.938654 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3de9f9-b240-4a13-8867-856bc4d22680 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:21.938948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3de9f9-b240-4a13-8867-856bc4d22680 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:21.939233 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3de9f9-b240-4a13-8867-856bc4d22680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:21.965825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-be3de9f9-b240-4a13-8867-856bc4d22680 None None] MFA Rules not processed for user `a722e800e7b148f9993aca6c6c29d3ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:21.967074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-be3de9f9-b240-4a13-8867-856bc4d22680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:22.030993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1127/2252] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:27:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:22.042270 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07221087-f012-493d-8504-2882e9e814ee admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:22.045122 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-07221087-f012-493d-8504-2882e9e814ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:22.101790 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07221087-f012-493d-8504-2882e9e814ee admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:22.106088 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd781d3-ed2e-4a60-97c0-566eedc2737f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:22.106769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd781d3-ed2e-4a60-97c0-566eedc2737f service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:22.107052 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd781d3-ed2e-4a60-97c0-566eedc2737f service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:22.107327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd781d3-ed2e-4a60-97c0-566eedc2737f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:22.115538 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd781d3-ed2e-4a60-97c0-566eedc2737f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:22.116947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd781d3-ed2e-4a60-97c0-566eedc2737f service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:22.126487 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1126/2253] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:22 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:24.436227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778d86d-4c33-479c-929e-42daf5f615a9 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:24.436777 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778d86d-4c33-479c-929e-42daf5f615a9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:24.436777 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778d86d-4c33-479c-929e-42daf5f615a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:24.455271 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1778d86d-4c33-479c-929e-42daf5f615a9 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:24.456480 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1778d86d-4c33-479c-929e-42daf5f615a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:24.516096 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1128/2254] 10.222.0.88 () {58 vars in 1016 bytes} [Wed Jul 20 19:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:27:24.537537 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd781d3-ed2e-4a60-97c0-566eedc2737f service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:24.539118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7dd781d3-ed2e-4a60-97c0-566eedc2737f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:24.620289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd781d3-ed2e-4a60-97c0-566eedc2737f service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:24.626698 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85500e-d914-4a58-a645-d1b6099f592e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:24.627355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85500e-d914-4a58-a645-d1b6099f592e service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:24.627642 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85500e-d914-4a58-a645-d1b6099f592e service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:24.627921 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85500e-d914-4a58-a645-d1b6099f592e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:24.636893 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85500e-d914-4a58-a645-d1b6099f592e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:24.638507 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85500e-d914-4a58-a645-d1b6099f592e service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:24.648041 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1127/2255] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:28.575616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6867a9-5b42-4183-856d-1cf46d7b1b41 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:28.576173 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6867a9-5b42-4183-856d-1cf46d7b1b41 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:28.576173 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6867a9-5b42-4183-856d-1cf46d7b1b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:28.582723 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:28.597135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-fb6867a9-5b42-4183-856d-1cf46d7b1b41 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:28.598485 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-fb6867a9-5b42-4183-856d-1cf46d7b1b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:28.607889 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1129/2256] 10.222.0.88 () {58 vars in 1016 bytes} [Wed Jul 20 19:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:28.630005 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85500e-d914-4a58-a645-d1b6099f592e service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:28.631541 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9b85500e-d914-4a58-a645-d1b6099f592e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:28.646653 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85500e-d914-4a58-a645-d1b6099f592e service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:28.652212 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea0def-4a09-4f4d-9890-b22941320d56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:28.652881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea0def-4a09-4f4d-9890-b22941320d56 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:28.653165 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea0def-4a09-4f4d-9890-b22941320d56 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:28.653443 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea0def-4a09-4f4d-9890-b22941320d56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:28.662149 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea0def-4a09-4f4d-9890-b22941320d56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:28.663815 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea0def-4a09-4f4d-9890-b22941320d56 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:28.674796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1128/2257] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:32.613316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ce0eb-9e63-412d-a88e-432d3c13a9de None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:32.613860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ce0eb-9e63-412d-a88e-432d3c13a9de None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:32.613860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ce0eb-9e63-412d-a88e-432d3c13a9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:32.632208 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-af5ce0eb-9e63-412d-a88e-432d3c13a9de None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:32.633444 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-af5ce0eb-9e63-412d-a88e-432d3c13a9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:32.641821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1130/2258] 10.222.0.88 () {58 vars in 1016 bytes} [Wed Jul 20 19:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:32.663174 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea0def-4a09-4f4d-9890-b22941320d56 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:32.675272 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea0def-4a09-4f4d-9890-b22941320d56 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:32.681241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ab7b5-7b30-4274-8325-6c59557c0a1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:32.681885 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ab7b5-7b30-4274-8325-6c59557c0a1a service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:32.682168 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ab7b5-7b30-4274-8325-6c59557c0a1a service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:32.682512 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ab7b5-7b30-4274-8325-6c59557c0a1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:32.691419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ab7b5-7b30-4274-8325-6c59557c0a1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:32.693188 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ab7b5-7b30-4274-8325-6c59557c0a1a service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:32.698403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:32.703999 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1129/2259] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:37.803575 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9fb91-6f36-4001-9d84-9d292c9e20f2 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:37.804225 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9fb91-6f36-4001-9d84-9d292c9e20f2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:37.804225 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9fb91-6f36-4001-9d84-9d292c9e20f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:37.825056 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a3e9fb91-6f36-4001-9d84-9d292c9e20f2 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:37.826779 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a3e9fb91-6f36-4001-9d84-9d292c9e20f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:37.837514 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1131/2260] 10.222.0.88 () {58 vars in 1016 bytes} [Wed Jul 20 19:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:27:37.869182 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ab7b5-7b30-4274-8325-6c59557c0a1a service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:37.880911 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ab7b5-7b30-4274-8325-6c59557c0a1a service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:37.887723 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a8686-a640-4a96-9a39-61b99ec60d2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:37.888373 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a8686-a640-4a96-9a39-61b99ec60d2e service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:37.888651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a8686-a640-4a96-9a39-61b99ec60d2e service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:37.888921 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a8686-a640-4a96-9a39-61b99ec60d2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:37.897633 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a8686-a640-4a96-9a39-61b99ec60d2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:37.899225 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a8686-a640-4a96-9a39-61b99ec60d2e service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:37.909995 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1130/2261] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:43.012566 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff702a7f-56ca-4bd4-9431-152c240af8b3 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:43.013107 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff702a7f-56ca-4bd4-9431-152c240af8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:43.013212 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff702a7f-56ca-4bd4-9431-152c240af8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:43.030736 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ff702a7f-56ca-4bd4-9431-152c240af8b3 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:27:43.031955 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ff702a7f-56ca-4bd4-9431-152c240af8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:43.040356 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1132/2262] 10.222.0.88 () {58 vars in 1016 bytes} [Wed Jul 20 19:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:27:43.068410 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a8686-a640-4a96-9a39-61b99ec60d2e service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:43.080413 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a8686-a640-4a96-9a39-61b99ec60d2e service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:43.085968 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a12667-d947-438c-b6a0-e51ddef32844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:43.086633 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a12667-d947-438c-b6a0-e51ddef32844 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:43.086922 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a12667-d947-438c-b6a0-e51ddef32844 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:43.087202 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a12667-d947-438c-b6a0-e51ddef32844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:43.095373 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a12667-d947-438c-b6a0-e51ddef32844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:43.096964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a12667-d947-438c-b6a0-e51ddef32844 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:43.107693 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1131/2263] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:27:53.026186 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=11 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:53.102653 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=12 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:27:58.670819 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff702a7f-56ca-4bd4-9431-152c240af8b3 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:27:58.672215 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ff702a7f-56ca-4bd4-9431-152c240af8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:58.743728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff702a7f-56ca-4bd4-9431-152c240af8b3 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:27:58.748738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044be38-af66-4bb3-a259-a910c24990c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd310799ac43e42bc9c7810e1296ddb9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:27:58.749440 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044be38-af66-4bb3-a259-a910c24990c0 service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:27:58.749748 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044be38-af66-4bb3-a259-a910c24990c0 service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:27:58.750002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044be38-af66-4bb3-a259-a910c24990c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:27:58.751907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c044be38-af66-4bb3-a259-a910c24990c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:27:58.764373 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044be38-af66-4bb3-a259-a910c24990c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:27:58.765946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044be38-af66-4bb3-a259-a910c24990c0 service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:27:58.776158 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1133/2264] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:27:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:02.341379 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a12667-d947-438c-b6a0-e51ddef32844 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:02.351641 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a12667-d947-438c-b6a0-e51ddef32844 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:02.357100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c4cae-6023-4fa7-bddd-114845b85d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:02.358040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c4cae-6023-4fa7-bddd-114845b85d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:02.358387 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c4cae-6023-4fa7-bddd-114845b85d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:02.358694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c4cae-6023-4fa7-bddd-114845b85d0c admin admin] PATH_INFO: `/v3/users/a722e800e7b148f9993aca6c6c29d3ed` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:02.359934 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c4cae-6023-4fa7-bddd-114845b85d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a722e800e7b148f9993aca6c6c29d3ed)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:02.361878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c4cae-6023-4fa7-bddd-114845b85d0c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:02.410752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3d7c4cae-6023-4fa7-bddd-114845b85d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a722e800e7b148f9993aca6c6c29d3ed'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:28:02.418874 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3d7c4cae-6023-4fa7-bddd-114845b85d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a722e800e7b148f9993aca6c6c29d3ed'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:28:02.431019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3d7c4cae-6023-4fa7-bddd-114845b85d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a722e800e7b148f9993aca6c6c29d3ed'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:28:02.440486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3d7c4cae-6023-4fa7-bddd-114845b85d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a722e800e7b148f9993aca6c6c29d3ed'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:28:02.441409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3d7c4cae-6023-4fa7-bddd-114845b85d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a722e800e7b148f9993aca6c6c29d3ed'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:28:02.449041 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1132/2265] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:28:02 2022] DELETE /identity/v3/users/a722e800e7b148f9993aca6c6c29d3ed => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:28:02.454727 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbb2a8-fb5b-430b-a93c-6cf081af3834 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:02.455193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbb2a8-fb5b-430b-a93c-6cf081af3834 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:02.455436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbb2a8-fb5b-430b-a93c-6cf081af3834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:02.473252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ebbbb2a8-fb5b-430b-a93c-6cf081af3834 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:02.474487 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ebbbb2a8-fb5b-430b-a93c-6cf081af3834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:02.534371 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1134/2266] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:02.545078 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c4cae-6023-4fa7-bddd-114845b85d0c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:02.546600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3d7c4cae-6023-4fa7-bddd-114845b85d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:02.612118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c4cae-6023-4fa7-bddd-114845b85d0c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:02.615789 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7985d-268e-428a-a3f9-dd194a646100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:02.616375 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7985d-268e-428a-a3f9-dd194a646100 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:02.616657 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7985d-268e-428a-a3f9-dd194a646100 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:02.616934 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7985d-268e-428a-a3f9-dd194a646100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:02.627042 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7985d-268e-428a-a3f9-dd194a646100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:02.628527 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7985d-268e-428a-a3f9-dd194a646100 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:02.640174 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1133/2267] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:02.952279 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbb2a8-fb5b-430b-a93c-6cf081af3834 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:02.953791 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ebbbb2a8-fb5b-430b-a93c-6cf081af3834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:02.967190 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbb2a8-fb5b-430b-a93c-6cf081af3834 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:02.972345 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0af87f-7a16-47c8-bfdd-f4b9a2adc040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:02.973352 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0af87f-7a16-47c8-bfdd-f4b9a2adc040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:02.973634 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0af87f-7a16-47c8-bfdd-f4b9a2adc040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:02.974076 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0af87f-7a16-47c8-bfdd-f4b9a2adc040 admin admin] PATH_INFO: `/v3/projects/c0def32a2fa04345ac599799591bf479` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:02.975810 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0af87f-7a16-47c8-bfdd-f4b9a2adc040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0def32a2fa04345ac599799591bf479)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:02.977617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0af87f-7a16-47c8-bfdd-f4b9a2adc040 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:03.030958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8f0af87f-7a16-47c8-bfdd-f4b9a2adc040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0def32a2fa04345ac599799591bf479', 'request_id': 'req-8f0af87f-7a16-47c8-bfdd-f4b9a2adc040'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:28:03.046448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8f0af87f-7a16-47c8-bfdd-f4b9a2adc040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0def32a2fa04345ac599799591bf479', 'request_id': 'req-8f0af87f-7a16-47c8-bfdd-f4b9a2adc040'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:28:03.052491 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8f0af87f-7a16-47c8-bfdd-f4b9a2adc040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0def32a2fa04345ac599799591bf479', 'request_id': 'req-8f0af87f-7a16-47c8-bfdd-f4b9a2adc040'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:28:03.067462 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8f0af87f-7a16-47c8-bfdd-f4b9a2adc040 admin admin] The token cache is being invalidate because project c0def32a2fa04345ac599799591bf479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:28:03.067863 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8f0af87f-7a16-47c8-bfdd-f4b9a2adc040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:28:03.068591 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8f0af87f-7a16-47c8-bfdd-f4b9a2adc040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:28:03.070290 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1135/2268] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:28:02 2022] DELETE /identity/v3/projects/c0def32a2fa04345ac599799591bf479 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:28:03.075954 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad3aba-c2ac-434f-9812-e413be59d0fe None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:03.076744 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad3aba-c2ac-434f-9812-e413be59d0fe None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:03.077233 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad3aba-c2ac-434f-9812-e413be59d0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:03.105450 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-20ad3aba-c2ac-434f-9812-e413be59d0fe None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:03.106846 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-20ad3aba-c2ac-434f-9812-e413be59d0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:03.175352 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1134/2269] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:03.183708 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e5c48-f965-47e3-9c62-78a36641164c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:03.184082 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e5c48-f965-47e3-9c62-78a36641164c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:03.184451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e5c48-f965-47e3-9c62-78a36641164c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:03.203767 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a51e5c48-f965-47e3-9c62-78a36641164c None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:03.204992 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a51e5c48-f965-47e3-9c62-78a36641164c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:03.213541 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1136/2270] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:03.217660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad3aba-c2ac-434f-9812-e413be59d0fe None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:03.233976 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad3aba-c2ac-434f-9812-e413be59d0fe None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:03.238918 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31de7e-c01e-4b84-8590-0a6e7b161c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:03.239649 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31de7e-c01e-4b84-8590-0a6e7b161c17 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:03.240004 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31de7e-c01e-4b84-8590-0a6e7b161c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:03.240351 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31de7e-c01e-4b84-8590-0a6e7b161c17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:03.241159 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31de7e-c01e-4b84-8590-0a6e7b161c17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:28:03.241500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31de7e-c01e-4b84-8590-0a6e7b161c17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:03.243116 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31de7e-c01e-4b84-8590-0a6e7b161c17 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:03.256215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1135/2271] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:28:03.261237 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e5c48-f965-47e3-9c62-78a36641164c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:03.270468 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e5c48-f965-47e3-9c62-78a36641164c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:03.275285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e673a8f-9004-4103-bcf9-0131d1c8e631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:03.276868 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e673a8f-9004-4103-bcf9-0131d1c8e631 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:03.276868 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e673a8f-9004-4103-bcf9-0131d1c8e631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:03.276868 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e673a8f-9004-4103-bcf9-0131d1c8e631 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:03.277188 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e673a8f-9004-4103-bcf9-0131d1c8e631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:03.279083 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e673a8f-9004-4103-bcf9-0131d1c8e631 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:03.283768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:03.309665 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1137/2272] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:28:03 2022] POST /identity/v3/projects => generated 397 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:28:03.313871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31de7e-c01e-4b84-8590-0a6e7b161c17 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:03.319041 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:03.327151 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31de7e-c01e-4b84-8590-0a6e7b161c17 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:03.388682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f076e9b-7dc3-4379-8a9f-c91d9b838db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:03.389639 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f076e9b-7dc3-4379-8a9f-c91d9b838db3 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:03.389932 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f076e9b-7dc3-4379-8a9f-c91d9b838db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:03.390237 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f076e9b-7dc3-4379-8a9f-c91d9b838db3 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:03.391040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f076e9b-7dc3-4379-8a9f-c91d9b838db3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:03.393599 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f076e9b-7dc3-4379-8a9f-c91d9b838db3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:03.417644 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1136/2273] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:28:03 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:28:03.421750 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e673a8f-9004-4103-bcf9-0131d1c8e631 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:03.433373 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e673a8f-9004-4103-bcf9-0131d1c8e631 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:03.439555 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74327b-78b8-43d1-b8c8-f122289d9c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:03.440228 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74327b-78b8-43d1-b8c8-f122289d9c22 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:03.440515 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74327b-78b8-43d1-b8c8-f122289d9c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:03.440795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74327b-78b8-43d1-b8c8-f122289d9c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:03.441524 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74327b-78b8-43d1-b8c8-f122289d9c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:03.443239 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74327b-78b8-43d1-b8c8-f122289d9c22 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:03.454625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1138/2274] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:28:03.458752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f076e9b-7dc3-4379-8a9f-c91d9b838db3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:03.469319 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f076e9b-7dc3-4379-8a9f-c91d9b838db3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:03.474156 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d7296-e2f6-4d50-9520-a62ce93f52df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:03.474886 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d7296-e2f6-4d50-9520-a62ce93f52df admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:03.475173 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d7296-e2f6-4d50-9520-a62ce93f52df admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:03.475479 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d7296-e2f6-4d50-9520-a62ce93f52df admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:03.476331 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d7296-e2f6-4d50-9520-a62ce93f52df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:03.477902 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d7296-e2f6-4d50-9520-a62ce93f52df admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:03.489660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1137/2275] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:28:03.492955 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74327b-78b8-43d1-b8c8-f122289d9c22 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:03.502856 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74327b-78b8-43d1-b8c8-f122289d9c22 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:03.507453 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a2376-d26f-44ed-b383-1f5b78a0fa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:03.508323 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a2376-d26f-44ed-b383-1f5b78a0fa1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:03.508597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a2376-d26f-44ed-b383-1f5b78a0fa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:03.508873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a2376-d26f-44ed-b383-1f5b78a0fa1a admin admin] PATH_INFO: `/v3/projects/3cf762d34f1d44edaf191546f416cd97/users/53542cbc6d8f488f90a94b399fe80b65/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:03.523036 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a2376-d26f-44ed-b383-1f5b78a0fa1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf762d34f1d44edaf191546f416cd97, user_id=53542cbc6d8f488f90a94b399fe80b65, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:03.526143 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a2376-d26f-44ed-b383-1f5b78a0fa1a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:03.539428 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1139/2276] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:28:03 2022] PUT /identity/v3/projects/3cf762d34f1d44edaf191546f416cd97/users/53542cbc6d8f488f90a94b399fe80b65/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:28:03.552330 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb8ed7-5660-454e-8133-cd19a4eff5b0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:03.552621 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb8ed7-5660-454e-8133-cd19a4eff5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:03.552899 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb8ed7-5660-454e-8133-cd19a4eff5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:03.579368 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4acb8ed7-5660-454e-8133-cd19a4eff5b0 None None] MFA Rules not processed for user `53542cbc6d8f488f90a94b399fe80b65`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:03.580568 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4acb8ed7-5660-454e-8133-cd19a4eff5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:03.644341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1138/2277] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:28:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:03.656711 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a2376-d26f-44ed-b383-1f5b78a0fa1a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:03.658446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-968a2376-d26f-44ed-b383-1f5b78a0fa1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:03.715261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a2376-d26f-44ed-b383-1f5b78a0fa1a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:03.718839 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e122f2-2213-4444-b08c-92498c48f64b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:03.719472 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e122f2-2213-4444-b08c-92498c48f64b service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:03.719753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e122f2-2213-4444-b08c-92498c48f64b service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:03.720028 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e122f2-2213-4444-b08c-92498c48f64b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:03.728350 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e122f2-2213-4444-b08c-92498c48f64b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:03.729762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e122f2-2213-4444-b08c-92498c48f64b service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:03.738456 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1140/2278] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:03.872571 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d150f-3a94-4641-83d4-d88633caaf02 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:03.872861 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d150f-3a94-4641-83d4-d88633caaf02 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:03.873135 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d150f-3a94-4641-83d4-d88633caaf02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:03.891075 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bc9d150f-3a94-4641-83d4-d88633caaf02 None None] MFA Rules not processed for user `b9daf80901df487a99d83f84a303995d`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:03.892267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bc9d150f-3a94-4641-83d4-d88633caaf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:03.948995 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1139/2279] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:28:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:08.718250 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e122f2-2213-4444-b08c-92498c48f64b service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:08.784013 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e122f2-2213-4444-b08c-92498c48f64b service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:08.788792 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c13fef-2954-4ae0-bda0-c66dafd5c0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:08.789626 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c13fef-2954-4ae0-bda0-c66dafd5c0b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:08.789913 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c13fef-2954-4ae0-bda0-c66dafd5c0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:08.790576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c13fef-2954-4ae0-bda0-c66dafd5c0b5 admin admin] PATH_INFO: `/v3/users/53542cbc6d8f488f90a94b399fe80b65` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:08.791794 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c13fef-2954-4ae0-bda0-c66dafd5c0b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53542cbc6d8f488f90a94b399fe80b65)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:08.793725 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c13fef-2954-4ae0-bda0-c66dafd5c0b5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:08.842025 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-10c13fef-2954-4ae0-bda0-c66dafd5c0b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53542cbc6d8f488f90a94b399fe80b65'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:28:08.847628 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:08.849728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-10c13fef-2954-4ae0-bda0-c66dafd5c0b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53542cbc6d8f488f90a94b399fe80b65'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:28:08.860090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-10c13fef-2954-4ae0-bda0-c66dafd5c0b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53542cbc6d8f488f90a94b399fe80b65'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:28:08.861149 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-10c13fef-2954-4ae0-bda0-c66dafd5c0b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53542cbc6d8f488f90a94b399fe80b65'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:28:08.861798 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-10c13fef-2954-4ae0-bda0-c66dafd5c0b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53542cbc6d8f488f90a94b399fe80b65'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:28:08.879911 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1141/2280] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:28:08 2022] DELETE /identity/v3/users/53542cbc6d8f488f90a94b399fe80b65 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:28:08.884611 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62bb34-226c-46a7-b803-c5ff6ca788e7 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:08.885165 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62bb34-226c-46a7-b803-c5ff6ca788e7 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:08.885279 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62bb34-226c-46a7-b803-c5ff6ca788e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:08.902729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8b62bb34-226c-46a7-b803-c5ff6ca788e7 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:08.903954 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8b62bb34-226c-46a7-b803-c5ff6ca788e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:08.913137 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:08.966796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1140/2281] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:08.976535 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c13fef-2954-4ae0-bda0-c66dafd5c0b5 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:08.978702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-10c13fef-2954-4ae0-bda0-c66dafd5c0b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:09.036428 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c13fef-2954-4ae0-bda0-c66dafd5c0b5 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:09.041574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47476a-26c3-47d2-9aa9-9dac0bfc7199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:09.042232 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47476a-26c3-47d2-9aa9-9dac0bfc7199 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:09.042831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47476a-26c3-47d2-9aa9-9dac0bfc7199 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:09.042831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47476a-26c3-47d2-9aa9-9dac0bfc7199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:09.055656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47476a-26c3-47d2-9aa9-9dac0bfc7199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:09.058113 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47476a-26c3-47d2-9aa9-9dac0bfc7199 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:09.070650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1142/2282] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:09.572783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62bb34-226c-46a7-b803-c5ff6ca788e7 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:09.574538 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8b62bb34-226c-46a7-b803-c5ff6ca788e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:09.593500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62bb34-226c-46a7-b803-c5ff6ca788e7 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:09.599877 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793672c-d5b9-47d5-9ef7-ad99538bb80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:09.600705 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793672c-d5b9-47d5-9ef7-ad99538bb80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:09.601038 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793672c-d5b9-47d5-9ef7-ad99538bb80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:09.601421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793672c-d5b9-47d5-9ef7-ad99538bb80b admin admin] PATH_INFO: `/v3/projects/3cf762d34f1d44edaf191546f416cd97` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:09.603230 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793672c-d5b9-47d5-9ef7-ad99538bb80b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf762d34f1d44edaf191546f416cd97)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:09.605216 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793672c-d5b9-47d5-9ef7-ad99538bb80b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:09.653849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2793672c-d5b9-47d5-9ef7-ad99538bb80b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf762d34f1d44edaf191546f416cd97', 'request_id': 'req-2793672c-d5b9-47d5-9ef7-ad99538bb80b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:28:09.660317 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2793672c-d5b9-47d5-9ef7-ad99538bb80b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf762d34f1d44edaf191546f416cd97', 'request_id': 'req-2793672c-d5b9-47d5-9ef7-ad99538bb80b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:28:09.668343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2793672c-d5b9-47d5-9ef7-ad99538bb80b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf762d34f1d44edaf191546f416cd97', 'request_id': 'req-2793672c-d5b9-47d5-9ef7-ad99538bb80b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:28:09.678710 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2793672c-d5b9-47d5-9ef7-ad99538bb80b admin admin] The token cache is being invalidate because project 3cf762d34f1d44edaf191546f416cd97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:28:09.679001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2793672c-d5b9-47d5-9ef7-ad99538bb80b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:28:09.679628 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2793672c-d5b9-47d5-9ef7-ad99538bb80b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:28:09.681771 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1141/2283] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:28:09 2022] DELETE /identity/v3/projects/3cf762d34f1d44edaf191546f416cd97 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:28:09.686855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b83d12-4a19-4f93-90e4-3ba04a3fc624 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:09.687152 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b83d12-4a19-4f93-90e4-3ba04a3fc624 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:09.687437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b83d12-4a19-4f93-90e4-3ba04a3fc624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:09.705324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-47b83d12-4a19-4f93-90e4-3ba04a3fc624 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:09.706573 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-47b83d12-4a19-4f93-90e4-3ba04a3fc624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:09.765937 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1143/2284] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:28:09.773843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f402f01-47b9-4219-a39a-44e692829a47 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:09.774137 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f402f01-47b9-4219-a39a-44e692829a47 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:09.774454 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f402f01-47b9-4219-a39a-44e692829a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:09.793128 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-9f402f01-47b9-4219-a39a-44e692829a47 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:09.794372 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9f402f01-47b9-4219-a39a-44e692829a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:09.802258 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1142/2285] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:09.807025 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b83d12-4a19-4f93-90e4-3ba04a3fc624 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:09.816562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b83d12-4a19-4f93-90e4-3ba04a3fc624 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:09.821952 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa225fbe-8756-41fc-9e6b-4b33300154e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:09.822655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa225fbe-8756-41fc-9e6b-4b33300154e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:09.822967 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa225fbe-8756-41fc-9e6b-4b33300154e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:09.823260 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa225fbe-8756-41fc-9e6b-4b33300154e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:09.824001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa225fbe-8756-41fc-9e6b-4b33300154e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:28:09.824314 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa225fbe-8756-41fc-9e6b-4b33300154e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:09.825952 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa225fbe-8756-41fc-9e6b-4b33300154e5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:09.837625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1144/2286] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:28:09.841949 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f402f01-47b9-4219-a39a-44e692829a47 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:09.851203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f402f01-47b9-4219-a39a-44e692829a47 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:09.856470 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78914f8c-f8de-4d29-9b11-38b9bffe9cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:09.857113 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78914f8c-f8de-4d29-9b11-38b9bffe9cca admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:09.857402 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78914f8c-f8de-4d29-9b11-38b9bffe9cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:09.857685 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78914f8c-f8de-4d29-9b11-38b9bffe9cca admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:09.858417 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78914f8c-f8de-4d29-9b11-38b9bffe9cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:09.860331 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78914f8c-f8de-4d29-9b11-38b9bffe9cca admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:09.887471 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1143/2287] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:28:09 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:28:09.891674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa225fbe-8756-41fc-9e6b-4b33300154e5 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:09.902580 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa225fbe-8756-41fc-9e6b-4b33300154e5 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:09.958970 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada49d03-7f67-4e2c-b1e0-3c6ea4a65771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:09.959647 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada49d03-7f67-4e2c-b1e0-3c6ea4a65771 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:09.959932 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada49d03-7f67-4e2c-b1e0-3c6ea4a65771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:09.960214 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada49d03-7f67-4e2c-b1e0-3c6ea4a65771 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:09.960899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada49d03-7f67-4e2c-b1e0-3c6ea4a65771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:09.963391 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada49d03-7f67-4e2c-b1e0-3c6ea4a65771 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:09.970862 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:09.986109 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1145/2288] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:28:09 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:28:09.990193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78914f8c-f8de-4d29-9b11-38b9bffe9cca admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:10.000910 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78914f8c-f8de-4d29-9b11-38b9bffe9cca admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:10.005730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99096a-e78c-4201-b8f6-099b10e1c33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:10.006423 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99096a-e78c-4201-b8f6-099b10e1c33d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:10.006762 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99096a-e78c-4201-b8f6-099b10e1c33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:10.007095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99096a-e78c-4201-b8f6-099b10e1c33d admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:10.007822 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99096a-e78c-4201-b8f6-099b10e1c33d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:10.009533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99096a-e78c-4201-b8f6-099b10e1c33d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:10.019839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1144/2289] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:28:10.023764 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada49d03-7f67-4e2c-b1e0-3c6ea4a65771 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:10.034429 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada49d03-7f67-4e2c-b1e0-3c6ea4a65771 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:10.039058 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe5284-da3c-4469-9ef7-d19746ca0897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:10.039712 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe5284-da3c-4469-9ef7-d19746ca0897 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:10.040289 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe5284-da3c-4469-9ef7-d19746ca0897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:10.041109 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe5284-da3c-4469-9ef7-d19746ca0897 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:10.041869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe5284-da3c-4469-9ef7-d19746ca0897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:10.043598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe5284-da3c-4469-9ef7-d19746ca0897 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:10.054742 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1146/2290] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:28:10.058694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99096a-e78c-4201-b8f6-099b10e1c33d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:10.068615 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99096a-e78c-4201-b8f6-099b10e1c33d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:10.073296 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9acc71-09e7-4cc3-9b21-2731fdcbb0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:10.074172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9acc71-09e7-4cc3-9b21-2731fdcbb0a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:10.074499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9acc71-09e7-4cc3-9b21-2731fdcbb0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:10.074782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9acc71-09e7-4cc3-9b21-2731fdcbb0a6 admin admin] PATH_INFO: `/v3/projects/c9f93d1e6cc74a1aaa65a786ca163d9e/users/62ef5bec99e2415582fd9be9e5eec6eb/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:10.090389 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9acc71-09e7-4cc3-9b21-2731fdcbb0a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f93d1e6cc74a1aaa65a786ca163d9e, user_id=62ef5bec99e2415582fd9be9e5eec6eb, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:10.094603 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9acc71-09e7-4cc3-9b21-2731fdcbb0a6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:10.109391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1145/2291] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:28:10 2022] PUT /identity/v3/projects/c9f93d1e6cc74a1aaa65a786ca163d9e/users/62ef5bec99e2415582fd9be9e5eec6eb/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:28:10.114613 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa6ddf-89d2-4504-a097-e1b67a083a00 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:10.114907 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa6ddf-89d2-4504-a097-e1b67a083a00 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:10.115190 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa6ddf-89d2-4504-a097-e1b67a083a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:10.132193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a4aa6ddf-89d2-4504-a097-e1b67a083a00 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:10.133387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a4aa6ddf-89d2-4504-a097-e1b67a083a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:10.193049 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1147/2292] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:10.202570 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9acc71-09e7-4cc3-9b21-2731fdcbb0a6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:10.204277 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6c9acc71-09e7-4cc3-9b21-2731fdcbb0a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:10.244851 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:10.263089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9acc71-09e7-4cc3-9b21-2731fdcbb0a6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:10.266749 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9b584-b556-4a1c-9d84-1ca4e89d051c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:10.267388 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9b584-b556-4a1c-9d84-1ca4e89d051c service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:10.267674 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9b584-b556-4a1c-9d84-1ca4e89d051c service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:10.267951 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9b584-b556-4a1c-9d84-1ca4e89d051c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:10.277317 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9b584-b556-4a1c-9d84-1ca4e89d051c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:10.278919 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9b584-b556-4a1c-9d84-1ca4e89d051c service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:10.288186 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1146/2293] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:15.036727 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1943c-642e-4fb5-8478-9543fb5028d9 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:15.036727 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1943c-642e-4fb5-8478-9543fb5028d9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:15.036727 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1943c-642e-4fb5-8478-9543fb5028d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:15.067670 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-95f1943c-642e-4fb5-8478-9543fb5028d9 None None] MFA Rules not processed for user `62ef5bec99e2415582fd9be9e5eec6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:15.068897 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-95f1943c-642e-4fb5-8478-9543fb5028d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:15.157812 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1148/2294] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:28:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:15.162252 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9b584-b556-4a1c-9d84-1ca4e89d051c service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:15.178737 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9b584-b556-4a1c-9d84-1ca4e89d051c service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:15.187015 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45bce1-44bb-4ae5-b00b-476b8be2923f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:15.187312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45bce1-44bb-4ae5-b00b-476b8be2923f admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:15.187631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45bce1-44bb-4ae5-b00b-476b8be2923f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:15.187976 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45bce1-44bb-4ae5-b00b-476b8be2923f admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:15.189234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45bce1-44bb-4ae5-b00b-476b8be2923f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:15.190838 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f45bce1-44bb-4ae5-b00b-476b8be2923f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:15.223818 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1147/2295] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:28:15 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:28:15.225306 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1943c-642e-4fb5-8478-9543fb5028d9 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:15.239002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1943c-642e-4fb5-8478-9543fb5028d9 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:15.309392 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6069d4-ced2-4418-9ab1-102d106161c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:15.310078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6069d4-ced2-4418-9ab1-102d106161c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:15.310400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6069d4-ced2-4418-9ab1-102d106161c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:15.310683 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6069d4-ced2-4418-9ab1-102d106161c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:15.311403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6069d4-ced2-4418-9ab1-102d106161c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:15.313869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6069d4-ced2-4418-9ab1-102d106161c0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:15.329719 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:15.338400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1149/2296] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:28:15 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:28:15.339615 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45bce1-44bb-4ae5-b00b-476b8be2923f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:15.350794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45bce1-44bb-4ae5-b00b-476b8be2923f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:15.356086 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fbcbc-0d4d-428c-8e22-abb25d0bd675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:15.356750 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fbcbc-0d4d-428c-8e22-abb25d0bd675 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:15.357033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fbcbc-0d4d-428c-8e22-abb25d0bd675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:15.357309 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fbcbc-0d4d-428c-8e22-abb25d0bd675 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:15.358044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405fbcbc-0d4d-428c-8e22-abb25d0bd675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:15.359680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405fbcbc-0d4d-428c-8e22-abb25d0bd675 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:15.371767 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1148/2297] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:28:15.376133 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6069d4-ced2-4418-9ab1-102d106161c0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:15.386660 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6069d4-ced2-4418-9ab1-102d106161c0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:15.391499 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839410ba-f4b9-48cd-a59f-53bd46247a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:15.393182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839410ba-f4b9-48cd-a59f-53bd46247a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:15.393462 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839410ba-f4b9-48cd-a59f-53bd46247a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:15.393792 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839410ba-f4b9-48cd-a59f-53bd46247a2d admin admin] PATH_INFO: `/v3/projects/3831035eb9264cee85c2678a124ceb85/users/4d5007be3bbd47889b48e9ccf6fe1c3f/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:15.412513 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839410ba-f4b9-48cd-a59f-53bd46247a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3831035eb9264cee85c2678a124ceb85, user_id=4d5007be3bbd47889b48e9ccf6fe1c3f, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:15.417242 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839410ba-f4b9-48cd-a59f-53bd46247a2d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:15.435998 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1150/2298] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:28:15 2022] PUT /identity/v3/projects/3831035eb9264cee85c2678a124ceb85/users/4d5007be3bbd47889b48e9ccf6fe1c3f/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:28:15.436837 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fbcbc-0d4d-428c-8e22-abb25d0bd675 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:15.448176 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fbcbc-0d4d-428c-8e22-abb25d0bd675 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:15.518263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022275e-912b-4633-9c48-e282911c361e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:15.519066 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022275e-912b-4633-9c48-e282911c361e admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:15.519472 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022275e-912b-4633-9c48-e282911c361e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:15.519812 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022275e-912b-4633-9c48-e282911c361e admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:15.520612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022275e-912b-4633-9c48-e282911c361e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:15.526544 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022275e-912b-4633-9c48-e282911c361e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:15.542110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1149/2299] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:28:15.543554 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839410ba-f4b9-48cd-a59f-53bd46247a2d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:15.558273 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839410ba-f4b9-48cd-a59f-53bd46247a2d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:15.572068 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772bce5-2ac4-4260-b36e-7637a80f26d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:15.573409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772bce5-2ac4-4260-b36e-7637a80f26d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:15.573409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772bce5-2ac4-4260-b36e-7637a80f26d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:15.573613 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772bce5-2ac4-4260-b36e-7637a80f26d7 admin admin] PATH_INFO: `/v3/projects/3831035eb9264cee85c2678a124ceb85/users/4d5007be3bbd47889b48e9ccf6fe1c3f/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:15.575869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772bce5-2ac4-4260-b36e-7637a80f26d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3831035eb9264cee85c2678a124ceb85, user_id=4d5007be3bbd47889b48e9ccf6fe1c3f, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:15.590164 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772bce5-2ac4-4260-b36e-7637a80f26d7 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:15.608931 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1151/2300] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:28:15 2022] PUT /identity/v3/projects/3831035eb9264cee85c2678a124ceb85/users/4d5007be3bbd47889b48e9ccf6fe1c3f/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:28:21.067198 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336463e-f7d0-463c-9849-031a4a4cd84e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:21.068010 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336463e-f7d0-463c-9849-031a4a4cd84e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:21.068010 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336463e-f7d0-463c-9849-031a4a4cd84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:21.098504 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5336463e-f7d0-463c-9849-031a4a4cd84e None None] MFA Rules not processed for user `4d5007be3bbd47889b48e9ccf6fe1c3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:21.099876 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5336463e-f7d0-463c-9849-031a4a4cd84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:21.177290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1150/2301] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:28:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:21.191496 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772bce5-2ac4-4260-b36e-7637a80f26d7 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:21.193173 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e772bce5-2ac4-4260-b36e-7637a80f26d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:21.271939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772bce5-2ac4-4260-b36e-7637a80f26d7 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:21.281416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11230081-565a-455e-a050-84d799d5b961 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:21.282094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11230081-565a-455e-a050-84d799d5b961 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:21.282509 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11230081-565a-455e-a050-84d799d5b961 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:21.282671 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11230081-565a-455e-a050-84d799d5b961 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:21.340534 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11230081-565a-455e-a050-84d799d5b961 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:21.342034 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11230081-565a-455e-a050-84d799d5b961 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:21.351778 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1152/2302] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:22.619762 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9f7ae-cd03-4b94-8740-e4296a2557af None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:22.620282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9f7ae-cd03-4b94-8740-e4296a2557af None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:22.620378 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9f7ae-cd03-4b94-8740-e4296a2557af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:22.639044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d2b9f7ae-cd03-4b94-8740-e4296a2557af None None] MFA Rules not processed for user `62ef5bec99e2415582fd9be9e5eec6eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:22.640284 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d2b9f7ae-cd03-4b94-8740-e4296a2557af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:22.647952 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1151/2303] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:28:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:25.002926 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7d502-1486-4d21-bb14-30ff85d24237 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:25.003475 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7d502-1486-4d21-bb14-30ff85d24237 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:25.003730 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7d502-1486-4d21-bb14-30ff85d24237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:25.030790 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e5e7d502-1486-4d21-bb14-30ff85d24237 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:25.032805 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e5e7d502-1486-4d21-bb14-30ff85d24237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:25.127222 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:25.140077 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1153/2304] 10.222.0.88 () {58 vars in 1016 bytes} [Wed Jul 20 19:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:25.163329 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9f7ae-cd03-4b94-8740-e4296a2557af None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:25.181996 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9f7ae-cd03-4b94-8740-e4296a2557af None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:25.188688 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eca31a-42a3-42fc-a362-ab030bd554f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:25.189790 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eca31a-42a3-42fc-a362-ab030bd554f3 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:25.190265 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eca31a-42a3-42fc-a362-ab030bd554f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:25.190598 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eca31a-42a3-42fc-a362-ab030bd554f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:25.202070 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eca31a-42a3-42fc-a362-ab030bd554f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:25.203772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eca31a-42a3-42fc-a362-ab030bd554f3 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:25.216597 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1152/2305] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:26.766657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffcb7f-3667-4cb6-9248-a0566beff0c9 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:26.767154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffcb7f-3667-4cb6-9248-a0566beff0c9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:26.767292 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffcb7f-3667-4cb6-9248-a0566beff0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:26.790445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-69ffcb7f-3667-4cb6-9248-a0566beff0c9 None None] MFA Rules not processed for user `e78792e617d84a7cbb384ed764c391fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:26.791469 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-69ffcb7f-3667-4cb6-9248-a0566beff0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:26.862664 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1154/2306] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 20 19:28:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:26.925015 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eca31a-42a3-42fc-a362-ab030bd554f3 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:26.926483 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a9eca31a-42a3-42fc-a362-ab030bd554f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:26.944342 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:27.014675 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eca31a-42a3-42fc-a362-ab030bd554f3 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:27.020935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94016ea6-6868-47c5-8fff-1b82d9526bc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebd7c59f0014a3886fa75fb35a40e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:27.021893 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94016ea6-6868-47c5-8fff-1b82d9526bc9 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:27.022157 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94016ea6-6868-47c5-8fff-1b82d9526bc9 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:27.022738 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94016ea6-6868-47c5-8fff-1b82d9526bc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:27.034447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94016ea6-6868-47c5-8fff-1b82d9526bc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:27.035965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94016ea6-6868-47c5-8fff-1b82d9526bc9 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:27.045386 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1153/2307] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 20 19:28:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:28:30.388158 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff534b5-1328-458f-b48a-90f9a6888c40 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:30.388801 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff534b5-1328-458f-b48a-90f9a6888c40 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:30.388958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff534b5-1328-458f-b48a-90f9a6888c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:30.416158 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7ff534b5-1328-458f-b48a-90f9a6888c40 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:30.417409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7ff534b5-1328-458f-b48a-90f9a6888c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:30.438226 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1155/2308] 10.222.0.88 () {58 vars in 1016 bytes} [Wed Jul 20 19:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:30.465736 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94016ea6-6868-47c5-8fff-1b82d9526bc9 service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:30.481816 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94016ea6-6868-47c5-8fff-1b82d9526bc9 service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:30.495665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb49f64-4ffd-485a-9cc1-6410d7679254 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:30.496327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb49f64-4ffd-485a-9cc1-6410d7679254 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:30.496674 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb49f64-4ffd-485a-9cc1-6410d7679254 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:30.496959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb49f64-4ffd-485a-9cc1-6410d7679254 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:30.522318 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb49f64-4ffd-485a-9cc1-6410d7679254 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:30.522318 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb49f64-4ffd-485a-9cc1-6410d7679254 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:30.542410 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1154/2309] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:35.643237 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899073c-ee53-444a-938c-52fab4103cad None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:35.643816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899073c-ee53-444a-938c-52fab4103cad None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:35.643816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899073c-ee53-444a-938c-52fab4103cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:35.666529 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d899073c-ee53-444a-938c-52fab4103cad None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:35.667773 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d899073c-ee53-444a-938c-52fab4103cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:35.678921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1156/2310] 10.222.0.88 () {58 vars in 1016 bytes} [Wed Jul 20 19:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:35.707927 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb49f64-4ffd-485a-9cc1-6410d7679254 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:35.709466 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-edb49f64-4ffd-485a-9cc1-6410d7679254 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:35.725112 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb49f64-4ffd-485a-9cc1-6410d7679254 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:35.732054 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a25794-e9d9-4938-aa10-2ff5e0ac14b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:35.732930 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a25794-e9d9-4938-aa10-2ff5e0ac14b1 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:35.733457 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a25794-e9d9-4938-aa10-2ff5e0ac14b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:35.733741 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a25794-e9d9-4938-aa10-2ff5e0ac14b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:35.750664 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a25794-e9d9-4938-aa10-2ff5e0ac14b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:35.752876 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a25794-e9d9-4938-aa10-2ff5e0ac14b1 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:35.766317 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1155/2311] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:40.743088 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15616cd8-c153-415c-87fa-3668063d45df None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:40.743673 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15616cd8-c153-415c-87fa-3668063d45df None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:40.743673 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15616cd8-c153-415c-87fa-3668063d45df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:40.763213 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-15616cd8-c153-415c-87fa-3668063d45df None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:40.765597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-15616cd8-c153-415c-87fa-3668063d45df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:40.774880 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1157/2312] 10.222.0.88 () {58 vars in 1016 bytes} [Wed Jul 20 19:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:40.811936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a25794-e9d9-4938-aa10-2ff5e0ac14b1 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:40.824471 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a25794-e9d9-4938-aa10-2ff5e0ac14b1 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:40.830168 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060e80d-270f-4bf3-8b56-286da11e110d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:40.830834 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060e80d-270f-4bf3-8b56-286da11e110d service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:40.831116 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060e80d-270f-4bf3-8b56-286da11e110d service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:40.831389 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060e80d-270f-4bf3-8b56-286da11e110d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:40.841030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060e80d-270f-4bf3-8b56-286da11e110d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:40.843738 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060e80d-270f-4bf3-8b56-286da11e110d service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:40.858184 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1156/2313] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:47.000805 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebc6c3-a344-4f08-9c19-3ce578a4ec5a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:47.001417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebc6c3-a344-4f08-9c19-3ce578a4ec5a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:47.001417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebc6c3-a344-4f08-9c19-3ce578a4ec5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:47.025067 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-35ebc6c3-a344-4f08-9c19-3ce578a4ec5a None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:47.026856 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-35ebc6c3-a344-4f08-9c19-3ce578a4ec5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:47.035789 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1158/2314] 10.222.0.88 () {58 vars in 1016 bytes} [Wed Jul 20 19:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:47.063033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060e80d-270f-4bf3-8b56-286da11e110d service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:47.079911 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060e80d-270f-4bf3-8b56-286da11e110d service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:47.085923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f589b2-6aee-4f92-b1a3-194978026de7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:47.086608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f589b2-6aee-4f92-b1a3-194978026de7 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:47.086938 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f589b2-6aee-4f92-b1a3-194978026de7 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:47.087220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f589b2-6aee-4f92-b1a3-194978026de7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:47.097127 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f589b2-6aee-4f92-b1a3-194978026de7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:47.099279 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f589b2-6aee-4f92-b1a3-194978026de7 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:47.111252 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1157/2315] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:52.523310 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0b9ed-3b8b-4ac7-9d03-54fe76494b8a None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:52.526895 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0b9ed-3b8b-4ac7-9d03-54fe76494b8a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:52.526895 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0b9ed-3b8b-4ac7-9d03-54fe76494b8a None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:52.526895 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1159/2316] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 20 19:28:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:52.531469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510ae45-9e9e-46a7-af2f-9204ddd56e71 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:52.531916 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510ae45-9e9e-46a7-af2f-9204ddd56e71 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:52.532028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510ae45-9e9e-46a7-af2f-9204ddd56e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:52.552549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-7510ae45-9e9e-46a7-af2f-9204ddd56e71 None None] MFA Rules not processed for user `a1f0f6bc94de4645a8c82038ff2bd34a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:52.553972 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7510ae45-9e9e-46a7-af2f-9204ddd56e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:52.563920 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1158/2317] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 20 19:28:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:52.576694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0b9ed-3b8b-4ac7-9d03-54fe76494b8a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:52.578846 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-56b0b9ed-3b8b-4ac7-9d03-54fe76494b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:52.656799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0b9ed-3b8b-4ac7-9d03-54fe76494b8a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:52.660593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555c163-759b-4fc7-955d-b83b9a73035e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f646c526a044e8b5b6e74aa64cf6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:52.661245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555c163-759b-4fc7-955d-b83b9a73035e service glance] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:52.661530 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555c163-759b-4fc7-955d-b83b9a73035e service glance] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:52.661911 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555c163-759b-4fc7-955d-b83b9a73035e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:52.677731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555c163-759b-4fc7-955d-b83b9a73035e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:52.680684 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555c163-759b-4fc7-955d-b83b9a73035e service glance] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:52.693634 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1160/2318] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:52.764782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcf5ea-a171-4a15-b4b3-54041d2481f8 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:52.765073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcf5ea-a171-4a15-b4b3-54041d2481f8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:52.765381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dcf5ea-a171-4a15-b4b3-54041d2481f8 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:52.766823 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1159/2319] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 20 19:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:52.771701 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb881a4-868d-4eed-a279-f6a736f0072f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:52.772120 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb881a4-868d-4eed-a279-f6a736f0072f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:52.773133 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb881a4-868d-4eed-a279-f6a736f0072f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:52.793425 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-cbb881a4-868d-4eed-a279-f6a736f0072f None None] MFA Rules not processed for user `0c7b88e083d04718bf19d982724babd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:52.794666 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-cbb881a4-868d-4eed-a279-f6a736f0072f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:52.849702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1161/2320] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 20 19:28:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:52.862528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dcf5ea-a171-4a15-b4b3-54041d2481f8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:52.873598 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dcf5ea-a171-4a15-b4b3-54041d2481f8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:52.877334 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc17f2b-683e-40af-9ad6-453cc868c316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:52.877977 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc17f2b-683e-40af-9ad6-453cc868c316 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:52.878265 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc17f2b-683e-40af-9ad6-453cc868c316 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:52.878575 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc17f2b-683e-40af-9ad6-453cc868c316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:52.886660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc17f2b-683e-40af-9ad6-453cc868c316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:52.888074 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc17f2b-683e-40af-9ad6-453cc868c316 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:52.896060 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1160/2321] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:52.982644 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabc95f-2c49-4ef2-ab30-cdf887a8823a None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:52.982939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabc95f-2c49-4ef2-ab30-cdf887a8823a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:52.983226 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabc95f-2c49-4ef2-ab30-cdf887a8823a None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:52.984642 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1162/2322] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 20 19:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:28:52.999209 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07faecb-bcbb-4676-af03-2720d3a526d4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:52.999733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07faecb-bcbb-4676-af03-2720d3a526d4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:53.000012 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07faecb-bcbb-4676-af03-2720d3a526d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:53.022777 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c07faecb-bcbb-4676-af03-2720d3a526d4 None None] MFA Rules not processed for user `a1f0f6bc94de4645a8c82038ff2bd34a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:53.024255 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c07faecb-bcbb-4676-af03-2720d3a526d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:53.035474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1161/2323] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 20 19:28:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:28:53.047266 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabc95f-2c49-4ef2-ab30-cdf887a8823a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:28:53.060467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabc95f-2c49-4ef2-ab30-cdf887a8823a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:28:53.065022 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c2f15-c095-4c16-bb24-f04401d356e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:28:53.065790 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c2f15-c095-4c16-bb24-f04401d356e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:53.066134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c2f15-c095-4c16-bb24-f04401d356e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:53.066935 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c2f15-c095-4c16-bb24-f04401d356e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:53.082598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c2f15-c095-4c16-bb24-f04401d356e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:28:53.084769 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c2f15-c095-4c16-bb24-f04401d356e7 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:28:53.124196 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1163/2324] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:28:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:28:58.481707 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c646b5-8f7d-475d-9201-23b17cb82759 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:28:58.482263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c646b5-8f7d-475d-9201-23b17cb82759 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:28:58.482263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c646b5-8f7d-475d-9201-23b17cb82759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:28:58.488133 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=66 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:28:58.500990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-22c646b5-8f7d-475d-9201-23b17cb82759 None None] MFA Rules not processed for user `1198a00eb02c41bc9f3b511f14e4503b`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:28:58.502209 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-22c646b5-8f7d-475d-9201-23b17cb82759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:28:58.561097 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1162/2325] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:28:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:29:03.096052 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:06.737693 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176cc98-6513-4f4f-8229-70afe0c9089d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:06.738286 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176cc98-6513-4f4f-8229-70afe0c9089d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:06.738286 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176cc98-6513-4f4f-8229-70afe0c9089d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:06.756603 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-e176cc98-6513-4f4f-8229-70afe0c9089d None None] MFA Rules not processed for user `e78792e617d84a7cbb384ed764c391fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:29:06.757834 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e176cc98-6513-4f4f-8229-70afe0c9089d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:06.765937 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1164/2326] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 20 19:29:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:29:06.779067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c646b5-8f7d-475d-9201-23b17cb82759 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:06.792707 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c646b5-8f7d-475d-9201-23b17cb82759 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:06.797819 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7389417-8388-4518-a593-56d4a8f173a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebd7c59f0014a3886fa75fb35a40e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:06.798576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7389417-8388-4518-a593-56d4a8f173a7 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:06.798929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7389417-8388-4518-a593-56d4a8f173a7 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:06.799277 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7389417-8388-4518-a593-56d4a8f173a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:06.812721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7389417-8388-4518-a593-56d4a8f173a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:06.814211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7389417-8388-4518-a593-56d4a8f173a7 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:06.822966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1163/2327] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 20 19:29:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:29:16.751268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:16.819523 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=30 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:31.236226 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176cc98-6513-4f4f-8229-70afe0c9089d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:31.238553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e176cc98-6513-4f4f-8229-70afe0c9089d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:31.258740 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176cc98-6513-4f4f-8229-70afe0c9089d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:31.267992 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4f7af-b020-4932-aa25-016e7752b23a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:31.269265 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4f7af-b020-4932-aa25-016e7752b23a service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:31.269751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4f7af-b020-4932-aa25-016e7752b23a service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:31.270416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4f7af-b020-4932-aa25-016e7752b23a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:31.286861 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4f7af-b020-4932-aa25-016e7752b23a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:31.289382 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4f7af-b020-4932-aa25-016e7752b23a service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:31.302520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1165/2328] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:29:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:29:36.664412 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7389417-8388-4518-a593-56d4a8f173a7 service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:36.674073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7389417-8388-4518-a593-56d4a8f173a7 service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:36.679362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838afe3-ba93-4b04-b5a5-5197dc862cc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:36.679990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838afe3-ba93-4b04-b5a5-5197dc862cc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:36.680271 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838afe3-ba93-4b04-b5a5-5197dc862cc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:36.680544 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838afe3-ba93-4b04-b5a5-5197dc862cc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:36.682336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e838afe3-ba93-4b04-b5a5-5197dc862cc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:36.699735 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838afe3-ba93-4b04-b5a5-5197dc862cc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:36.701824 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838afe3-ba93-4b04-b5a5-5197dc862cc4 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:36.714633 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1164/2329] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:29:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:29:37.324225 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb70ca-76d2-42d3-a534-1937b155465c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:37.324708 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb70ca-76d2-42d3-a534-1937b155465c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:37.324800 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb70ca-76d2-42d3-a534-1937b155465c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:37.343696 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-dedb70ca-76d2-42d3-a534-1937b155465c None None] MFA Rules not processed for user `e78792e617d84a7cbb384ed764c391fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:29:37.344911 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-dedb70ca-76d2-42d3-a534-1937b155465c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:37.352216 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1166/2330] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jul 20 19:29:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:29:37.375381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838afe3-ba93-4b04-b5a5-5197dc862cc4 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:37.400876 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838afe3-ba93-4b04-b5a5-5197dc862cc4 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:37.406240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79230200-e6cf-4705-8a49-5455ed388112 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebd7c59f0014a3886fa75fb35a40e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:37.406933 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79230200-e6cf-4705-8a49-5455ed388112 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:37.407220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79230200-e6cf-4705-8a49-5455ed388112 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:37.407504 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79230200-e6cf-4705-8a49-5455ed388112 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:37.416880 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79230200-e6cf-4705-8a49-5455ed388112 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:37.418496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79230200-e6cf-4705-8a49-5455ed388112 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:37.427331 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1165/2331] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 20 19:29:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:29:37.610536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb70ca-76d2-42d3-a534-1937b155465c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:37.630459 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb70ca-76d2-42d3-a534-1937b155465c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:37.637506 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d5d3e-c621-40db-9ce3-ea2bae48309f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:37.638366 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d5d3e-c621-40db-9ce3-ea2bae48309f service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:37.638691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d5d3e-c621-40db-9ce3-ea2bae48309f service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:37.639185 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d5d3e-c621-40db-9ce3-ea2bae48309f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:37.641884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-df1d5d3e-c621-40db-9ce3-ea2bae48309f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:37.661316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d5d3e-c621-40db-9ce3-ea2bae48309f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:37.662904 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d5d3e-c621-40db-9ce3-ea2bae48309f service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:37.675954 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1167/2332] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:29:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:29:47.423942 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=12 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:47.670293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=15 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:48.493759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79230200-e6cf-4705-8a49-5455ed388112 service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:48.495330 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-79230200-e6cf-4705-8a49-5455ed388112 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:48.510292 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79230200-e6cf-4705-8a49-5455ed388112 service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:48.514924 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5b970-9114-4b40-845f-e78a535c5610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:48.515827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5b970-9114-4b40-845f-e78a535c5610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:48.516114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5b970-9114-4b40-845f-e78a535c5610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:48.516390 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5b970-9114-4b40-845f-e78a535c5610 admin admin] PATH_INFO: `/v3/users/b9daf80901df487a99d83f84a303995d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:48.517712 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5b970-9114-4b40-845f-e78a535c5610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9daf80901df487a99d83f84a303995d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:48.520169 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5b970-9114-4b40-845f-e78a535c5610 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:48.570061 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1dd5b970-9114-4b40-845f-e78a535c5610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9daf80901df487a99d83f84a303995d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:29:48.577367 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1dd5b970-9114-4b40-845f-e78a535c5610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9daf80901df487a99d83f84a303995d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:29:48.591561 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1dd5b970-9114-4b40-845f-e78a535c5610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9daf80901df487a99d83f84a303995d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:29:48.602508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1dd5b970-9114-4b40-845f-e78a535c5610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9daf80901df487a99d83f84a303995d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:29:48.603381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-1dd5b970-9114-4b40-845f-e78a535c5610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9daf80901df487a99d83f84a303995d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:29:48.610000 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1166/2333] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:29:48 2022] DELETE /identity/v3/users/b9daf80901df487a99d83f84a303995d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:29:48.829936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d5d3e-c621-40db-9ce3-ea2bae48309f service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:48.845358 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d5d3e-c621-40db-9ce3-ea2bae48309f service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:48.921722 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a6949-4221-4074-8fa1-944e02eeb0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:48.922657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a6949-4221-4074-8fa1-944e02eeb0dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:48.923211 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a6949-4221-4074-8fa1-944e02eeb0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:48.923495 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a6949-4221-4074-8fa1-944e02eeb0dc admin admin] PATH_INFO: `/v3/projects/efb4a8d109b04557abf549231a70ad98` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:48.924694 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a6949-4221-4074-8fa1-944e02eeb0dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=efb4a8d109b04557abf549231a70ad98)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:48.927210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a6949-4221-4074-8fa1-944e02eeb0dc admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:48.975508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-764a6949-4221-4074-8fa1-944e02eeb0dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efb4a8d109b04557abf549231a70ad98', 'request_id': 'req-764a6949-4221-4074-8fa1-944e02eeb0dc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:29:48.982481 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-764a6949-4221-4074-8fa1-944e02eeb0dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efb4a8d109b04557abf549231a70ad98', 'request_id': 'req-764a6949-4221-4074-8fa1-944e02eeb0dc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:29:48.988942 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-764a6949-4221-4074-8fa1-944e02eeb0dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efb4a8d109b04557abf549231a70ad98', 'request_id': 'req-764a6949-4221-4074-8fa1-944e02eeb0dc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:29:49.001772 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-764a6949-4221-4074-8fa1-944e02eeb0dc admin admin] The token cache is being invalidate because project efb4a8d109b04557abf549231a70ad98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:29:49.002053 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-764a6949-4221-4074-8fa1-944e02eeb0dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:29:49.002689 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-764a6949-4221-4074-8fa1-944e02eeb0dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:29:49.004512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1168/2334] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:29:48 2022] DELETE /identity/v3/projects/efb4a8d109b04557abf549231a70ad98 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:29:55.596440 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5b970-9114-4b40-845f-e78a535c5610 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:55.597853 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1dd5b970-9114-4b40-845f-e78a535c5610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:55.675907 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5b970-9114-4b40-845f-e78a535c5610 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:55.739156 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24110f-fc67-49c7-8217-79d4f7d57da0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:55.739814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24110f-fc67-49c7-8217-79d4f7d57da0 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:55.740104 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24110f-fc67-49c7-8217-79d4f7d57da0 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:55.740388 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24110f-fc67-49c7-8217-79d4f7d57da0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:55.742184 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4e24110f-fc67-49c7-8217-79d4f7d57da0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:55.748260 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:29:55.802882 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24110f-fc67-49c7-8217-79d4f7d57da0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:55.804520 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24110f-fc67-49c7-8217-79d4f7d57da0 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:55.813500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1167/2335] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:29:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:29:57.111841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a6949-4221-4074-8fa1-944e02eeb0dc admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:57.114213 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-764a6949-4221-4074-8fa1-944e02eeb0dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:57.132455 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a6949-4221-4074-8fa1-944e02eeb0dc admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:57.138082 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71fafc2-039f-4bdd-86f4-1e20b8678ba1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:57.138772 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fafc2-039f-4bdd-86f4-1e20b8678ba1 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:57.139062 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fafc2-039f-4bdd-86f4-1e20b8678ba1 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:57.139343 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fafc2-039f-4bdd-86f4-1e20b8678ba1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:57.141260 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e71fafc2-039f-4bdd-86f4-1e20b8678ba1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:57.203421 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71fafc2-039f-4bdd-86f4-1e20b8678ba1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:57.205305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71fafc2-039f-4bdd-86f4-1e20b8678ba1 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:57.214356 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1169/2336] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:29:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:29:59.401875 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24110f-fc67-49c7-8217-79d4f7d57da0 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:29:59.403543 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4e24110f-fc67-49c7-8217-79d4f7d57da0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:59.464025 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24110f-fc67-49c7-8217-79d4f7d57da0 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:29:59.467842 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30582583-5c7e-4f33-81ff-5415aa257aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:29:59.468495 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30582583-5c7e-4f33-81ff-5415aa257aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:29:59.468783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30582583-5c7e-4f33-81ff-5415aa257aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:29:59.469065 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30582583-5c7e-4f33-81ff-5415aa257aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:29:59.470944 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-30582583-5c7e-4f33-81ff-5415aa257aa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:29:59.482916 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30582583-5c7e-4f33-81ff-5415aa257aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:29:59.484360 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30582583-5c7e-4f33-81ff-5415aa257aa0 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:29:59.492440 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1168/2337] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:29:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:30:01.831955 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b7afc-eb89-4494-9c8e-3046c20dc1d4 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:01.833020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b7afc-eb89-4494-9c8e-3046c20dc1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:01.833020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b7afc-eb89-4494-9c8e-3046c20dc1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:01.851257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-117b7afc-eb89-4494-9c8e-3046c20dc1d4 None None] MFA Rules not processed for user `551a91b131bc4a16a40b865a0a3fb50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:30:01.852491 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-117b7afc-eb89-4494-9c8e-3046c20dc1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:01.859532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1170/2338] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:30:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:30:09.488860 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=50 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:09.637281 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30582583-5c7e-4f33-81ff-5415aa257aa0 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:30:09.651136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30582583-5c7e-4f33-81ff-5415aa257aa0 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:30:09.660170 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a19939-f472-42f4-9d95-eb20a2741703 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:30:09.660170 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a19939-f472-42f4-9d95-eb20a2741703 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:30:09.660170 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a19939-f472-42f4-9d95-eb20a2741703 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:30:09.660170 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a19939-f472-42f4-9d95-eb20a2741703 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:30:09.661158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-64a19939-f472-42f4-9d95-eb20a2741703 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:30:09.674934 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a19939-f472-42f4-9d95-eb20a2741703 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:30:09.676543 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a19939-f472-42f4-9d95-eb20a2741703 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:30:09.687953 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1169/2339] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:30:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:30:11.845281 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:30:19.683222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:09.192617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b7afc-eb89-4494-9c8e-3046c20dc1d4 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:09.206544 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b7afc-eb89-4494-9c8e-3046c20dc1d4 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:09.212220 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8ff92-72de-4afc-9025-8927f3bf3f34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:09.213327 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8ff92-72de-4afc-9025-8927f3bf3f34 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:09.213615 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8ff92-72de-4afc-9025-8927f3bf3f34 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:09.214150 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8ff92-72de-4afc-9025-8927f3bf3f34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:09.216047 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-87a8ff92-72de-4afc-9025-8927f3bf3f34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:09.279869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8ff92-72de-4afc-9025-8927f3bf3f34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:09.281633 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8ff92-72de-4afc-9025-8927f3bf3f34 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:09.291600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1171/2340] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:31:15.011701 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a19939-f472-42f4-9d95-eb20a2741703 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:15.013400 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-64a19939-f472-42f4-9d95-eb20a2741703 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:15.027508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a19939-f472-42f4-9d95-eb20a2741703 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:15.034176 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df03fa4-69b7-4672-9693-74f1e57140a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:15.034877 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df03fa4-69b7-4672-9693-74f1e57140a2 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:15.035163 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df03fa4-69b7-4672-9693-74f1e57140a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:15.035447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df03fa4-69b7-4672-9693-74f1e57140a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:15.037783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4df03fa4-69b7-4672-9693-74f1e57140a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:15.051494 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df03fa4-69b7-4672-9693-74f1e57140a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:15.053098 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df03fa4-69b7-4672-9693-74f1e57140a2 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:15.064536 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1170/2341] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:31:19.286800 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=28 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:19.739909 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223d3fa-85ae-45cf-82a9-a743c6130f82 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:19.740204 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223d3fa-85ae-45cf-82a9-a743c6130f82 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:19.740487 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223d3fa-85ae-45cf-82a9-a743c6130f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:19.758156 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9223d3fa-85ae-45cf-82a9-a743c6130f82 None None] MFA Rules not processed for user `31bfcbd417344e5cadf0f2e6f504fafb`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:19.759400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9223d3fa-85ae-45cf-82a9-a743c6130f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:19.766952 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1172/2342] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:31:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:20.081574 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df03fa4-69b7-4672-9693-74f1e57140a2 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:20.083070 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4df03fa4-69b7-4672-9693-74f1e57140a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:20.095067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df03fa4-69b7-4672-9693-74f1e57140a2 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:20.098718 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037a0c2-da90-4e09-b024-74699ee0543e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:20.099382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037a0c2-da90-4e09-b024-74699ee0543e service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:20.099668 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037a0c2-da90-4e09-b024-74699ee0543e service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:20.099947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037a0c2-da90-4e09-b024-74699ee0543e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:20.101679 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7037a0c2-da90-4e09-b024-74699ee0543e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:20.111740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037a0c2-da90-4e09-b024-74699ee0543e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:20.113153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037a0c2-da90-4e09-b024-74699ee0543e service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:20.121132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1171/2343] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:31:22.454820 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223d3fa-85ae-45cf-82a9-a743c6130f82 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:22.456234 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9223d3fa-85ae-45cf-82a9-a743c6130f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:22.531369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223d3fa-85ae-45cf-82a9-a743c6130f82 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:22.536532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5c02b-68aa-4e1e-b463-285a932d9318 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd310799ac43e42bc9c7810e1296ddb9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:22.537186 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5c02b-68aa-4e1e-b463-285a932d9318 service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:22.537468 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5c02b-68aa-4e1e-b463-285a932d9318 service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:22.537747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5c02b-68aa-4e1e-b463-285a932d9318 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:22.539609 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-27f5c02b-68aa-4e1e-b463-285a932d9318 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:22.554283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5c02b-68aa-4e1e-b463-285a932d9318 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:22.555933 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5c02b-68aa-4e1e-b463-285a932d9318 service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:22.566290 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1173/2344] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:31:30.117617 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=12 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:32.561833 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=35 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:36.884359 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037a0c2-da90-4e09-b024-74699ee0543e service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:36.899711 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037a0c2-da90-4e09-b024-74699ee0543e service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:36.906445 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175e1e5-b2a3-48c9-9f50-0104a6ca3ec2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:36.907360 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175e1e5-b2a3-48c9-9f50-0104a6ca3ec2 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:36.907640 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175e1e5-b2a3-48c9-9f50-0104a6ca3ec2 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:36.908109 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175e1e5-b2a3-48c9-9f50-0104a6ca3ec2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:36.910336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5175e1e5-b2a3-48c9-9f50-0104a6ca3ec2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:36.924722 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175e1e5-b2a3-48c9-9f50-0104a6ca3ec2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:36.926318 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175e1e5-b2a3-48c9-9f50-0104a6ca3ec2 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:36.936942 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1172/2345] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:31:41.376328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5c02b-68aa-4e1e-b463-285a932d9318 service placement] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:41.389581 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5c02b-68aa-4e1e-b463-285a932d9318 service placement] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:41.395822 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8e222-60e5-4c01-a9c1-430eb337756b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:41.396633 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8e222-60e5-4c01-a9c1-430eb337756b service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:41.396917 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8e222-60e5-4c01-a9c1-430eb337756b service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:41.397192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8e222-60e5-4c01-a9c1-430eb337756b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:41.399043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a8f8e222-60e5-4c01-a9c1-430eb337756b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:41.466996 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8e222-60e5-4c01-a9c1-430eb337756b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:41.469171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8e222-60e5-4c01-a9c1-430eb337756b service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:41.480528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1174/2346] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:31:44.140629 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642735a3-4757-44a7-9698-3974c965bd14 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:44.141543 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642735a3-4757-44a7-9698-3974c965bd14 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:44.142507 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642735a3-4757-44a7-9698-3974c965bd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:44.161078 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-642735a3-4757-44a7-9698-3974c965bd14 None None] MFA Rules not processed for user `4eaf9d8ee17e45c99c415e80e72ef868`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:44.162328 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-642735a3-4757-44a7-9698-3974c965bd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:44.169356 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1173/2347] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:31:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:51.474845 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=28 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:54.155610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=9 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:54.410125 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8e222-60e5-4c01-a9c1-430eb337756b service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:54.420325 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8e222-60e5-4c01-a9c1-430eb337756b service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:54.424061 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ed69a-c9b6-407c-ae90-47535613f2af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:54.424709 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ed69a-c9b6-407c-ae90-47535613f2af service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:54.424984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ed69a-c9b6-407c-ae90-47535613f2af service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:54.425457 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ed69a-c9b6-407c-ae90-47535613f2af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:54.427390 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1f5ed69a-c9b6-407c-ae90-47535613f2af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:54.528330 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ed69a-c9b6-407c-ae90-47535613f2af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:54.531217 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ed69a-c9b6-407c-ae90-47535613f2af service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:54.543577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1175/2348] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:31:58.128807 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642735a3-4757-44a7-9698-3974c965bd14 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:58.130318 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-642735a3-4757-44a7-9698-3974c965bd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:58.146968 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642735a3-4757-44a7-9698-3974c965bd14 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:58.154874 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8b8c3-2a69-4adf-9761-fa922607b5d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd310799ac43e42bc9c7810e1296ddb9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:58.155649 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8b8c3-2a69-4adf-9761-fa922607b5d4 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:58.156138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8b8c3-2a69-4adf-9761-fa922607b5d4 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:58.156667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8b8c3-2a69-4adf-9761-fa922607b5d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:58.158848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a9e8b8c3-2a69-4adf-9761-fa922607b5d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:58.173879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8b8c3-2a69-4adf-9761-fa922607b5d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:58.175541 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8b8c3-2a69-4adf-9761-fa922607b5d4 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:58.190654 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1174/2349] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:31:58.208724 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ed69a-c9b6-407c-ae90-47535613f2af service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:58.212696 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1f5ed69a-c9b6-407c-ae90-47535613f2af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:58.228757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ed69a-c9b6-407c-ae90-47535613f2af service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:58.237573 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafb2d8-9389-40f5-8ed6-861092dded8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:58.238522 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafb2d8-9389-40f5-8ed6-861092dded8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:58.238811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafb2d8-9389-40f5-8ed6-861092dded8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:58.239093 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafb2d8-9389-40f5-8ed6-861092dded8e admin admin] PATH_INFO: `/v3/users/551a91b131bc4a16a40b865a0a3fb50d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:58.240352 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafb2d8-9389-40f5-8ed6-861092dded8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=551a91b131bc4a16a40b865a0a3fb50d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:58.242917 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafb2d8-9389-40f5-8ed6-861092dded8e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:58.303863 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bfafb2d8-9389-40f5-8ed6-861092dded8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '551a91b131bc4a16a40b865a0a3fb50d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:58.317429 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bfafb2d8-9389-40f5-8ed6-861092dded8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '551a91b131bc4a16a40b865a0a3fb50d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:58.327372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bfafb2d8-9389-40f5-8ed6-861092dded8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '551a91b131bc4a16a40b865a0a3fb50d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:58.328082 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bfafb2d8-9389-40f5-8ed6-861092dded8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '551a91b131bc4a16a40b865a0a3fb50d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:58.328875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bfafb2d8-9389-40f5-8ed6-861092dded8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '551a91b131bc4a16a40b865a0a3fb50d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:58.348499 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1176/2350] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:31:58 2022] DELETE /identity/v3/users/551a91b131bc4a16a40b865a0a3fb50d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:31:58.543917 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8b8c3-2a69-4adf-9761-fa922607b5d4 service placement] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:58.561210 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8b8c3-2a69-4adf-9761-fa922607b5d4 service placement] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:58.655459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb837e-58b3-4b61-a948-4ac7e8cdc599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:58.656860 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb837e-58b3-4b61-a948-4ac7e8cdc599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:58.657315 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb837e-58b3-4b61-a948-4ac7e8cdc599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:58.658183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb837e-58b3-4b61-a948-4ac7e8cdc599 admin admin] PATH_INFO: `/v3/projects/b97e2ccd86eb4d0083a219f0ba8cdf31` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:58.659739 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb837e-58b3-4b61-a948-4ac7e8cdc599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b97e2ccd86eb4d0083a219f0ba8cdf31)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:58.663224 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb837e-58b3-4b61-a948-4ac7e8cdc599 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:58.731220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3efb837e-58b3-4b61-a948-4ac7e8cdc599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97e2ccd86eb4d0083a219f0ba8cdf31', 'request_id': 'req-3efb837e-58b3-4b61-a948-4ac7e8cdc599'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:58.739376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3efb837e-58b3-4b61-a948-4ac7e8cdc599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97e2ccd86eb4d0083a219f0ba8cdf31', 'request_id': 'req-3efb837e-58b3-4b61-a948-4ac7e8cdc599'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:58.751242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3efb837e-58b3-4b61-a948-4ac7e8cdc599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97e2ccd86eb4d0083a219f0ba8cdf31', 'request_id': 'req-3efb837e-58b3-4b61-a948-4ac7e8cdc599'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:58.763533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3efb837e-58b3-4b61-a948-4ac7e8cdc599 admin admin] The token cache is being invalidate because project b97e2ccd86eb4d0083a219f0ba8cdf31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:31:58.763822 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3efb837e-58b3-4b61-a948-4ac7e8cdc599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:58.764480 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3efb837e-58b3-4b61-a948-4ac7e8cdc599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:31:58.766270 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1175/2351] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:31:58 2022] DELETE /identity/v3/projects/b97e2ccd86eb4d0083a219f0ba8cdf31 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:31:58.771408 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e919ad-432f-473a-9d87-af1f466a38d8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:58.771640 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e919ad-432f-473a-9d87-af1f466a38d8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:58.771919 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e919ad-432f-473a-9d87-af1f466a38d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:58.798476 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a4e919ad-432f-473a-9d87-af1f466a38d8 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:58.799697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a4e919ad-432f-473a-9d87-af1f466a38d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:58.861955 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1177/2352] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:58.869538 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58344ce-0b9a-496d-b791-1799aadc31b1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:58.869955 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58344ce-0b9a-496d-b791-1799aadc31b1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:58.870452 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58344ce-0b9a-496d-b791-1799aadc31b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:58.890048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d58344ce-0b9a-496d-b791-1799aadc31b1 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:58.891330 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d58344ce-0b9a-496d-b791-1799aadc31b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:58.899760 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1176/2353] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:58.904458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e919ad-432f-473a-9d87-af1f466a38d8 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:58.914350 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e919ad-432f-473a-9d87-af1f466a38d8 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:58.919875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7142ff7-4088-4171-a24e-7a0e77b46726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:58.920760 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7142ff7-4088-4171-a24e-7a0e77b46726 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:58.921082 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7142ff7-4088-4171-a24e-7a0e77b46726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:58.921372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7142ff7-4088-4171-a24e-7a0e77b46726 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:58.922133 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7142ff7-4088-4171-a24e-7a0e77b46726 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:31:58.922485 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7142ff7-4088-4171-a24e-7a0e77b46726 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:58.924145 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7142ff7-4088-4171-a24e-7a0e77b46726 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:58.925890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:58.938152 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1178/2354] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:31:58.942552 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58344ce-0b9a-496d-b791-1799aadc31b1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:58.954276 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58344ce-0b9a-496d-b791-1799aadc31b1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:58.959399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f986aa-5f6e-41d4-a1ae-17ad9894629b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:58.960099 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f986aa-5f6e-41d4-a1ae-17ad9894629b admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:58.960406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f986aa-5f6e-41d4-a1ae-17ad9894629b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:58.960684 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f986aa-5f6e-41d4-a1ae-17ad9894629b admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:58.961381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f986aa-5f6e-41d4-a1ae-17ad9894629b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:58.963373 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f986aa-5f6e-41d4-a1ae-17ad9894629b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:59.000986 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1177/2355] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:31:58 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:31:59.006324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7142ff7-4088-4171-a24e-7a0e77b46726 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:59.019070 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7142ff7-4088-4171-a24e-7a0e77b46726 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:59.046906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ca55d-f4cd-46b7-b2ab-a5f8fac760c5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:59.047197 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ca55d-f4cd-46b7-b2ab-a5f8fac760c5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:59.047668 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ca55d-f4cd-46b7-b2ab-a5f8fac760c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:59.065443 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-dd4ca55d-f4cd-46b7-b2ab-a5f8fac760c5 None None] MFA Rules not processed for user `1198a00eb02c41bc9f3b511f14e4503b`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:59.066716 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-dd4ca55d-f4cd-46b7-b2ab-a5f8fac760c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:59.080804 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de71614-cf3d-4253-acba-784df5961480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:59.081483 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de71614-cf3d-4253-acba-784df5961480 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:59.081770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de71614-cf3d-4253-acba-784df5961480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:59.082051 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de71614-cf3d-4253-acba-784df5961480 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:59.082777 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de71614-cf3d-4253-acba-784df5961480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:59.084702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de71614-cf3d-4253-acba-784df5961480 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:59.110039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1179/2356] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:31:59 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:31:59.111091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de71614-cf3d-4253-acba-784df5961480 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:59.113407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:31:59.122226 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de71614-cf3d-4253-acba-784df5961480 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:59.126993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b2557-e1de-4089-8a26-600c5c7d878c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:59.127654 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b2557-e1de-4089-8a26-600c5c7d878c admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:59.127941 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b2557-e1de-4089-8a26-600c5c7d878c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:59.128223 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b2557-e1de-4089-8a26-600c5c7d878c admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:59.128950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b2557-e1de-4089-8a26-600c5c7d878c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:59.130598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b2557-e1de-4089-8a26-600c5c7d878c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:59.132954 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1178/2357] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:31:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:31:59.141733 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1180/2358] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:31:59.145669 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ca55d-f4cd-46b7-b2ab-a5f8fac760c5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:59.156714 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ca55d-f4cd-46b7-b2ab-a5f8fac760c5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:59.163413 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f59569-e6b1-4789-8960-eaabc4ca7c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:59.164164 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f59569-e6b1-4789-8960-eaabc4ca7c8f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:59.164488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f59569-e6b1-4789-8960-eaabc4ca7c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:59.164776 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f59569-e6b1-4789-8960-eaabc4ca7c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:59.165550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f59569-e6b1-4789-8960-eaabc4ca7c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:59.167309 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f59569-e6b1-4789-8960-eaabc4ca7c8f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:59.181891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1179/2359] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:31:59.183819 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b2557-e1de-4089-8a26-600c5c7d878c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:59.194425 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b2557-e1de-4089-8a26-600c5c7d878c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:59.199279 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fc99c-1d64-45a0-ba91-19e929f025f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:59.200241 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fc99c-1d64-45a0-ba91-19e929f025f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:59.200603 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fc99c-1d64-45a0-ba91-19e929f025f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:59.200956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fc99c-1d64-45a0-ba91-19e929f025f2 admin admin] PATH_INFO: `/v3/projects/200c893dd8454565b04b039093be2fbe/users/8a1fc3310ad849e1bac3d864c686f640/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:59.216255 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9fc99c-1d64-45a0-ba91-19e929f025f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=200c893dd8454565b04b039093be2fbe, user_id=8a1fc3310ad849e1bac3d864c686f640, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:59.219044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9fc99c-1d64-45a0-ba91-19e929f025f2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:59.233777 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1181/2360] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:31:59 2022] PUT /identity/v3/projects/200c893dd8454565b04b039093be2fbe/users/8a1fc3310ad849e1bac3d864c686f640/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:31:59.244986 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f1054-7eac-4ee8-9dd6-1507bc3ada5d None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:59.245537 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f1054-7eac-4ee8-9dd6-1507bc3ada5d None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:59.245984 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f1054-7eac-4ee8-9dd6-1507bc3ada5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:59.275495 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-cd5f1054-7eac-4ee8-9dd6-1507bc3ada5d None None] MFA Rules not processed for user `8a1fc3310ad849e1bac3d864c686f640`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:31:59.276728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cd5f1054-7eac-4ee8-9dd6-1507bc3ada5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:59.345261 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1180/2361] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:31:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:31:59.356836 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fc99c-1d64-45a0-ba91-19e929f025f2 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:31:59.358557 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9b9fc99c-1d64-45a0-ba91-19e929f025f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:31:59.437588 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9fc99c-1d64-45a0-ba91-19e929f025f2 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:31:59.443271 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e98bf-c233-44da-b0dc-3a0959f52a9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:31:59.443980 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e98bf-c233-44da-b0dc-3a0959f52a9d service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:31:59.444249 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e98bf-c233-44da-b0dc-3a0959f52a9d service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:31:59.444531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e98bf-c233-44da-b0dc-3a0959f52a9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:31:59.454143 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e98bf-c233-44da-b0dc-3a0959f52a9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:31:59.455777 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e98bf-c233-44da-b0dc-3a0959f52a9d service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:31:59.465208 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1182/2362] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:31:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:02.298991 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f1054-7eac-4ee8-9dd6-1507bc3ada5d None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:02.383128 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f1054-7eac-4ee8-9dd6-1507bc3ada5d None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:02.388360 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f8ced-4679-4626-8dad-84e40f690419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:02.389768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f8ced-4679-4626-8dad-84e40f690419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:02.390136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f8ced-4679-4626-8dad-84e40f690419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:02.390488 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f8ced-4679-4626-8dad-84e40f690419 admin admin] PATH_INFO: `/v3/users/8a1fc3310ad849e1bac3d864c686f640` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:02.391848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f8ced-4679-4626-8dad-84e40f690419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a1fc3310ad849e1bac3d864c686f640)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:02.393999 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f8ced-4679-4626-8dad-84e40f690419 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:02.470759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-278f8ced-4679-4626-8dad-84e40f690419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a1fc3310ad849e1bac3d864c686f640'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:02.479113 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-278f8ced-4679-4626-8dad-84e40f690419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a1fc3310ad849e1bac3d864c686f640'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:02.495299 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-278f8ced-4679-4626-8dad-84e40f690419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a1fc3310ad849e1bac3d864c686f640'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:02.497601 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:02.505655 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-278f8ced-4679-4626-8dad-84e40f690419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a1fc3310ad849e1bac3d864c686f640'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:02.506552 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-278f8ced-4679-4626-8dad-84e40f690419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a1fc3310ad849e1bac3d864c686f640'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:02.513550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1181/2363] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:02 2022] DELETE /identity/v3/users/8a1fc3310ad849e1bac3d864c686f640 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:02.519237 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853413f7-ca32-4296-9198-52c125ddb9ce None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:02.519789 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853413f7-ca32-4296-9198-52c125ddb9ce None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:02.520216 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853413f7-ca32-4296-9198-52c125ddb9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:02.550707 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-853413f7-ca32-4296-9198-52c125ddb9ce None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:02.552653 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-853413f7-ca32-4296-9198-52c125ddb9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:02.594619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:02.632103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1183/2364] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:02.642124 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f8ced-4679-4626-8dad-84e40f690419 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:02.643812 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-278f8ced-4679-4626-8dad-84e40f690419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:02.703412 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f8ced-4679-4626-8dad-84e40f690419 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:02.708934 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735dce4b-420b-4833-bb76-fb6135d43756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:02.709650 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dce4b-420b-4833-bb76-fb6135d43756 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:02.709961 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dce4b-420b-4833-bb76-fb6135d43756 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:02.710247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dce4b-420b-4833-bb76-fb6135d43756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:02.723461 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735dce4b-420b-4833-bb76-fb6135d43756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:02.724967 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735dce4b-420b-4833-bb76-fb6135d43756 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:02.736263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1182/2365] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:03.039266 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853413f7-ca32-4296-9198-52c125ddb9ce None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:03.040701 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-853413f7-ca32-4296-9198-52c125ddb9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:03.056962 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853413f7-ca32-4296-9198-52c125ddb9ce None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:03.062317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1d704-4469-4527-bf10-c56ce285558c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:03.063456 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1d704-4469-4527-bf10-c56ce285558c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:03.063871 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1d704-4469-4527-bf10-c56ce285558c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:03.064107 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1d704-4469-4527-bf10-c56ce285558c admin admin] PATH_INFO: `/v3/projects/200c893dd8454565b04b039093be2fbe` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:03.066683 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1d704-4469-4527-bf10-c56ce285558c admin admin] RBAC: Authorizing `identity:delete_project(project_id=200c893dd8454565b04b039093be2fbe)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:03.068675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1d704-4469-4527-bf10-c56ce285558c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:03.116262 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7fd1d704-4469-4527-bf10-c56ce285558c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '200c893dd8454565b04b039093be2fbe', 'request_id': 'req-7fd1d704-4469-4527-bf10-c56ce285558c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:03.123261 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7fd1d704-4469-4527-bf10-c56ce285558c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '200c893dd8454565b04b039093be2fbe', 'request_id': 'req-7fd1d704-4469-4527-bf10-c56ce285558c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:03.128749 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7fd1d704-4469-4527-bf10-c56ce285558c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '200c893dd8454565b04b039093be2fbe', 'request_id': 'req-7fd1d704-4469-4527-bf10-c56ce285558c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:03.141677 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7fd1d704-4469-4527-bf10-c56ce285558c admin admin] The token cache is being invalidate because project 200c893dd8454565b04b039093be2fbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:03.141960 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7fd1d704-4469-4527-bf10-c56ce285558c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:03.142644 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7fd1d704-4469-4527-bf10-c56ce285558c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:03.144187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1184/2366] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:03 2022] DELETE /identity/v3/projects/200c893dd8454565b04b039093be2fbe => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:03.149125 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410940ce-4501-48e7-b506-dda11e28f625 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:03.149418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410940ce-4501-48e7-b506-dda11e28f625 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:03.149693 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410940ce-4501-48e7-b506-dda11e28f625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:03.167722 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-410940ce-4501-48e7-b506-dda11e28f625 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:03.168919 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-410940ce-4501-48e7-b506-dda11e28f625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:03.231145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1183/2367] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:03.239190 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92520e1b-d5ad-4670-b07f-7193106c5fc2 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:03.239565 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92520e1b-d5ad-4670-b07f-7193106c5fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:03.239920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92520e1b-d5ad-4670-b07f-7193106c5fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:03.259211 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-92520e1b-d5ad-4670-b07f-7193106c5fc2 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:03.261201 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-92520e1b-d5ad-4670-b07f-7193106c5fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:03.269807 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1185/2368] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:03.274439 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410940ce-4501-48e7-b506-dda11e28f625 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:03.284695 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410940ce-4501-48e7-b506-dda11e28f625 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:03.289573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3fdc8-7333-4404-93c0-375a043880d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:03.290228 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3fdc8-7333-4404-93c0-375a043880d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:03.290547 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3fdc8-7333-4404-93c0-375a043880d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:03.290830 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3fdc8-7333-4404-93c0-375a043880d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:03.291622 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3fdc8-7333-4404-93c0-375a043880d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:32:03.291933 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3fdc8-7333-4404-93c0-375a043880d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:03.294096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3fdc8-7333-4404-93c0-375a043880d6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:03.306185 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1184/2369] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:32:03.311118 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92520e1b-d5ad-4670-b07f-7193106c5fc2 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:03.321022 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92520e1b-d5ad-4670-b07f-7193106c5fc2 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:03.326137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc0fcc-f07c-44ac-814c-7fbcf432d76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:03.327148 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc0fcc-f07c-44ac-814c-7fbcf432d76a admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:03.327148 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc0fcc-f07c-44ac-814c-7fbcf432d76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:03.327406 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc0fcc-f07c-44ac-814c-7fbcf432d76a admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:03.328223 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc0fcc-f07c-44ac-814c-7fbcf432d76a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:03.330127 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc0fcc-f07c-44ac-814c-7fbcf432d76a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:03.357191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1186/2370] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:32:03 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:03.361312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3fdc8-7333-4404-93c0-375a043880d6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:03.371306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3fdc8-7333-4404-93c0-375a043880d6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:03.429011 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267c5aa-d569-4cbc-9a4e-b19ce46469be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:03.429692 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267c5aa-d569-4cbc-9a4e-b19ce46469be admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:03.430033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267c5aa-d569-4cbc-9a4e-b19ce46469be admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:03.430341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267c5aa-d569-4cbc-9a4e-b19ce46469be admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:03.431055 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267c5aa-d569-4cbc-9a4e-b19ce46469be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:03.433096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0267c5aa-d569-4cbc-9a4e-b19ce46469be admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:03.457758 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1185/2371] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:32:03 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:03.461840 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc0fcc-f07c-44ac-814c-7fbcf432d76a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:03.472905 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc0fcc-f07c-44ac-814c-7fbcf432d76a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:03.477577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8103e8-d1e2-4b4d-8d46-7967d2571551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:03.478240 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8103e8-d1e2-4b4d-8d46-7967d2571551 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:03.478561 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8103e8-d1e2-4b4d-8d46-7967d2571551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:03.478841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8103e8-d1e2-4b4d-8d46-7967d2571551 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:03.479608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8103e8-d1e2-4b4d-8d46-7967d2571551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:03.481315 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8103e8-d1e2-4b4d-8d46-7967d2571551 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:03.492957 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1187/2372] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:03.496993 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267c5aa-d569-4cbc-9a4e-b19ce46469be admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:03.506911 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267c5aa-d569-4cbc-9a4e-b19ce46469be admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:03.514176 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ee78e-a869-4d04-bea4-91f2322d2798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:03.514857 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ee78e-a869-4d04-bea4-91f2322d2798 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:03.515142 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ee78e-a869-4d04-bea4-91f2322d2798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:03.515419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ee78e-a869-4d04-bea4-91f2322d2798 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:03.516140 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ee78e-a869-4d04-bea4-91f2322d2798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:03.517755 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ee78e-a869-4d04-bea4-91f2322d2798 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:03.522934 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:03.529612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1186/2373] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:03.533821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8103e8-d1e2-4b4d-8d46-7967d2571551 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:03.545044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8103e8-d1e2-4b4d-8d46-7967d2571551 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:03.549891 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84467678-a0f7-4195-9e88-9ab801c4ea00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:03.550816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84467678-a0f7-4195-9e88-9ab801c4ea00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:03.551095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84467678-a0f7-4195-9e88-9ab801c4ea00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:03.551395 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84467678-a0f7-4195-9e88-9ab801c4ea00 admin admin] PATH_INFO: `/v3/projects/6ef5747b8bdd4bc0930bb7c88c41c85a/users/61427817242446939d006f70627b9c0c/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:03.567133 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84467678-a0f7-4195-9e88-9ab801c4ea00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef5747b8bdd4bc0930bb7c88c41c85a, user_id=61427817242446939d006f70627b9c0c, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:03.569825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84467678-a0f7-4195-9e88-9ab801c4ea00 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:03.584249 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1188/2374] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:03 2022] PUT /identity/v3/projects/6ef5747b8bdd4bc0930bb7c88c41c85a/users/61427817242446939d006f70627b9c0c/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:03.594614 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5242d-64c6-4fb6-9c76-2f3bcb76c2f6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:03.594909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5242d-64c6-4fb6-9c76-2f3bcb76c2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:03.595188 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5242d-64c6-4fb6-9c76-2f3bcb76c2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:03.623291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fdc5242d-64c6-4fb6-9c76-2f3bcb76c2f6 None None] MFA Rules not processed for user `61427817242446939d006f70627b9c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:03.624613 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fdc5242d-64c6-4fb6-9c76-2f3bcb76c2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:03.814129 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1187/2375] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:32:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:03.818643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84467678-a0f7-4195-9e88-9ab801c4ea00 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:03.868982 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:03.881892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84467678-a0f7-4195-9e88-9ab801c4ea00 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:03.887240 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a43fe-67d6-4dad-8136-adc9d21a8586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:03.887952 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a43fe-67d6-4dad-8136-adc9d21a8586 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:03.888237 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a43fe-67d6-4dad-8136-adc9d21a8586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:03.888516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a43fe-67d6-4dad-8136-adc9d21a8586 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:03.889209 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a43fe-67d6-4dad-8136-adc9d21a8586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:03.891251 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a43fe-67d6-4dad-8136-adc9d21a8586 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:03.916415 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1189/2376] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:32:03 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:32:03.921244 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5242d-64c6-4fb6-9c76-2f3bcb76c2f6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:03.932168 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5242d-64c6-4fb6-9c76-2f3bcb76c2f6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:03.989211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a550637-b172-411b-8550-6697f0fca929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:03.989879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a550637-b172-411b-8550-6697f0fca929 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:03.990162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a550637-b172-411b-8550-6697f0fca929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:03.990472 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a550637-b172-411b-8550-6697f0fca929 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:03.991168 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a550637-b172-411b-8550-6697f0fca929 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:03.993061 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a550637-b172-411b-8550-6697f0fca929 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:04.013394 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1188/2377] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:32:03 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:04.017339 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a43fe-67d6-4dad-8136-adc9d21a8586 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:04.028558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a43fe-67d6-4dad-8136-adc9d21a8586 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:04.033313 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dc015-55da-40c9-9b88-86f0f5d1dcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:04.033975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dc015-55da-40c9-9b88-86f0f5d1dcc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:04.034289 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dc015-55da-40c9-9b88-86f0f5d1dcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:04.034594 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dc015-55da-40c9-9b88-86f0f5d1dcc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:04.035583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9dc015-55da-40c9-9b88-86f0f5d1dcc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:04.037180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9dc015-55da-40c9-9b88-86f0f5d1dcc6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:04.048443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1190/2378] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:04.052963 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a550637-b172-411b-8550-6697f0fca929 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:04.063215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a550637-b172-411b-8550-6697f0fca929 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:04.067919 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8bed2-1691-43ee-946f-aeb57830db7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:04.068724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8bed2-1691-43ee-946f-aeb57830db7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:04.068998 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8bed2-1691-43ee-946f-aeb57830db7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:04.069267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8bed2-1691-43ee-946f-aeb57830db7d admin admin] PATH_INFO: `/v3/projects/b74314eacd1647e9ab0c5ce2cd4b6f3c/users/7aa09622f9844fb28790d077aa8aabe2/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:04.084099 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8bed2-1691-43ee-946f-aeb57830db7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74314eacd1647e9ab0c5ce2cd4b6f3c, user_id=7aa09622f9844fb28790d077aa8aabe2, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:04.086723 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8bed2-1691-43ee-946f-aeb57830db7d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:04.101247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1189/2379] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:04 2022] PUT /identity/v3/projects/b74314eacd1647e9ab0c5ce2cd4b6f3c/users/7aa09622f9844fb28790d077aa8aabe2/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:04.105912 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dc015-55da-40c9-9b88-86f0f5d1dcc6 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:04.116720 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dc015-55da-40c9-9b88-86f0f5d1dcc6 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:04.172293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9abbe1-90c7-4cb5-8b0d-5650391bf0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:04.173043 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9abbe1-90c7-4cb5-8b0d-5650391bf0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:04.173357 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9abbe1-90c7-4cb5-8b0d-5650391bf0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:04.173655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9abbe1-90c7-4cb5-8b0d-5650391bf0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:04.174443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9abbe1-90c7-4cb5-8b0d-5650391bf0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:04.176159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9abbe1-90c7-4cb5-8b0d-5650391bf0a2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:04.185951 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1191/2380] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:04.190326 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8bed2-1691-43ee-946f-aeb57830db7d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:04.201260 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8bed2-1691-43ee-946f-aeb57830db7d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:04.206108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc373b-a2fe-4744-9ce0-b27113f44e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:04.207023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc373b-a2fe-4744-9ce0-b27113f44e0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:04.207310 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc373b-a2fe-4744-9ce0-b27113f44e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:04.207587 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc373b-a2fe-4744-9ce0-b27113f44e0c admin admin] PATH_INFO: `/v3/projects/b74314eacd1647e9ab0c5ce2cd4b6f3c/users/7aa09622f9844fb28790d077aa8aabe2/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:04.209580 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc373b-a2fe-4744-9ce0-b27113f44e0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74314eacd1647e9ab0c5ce2cd4b6f3c, user_id=7aa09622f9844fb28790d077aa8aabe2, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:04.212347 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc373b-a2fe-4744-9ce0-b27113f44e0c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:04.223331 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1190/2381] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:04 2022] PUT /identity/v3/projects/b74314eacd1647e9ab0c5ce2cd4b6f3c/users/7aa09622f9844fb28790d077aa8aabe2/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:04.235036 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b1f84-2b3e-4297-a549-11d0c72ab106 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:04.235330 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b1f84-2b3e-4297-a549-11d0c72ab106 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:04.235638 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b1f84-2b3e-4297-a549-11d0c72ab106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:04.263297 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-530b1f84-2b3e-4297-a549-11d0c72ab106 None None] MFA Rules not processed for user `7aa09622f9844fb28790d077aa8aabe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:04.264520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-530b1f84-2b3e-4297-a549-11d0c72ab106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:04.332269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1192/2382] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:32:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:32:04.343835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc373b-a2fe-4744-9ce0-b27113f44e0c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:04.345603 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-79bc373b-a2fe-4744-9ce0-b27113f44e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:04.392814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:04.406591 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc373b-a2fe-4744-9ce0-b27113f44e0c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:04.410618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e62f86-9188-4b8d-8489-ae43ba6b6d5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:04.411524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e62f86-9188-4b8d-8489-ae43ba6b6d5c service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:04.411816 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e62f86-9188-4b8d-8489-ae43ba6b6d5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:04.412093 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e62f86-9188-4b8d-8489-ae43ba6b6d5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:04.422858 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e62f86-9188-4b8d-8489-ae43ba6b6d5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:04.424358 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e62f86-9188-4b8d-8489-ae43ba6b6d5c service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:04.436098 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1191/2383] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:04.509076 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b1f84-2b3e-4297-a549-11d0c72ab106 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:04.519304 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b1f84-2b3e-4297-a549-11d0c72ab106 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:04.523878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6d0a9-2065-4486-98df-bb115b6ff74a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:04.524283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6d0a9-2065-4486-98df-bb115b6ff74a service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:04.524662 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6d0a9-2065-4486-98df-bb115b6ff74a service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:04.525335 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6d0a9-2065-4486-98df-bb115b6ff74a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:04.577387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:04.591809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6d0a9-2065-4486-98df-bb115b6ff74a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:04.593273 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6d0a9-2065-4486-98df-bb115b6ff74a service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:04.602220 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1193/2384] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:14.429929 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:14.598129 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=6 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:37.003210 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e62f86-9188-4b8d-8489-ae43ba6b6d5c service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:37.106948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e62f86-9188-4b8d-8489-ae43ba6b6d5c service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:37.111481 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefd72d-1df2-48b9-80af-834a9a4e8ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:37.112342 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefd72d-1df2-48b9-80af-834a9a4e8ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:37.112626 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefd72d-1df2-48b9-80af-834a9a4e8ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:37.112894 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefd72d-1df2-48b9-80af-834a9a4e8ccc admin admin] PATH_INFO: `/v3/users/61427817242446939d006f70627b9c0c` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:37.114064 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefd72d-1df2-48b9-80af-834a9a4e8ccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=61427817242446939d006f70627b9c0c)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:37.116007 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefd72d-1df2-48b9-80af-834a9a4e8ccc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:37.166586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4aefd72d-1df2-48b9-80af-834a9a4e8ccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61427817242446939d006f70627b9c0c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:37.174626 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4aefd72d-1df2-48b9-80af-834a9a4e8ccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61427817242446939d006f70627b9c0c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:37.186942 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4aefd72d-1df2-48b9-80af-834a9a4e8ccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61427817242446939d006f70627b9c0c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:37.194184 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4aefd72d-1df2-48b9-80af-834a9a4e8ccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61427817242446939d006f70627b9c0c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:37.194878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4aefd72d-1df2-48b9-80af-834a9a4e8ccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61427817242446939d006f70627b9c0c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:37.200809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1192/2385] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:37 2022] DELETE /identity/v3/users/61427817242446939d006f70627b9c0c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:37.205419 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9347e1-cda1-4170-9a63-afc2dc6b48c5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:37.206078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9347e1-cda1-4170-9a63-afc2dc6b48c5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:37.206078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9347e1-cda1-4170-9a63-afc2dc6b48c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:37.257124 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7f9347e1-cda1-4170-9a63-afc2dc6b48c5 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:37.259891 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7f9347e1-cda1-4170-9a63-afc2dc6b48c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:37.324467 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1194/2386] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:37.334571 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefd72d-1df2-48b9-80af-834a9a4e8ccc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:37.335999 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4aefd72d-1df2-48b9-80af-834a9a4e8ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:37.379565 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:37.417397 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefd72d-1df2-48b9-80af-834a9a4e8ccc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:37.421120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92142414-6ea2-4639-b652-858a7f0c3783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:37.421758 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92142414-6ea2-4639-b652-858a7f0c3783 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:37.422038 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92142414-6ea2-4639-b652-858a7f0c3783 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:37.422338 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92142414-6ea2-4639-b652-858a7f0c3783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:37.431616 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92142414-6ea2-4639-b652-858a7f0c3783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:37.433088 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92142414-6ea2-4639-b652-858a7f0c3783 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:37.444058 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1193/2387] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:32:37.840785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9347e1-cda1-4170-9a63-afc2dc6b48c5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:37.842655 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7f9347e1-cda1-4170-9a63-afc2dc6b48c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:37.856067 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9347e1-cda1-4170-9a63-afc2dc6b48c5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:37.861340 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba032292-1048-4382-8f43-d790c96ba520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:37.862213 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba032292-1048-4382-8f43-d790c96ba520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:37.862571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba032292-1048-4382-8f43-d790c96ba520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:37.862993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba032292-1048-4382-8f43-d790c96ba520 admin admin] PATH_INFO: `/v3/projects/6ef5747b8bdd4bc0930bb7c88c41c85a` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:37.864664 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba032292-1048-4382-8f43-d790c96ba520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef5747b8bdd4bc0930bb7c88c41c85a)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:37.866877 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba032292-1048-4382-8f43-d790c96ba520 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:37.922167 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ba032292-1048-4382-8f43-d790c96ba520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef5747b8bdd4bc0930bb7c88c41c85a', 'request_id': 'req-ba032292-1048-4382-8f43-d790c96ba520'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:37.928482 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ba032292-1048-4382-8f43-d790c96ba520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef5747b8bdd4bc0930bb7c88c41c85a', 'request_id': 'req-ba032292-1048-4382-8f43-d790c96ba520'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:37.935658 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ba032292-1048-4382-8f43-d790c96ba520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef5747b8bdd4bc0930bb7c88c41c85a', 'request_id': 'req-ba032292-1048-4382-8f43-d790c96ba520'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:37.951672 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ba032292-1048-4382-8f43-d790c96ba520 admin admin] The token cache is being invalidate because project 6ef5747b8bdd4bc0930bb7c88c41c85a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:37.952002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ba032292-1048-4382-8f43-d790c96ba520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:37.953057 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-ba032292-1048-4382-8f43-d790c96ba520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:37.954758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1195/2388] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:37 2022] DELETE /identity/v3/projects/6ef5747b8bdd4bc0930bb7c88c41c85a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:37.960625 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92142414-6ea2-4639-b652-858a7f0c3783 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:37.972186 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92142414-6ea2-4639-b652-858a7f0c3783 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:38.037930 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea7ce8-1504-4747-910b-726cb2941c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:38.039290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea7ce8-1504-4747-910b-726cb2941c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:38.039724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea7ce8-1504-4747-910b-726cb2941c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:38.040186 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea7ce8-1504-4747-910b-726cb2941c77 admin admin] PATH_INFO: `/v3/users/7aa09622f9844fb28790d077aa8aabe2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:38.042093 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea7ce8-1504-4747-910b-726cb2941c77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aa09622f9844fb28790d077aa8aabe2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:38.045295 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea7ce8-1504-4747-910b-726cb2941c77 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:38.105171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0cea7ce8-1504-4747-910b-726cb2941c77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aa09622f9844fb28790d077aa8aabe2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:38.111925 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0cea7ce8-1504-4747-910b-726cb2941c77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aa09622f9844fb28790d077aa8aabe2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:38.124274 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0cea7ce8-1504-4747-910b-726cb2941c77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aa09622f9844fb28790d077aa8aabe2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:38.132440 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0cea7ce8-1504-4747-910b-726cb2941c77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aa09622f9844fb28790d077aa8aabe2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:38.133146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0cea7ce8-1504-4747-910b-726cb2941c77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aa09622f9844fb28790d077aa8aabe2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:38.139725 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1194/2389] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:37 2022] DELETE /identity/v3/users/7aa09622f9844fb28790d077aa8aabe2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:38.419896 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba032292-1048-4382-8f43-d790c96ba520 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:38.422247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ba032292-1048-4382-8f43-d790c96ba520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:38.439020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba032292-1048-4382-8f43-d790c96ba520 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:38.494342 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:38.501599 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19317cf4-0426-46fd-96ab-ca0f04c859c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:38.502595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19317cf4-0426-46fd-96ab-ca0f04c859c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:38.503847 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19317cf4-0426-46fd-96ab-ca0f04c859c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:38.504221 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19317cf4-0426-46fd-96ab-ca0f04c859c2 admin admin] PATH_INFO: `/v3/projects/b74314eacd1647e9ab0c5ce2cd4b6f3c` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:38.505674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19317cf4-0426-46fd-96ab-ca0f04c859c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b74314eacd1647e9ab0c5ce2cd4b6f3c)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:38.508034 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19317cf4-0426-46fd-96ab-ca0f04c859c2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:38.562096 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-19317cf4-0426-46fd-96ab-ca0f04c859c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b74314eacd1647e9ab0c5ce2cd4b6f3c', 'request_id': 'req-19317cf4-0426-46fd-96ab-ca0f04c859c2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:38.568905 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-19317cf4-0426-46fd-96ab-ca0f04c859c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b74314eacd1647e9ab0c5ce2cd4b6f3c', 'request_id': 'req-19317cf4-0426-46fd-96ab-ca0f04c859c2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:38.575212 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-19317cf4-0426-46fd-96ab-ca0f04c859c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b74314eacd1647e9ab0c5ce2cd4b6f3c', 'request_id': 'req-19317cf4-0426-46fd-96ab-ca0f04c859c2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:38.589498 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-19317cf4-0426-46fd-96ab-ca0f04c859c2 admin admin] The token cache is being invalidate because project b74314eacd1647e9ab0c5ce2cd4b6f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:38.589793 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-19317cf4-0426-46fd-96ab-ca0f04c859c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:38.590479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-19317cf4-0426-46fd-96ab-ca0f04c859c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:38.592106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1196/2390] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:38 2022] DELETE /identity/v3/projects/b74314eacd1647e9ab0c5ce2cd4b6f3c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:38.599695 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65246009-a740-4629-b52c-8b7fd8cb20f4 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:38.600068 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65246009-a740-4629-b52c-8b7fd8cb20f4 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:38.600427 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65246009-a740-4629-b52c-8b7fd8cb20f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:38.651036 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-65246009-a740-4629-b52c-8b7fd8cb20f4 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:38.652256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-65246009-a740-4629-b52c-8b7fd8cb20f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:38.665659 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:38.717626 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1195/2391] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:38.728474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b47fb-b134-4091-a82c-717d74836c58 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:38.728771 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b47fb-b134-4091-a82c-717d74836c58 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:38.729124 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b47fb-b134-4091-a82c-717d74836c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:38.752627 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-836b47fb-b134-4091-a82c-717d74836c58 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:38.754080 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-836b47fb-b134-4091-a82c-717d74836c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:38.765124 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1197/2392] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:32:38.770186 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65246009-a740-4629-b52c-8b7fd8cb20f4 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:38.780648 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65246009-a740-4629-b52c-8b7fd8cb20f4 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:38.790108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b731d2b-e482-4c9c-9734-81bba19e9d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:38.791121 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b731d2b-e482-4c9c-9734-81bba19e9d2a admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:38.791562 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b731d2b-e482-4c9c-9734-81bba19e9d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:38.791957 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b731d2b-e482-4c9c-9734-81bba19e9d2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:38.792948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b731d2b-e482-4c9c-9734-81bba19e9d2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:32:38.793419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b731d2b-e482-4c9c-9734-81bba19e9d2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:38.795567 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b731d2b-e482-4c9c-9734-81bba19e9d2a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:38.810875 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1196/2393] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:32:38.816224 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b47fb-b134-4091-a82c-717d74836c58 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:38.827560 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b47fb-b134-4091-a82c-717d74836c58 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:38.832788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037bc48-c696-40ca-b829-91424de31dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:38.833483 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037bc48-c696-40ca-b829-91424de31dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:38.833838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037bc48-c696-40ca-b829-91424de31dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:38.834142 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037bc48-c696-40ca-b829-91424de31dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:38.835009 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037bc48-c696-40ca-b829-91424de31dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:38.837686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037bc48-c696-40ca-b829-91424de31dd0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:38.872068 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1198/2394] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:32:38 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:38.873449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b731d2b-e482-4c9c-9734-81bba19e9d2a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:38.886679 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b731d2b-e482-4c9c-9734-81bba19e9d2a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:38.952464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ee5ec-4a6d-469f-8a9c-05ba29035361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:38.953139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ee5ec-4a6d-469f-8a9c-05ba29035361 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:38.953423 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ee5ec-4a6d-469f-8a9c-05ba29035361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:38.953703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ee5ec-4a6d-469f-8a9c-05ba29035361 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:38.954440 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ee5ec-4a6d-469f-8a9c-05ba29035361 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:38.956361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ee5ec-4a6d-469f-8a9c-05ba29035361 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:38.987465 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1197/2395] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:32:38 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:32:38.993293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037bc48-c696-40ca-b829-91424de31dd0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:39.004533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037bc48-c696-40ca-b829-91424de31dd0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:39.010102 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41317f33-36d2-45d0-a02f-809b212b7970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:39.010791 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41317f33-36d2-45d0-a02f-809b212b7970 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:39.011073 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41317f33-36d2-45d0-a02f-809b212b7970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:39.011348 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41317f33-36d2-45d0-a02f-809b212b7970 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:39.012066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41317f33-36d2-45d0-a02f-809b212b7970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:39.013656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41317f33-36d2-45d0-a02f-809b212b7970 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:39.025072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1199/2396] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:32:39.029574 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ee5ec-4a6d-469f-8a9c-05ba29035361 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:39.040807 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ee5ec-4a6d-469f-8a9c-05ba29035361 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:39.046695 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e088da6-3dde-4ba1-a728-55d8ef57eb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:39.047601 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e088da6-3dde-4ba1-a728-55d8ef57eb50 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:39.047998 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e088da6-3dde-4ba1-a728-55d8ef57eb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:39.048323 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e088da6-3dde-4ba1-a728-55d8ef57eb50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:39.049358 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e088da6-3dde-4ba1-a728-55d8ef57eb50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:39.051603 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e088da6-3dde-4ba1-a728-55d8ef57eb50 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:39.065834 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1198/2397] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:39.069864 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41317f33-36d2-45d0-a02f-809b212b7970 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:39.082044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41317f33-36d2-45d0-a02f-809b212b7970 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:39.087009 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da585c-3f87-42db-bb6d-4e4d0c1166ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:39.088683 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da585c-3f87-42db-bb6d-4e4d0c1166ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:39.089095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da585c-3f87-42db-bb6d-4e4d0c1166ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:39.089500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da585c-3f87-42db-bb6d-4e4d0c1166ba admin admin] PATH_INFO: `/v3/projects/1b3e615f66144e968476089556784969/users/5e07a41e948641b6860068632299e2bd/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:39.105860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da585c-3f87-42db-bb6d-4e4d0c1166ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b3e615f66144e968476089556784969, user_id=5e07a41e948641b6860068632299e2bd, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:39.108537 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da585c-3f87-42db-bb6d-4e4d0c1166ba admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:39.123403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1200/2398] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:39 2022] PUT /identity/v3/projects/1b3e615f66144e968476089556784969/users/5e07a41e948641b6860068632299e2bd/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:39.141244 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03ed91-bd88-43ae-8a7d-c3c04148205f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:39.141550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03ed91-bd88-43ae-8a7d-c3c04148205f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:39.141831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03ed91-bd88-43ae-8a7d-c3c04148205f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:39.170283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8e03ed91-bd88-43ae-8a7d-c3c04148205f None None] MFA Rules not processed for user `5e07a41e948641b6860068632299e2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:39.171540 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8e03ed91-bd88-43ae-8a7d-c3c04148205f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:39.237950 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1199/2399] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:32:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:39.242669 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da585c-3f87-42db-bb6d-4e4d0c1166ba admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:39.309889 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da585c-3f87-42db-bb6d-4e4d0c1166ba admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:39.314899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83000fd8-dd25-4167-bb97-174ee55f5b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:39.315583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83000fd8-dd25-4167-bb97-174ee55f5b6d admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:39.315911 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83000fd8-dd25-4167-bb97-174ee55f5b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:39.316189 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83000fd8-dd25-4167-bb97-174ee55f5b6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:39.316942 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83000fd8-dd25-4167-bb97-174ee55f5b6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:39.318937 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83000fd8-dd25-4167-bb97-174ee55f5b6d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:39.345593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1201/2400] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:32:39 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:39.350157 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03ed91-bd88-43ae-8a7d-c3c04148205f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:39.362772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03ed91-bd88-43ae-8a7d-c3c04148205f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:39.378580 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:39.433396 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4eb87-f988-40e4-9c75-31becbd66510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:39.434074 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4eb87-f988-40e4-9c75-31becbd66510 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:39.434385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4eb87-f988-40e4-9c75-31becbd66510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:39.434665 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4eb87-f988-40e4-9c75-31becbd66510 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:39.435379 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4eb87-f988-40e4-9c75-31becbd66510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:39.437418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4eb87-f988-40e4-9c75-31becbd66510 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:39.461144 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1200/2401] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:32:39 2022] POST /identity/v3/users => generated 297 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:32:39.466360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83000fd8-dd25-4167-bb97-174ee55f5b6d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:39.478706 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83000fd8-dd25-4167-bb97-174ee55f5b6d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:39.484353 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a11ae7-97f7-4260-9bb1-62aad5009b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:39.485029 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a11ae7-97f7-4260-9bb1-62aad5009b8c admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:39.485328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a11ae7-97f7-4260-9bb1-62aad5009b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:39.485617 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a11ae7-97f7-4260-9bb1-62aad5009b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:39.486378 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a11ae7-97f7-4260-9bb1-62aad5009b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:39.488085 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a11ae7-97f7-4260-9bb1-62aad5009b8c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:39.490615 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:39.500603 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1202/2402] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:39.505864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4eb87-f988-40e4-9c75-31becbd66510 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:39.520696 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4eb87-f988-40e4-9c75-31becbd66510 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:39.527886 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce476e1-73cf-453d-b429-82c38fa3dd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:39.529136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce476e1-73cf-453d-b429-82c38fa3dd6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:39.529573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce476e1-73cf-453d-b429-82c38fa3dd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:39.530018 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce476e1-73cf-453d-b429-82c38fa3dd6d admin admin] PATH_INFO: `/v3/projects/edea8f57474947cca02bdef2cf93d00e/users/2db6418439024c228617941742c219f7/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:39.551350 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce476e1-73cf-453d-b429-82c38fa3dd6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=edea8f57474947cca02bdef2cf93d00e, user_id=2db6418439024c228617941742c219f7, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:39.555285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce476e1-73cf-453d-b429-82c38fa3dd6d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:39.574243 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1201/2403] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:39 2022] PUT /identity/v3/projects/edea8f57474947cca02bdef2cf93d00e/users/2db6418439024c228617941742c219f7/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:32:39.579352 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a11ae7-97f7-4260-9bb1-62aad5009b8c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:39.592006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a11ae7-97f7-4260-9bb1-62aad5009b8c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:39.654625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ab78f-7752-463d-be19-ae6b7dfc4f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:39.655301 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ab78f-7752-463d-be19-ae6b7dfc4f0d admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:39.655581 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ab78f-7752-463d-be19-ae6b7dfc4f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:39.655876 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ab78f-7752-463d-be19-ae6b7dfc4f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:39.656588 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ab78f-7752-463d-be19-ae6b7dfc4f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:39.658196 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ab78f-7752-463d-be19-ae6b7dfc4f0d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:39.668728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1203/2404] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:39.673100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce476e1-73cf-453d-b429-82c38fa3dd6d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:39.684081 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce476e1-73cf-453d-b429-82c38fa3dd6d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:39.688936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e0afc-2823-4d8f-b7b8-485b8f0db749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:39.689814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e0afc-2823-4d8f-b7b8-485b8f0db749 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:39.690095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e0afc-2823-4d8f-b7b8-485b8f0db749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:39.690410 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e0afc-2823-4d8f-b7b8-485b8f0db749 admin admin] PATH_INFO: `/v3/projects/edea8f57474947cca02bdef2cf93d00e/users/2db6418439024c228617941742c219f7/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:39.692373 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e0afc-2823-4d8f-b7b8-485b8f0db749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edea8f57474947cca02bdef2cf93d00e, user_id=2db6418439024c228617941742c219f7, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:39.695055 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e0afc-2823-4d8f-b7b8-485b8f0db749 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:39.709403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1202/2405] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:39 2022] PUT /identity/v3/projects/edea8f57474947cca02bdef2cf93d00e/users/2db6418439024c228617941742c219f7/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:39.724121 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd8fe1-ef3f-4a08-8996-dcdab5f87bcf None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:39.724121 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd8fe1-ef3f-4a08-8996-dcdab5f87bcf None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:39.724121 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd8fe1-ef3f-4a08-8996-dcdab5f87bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:39.752754 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-43fd8fe1-ef3f-4a08-8996-dcdab5f87bcf None None] MFA Rules not processed for user `2db6418439024c228617941742c219f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:39.754006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-43fd8fe1-ef3f-4a08-8996-dcdab5f87bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:39.828456 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1204/2406] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:32:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:39.839965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e0afc-2823-4d8f-b7b8-485b8f0db749 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:39.841878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-548e0afc-2823-4d8f-b7b8-485b8f0db749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:39.902396 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e0afc-2823-4d8f-b7b8-485b8f0db749 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:39.906153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7797ea-c2b9-4f22-a094-8d91780c0b23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:39.906834 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7797ea-c2b9-4f22-a094-8d91780c0b23 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:39.907113 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7797ea-c2b9-4f22-a094-8d91780c0b23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:39.907389 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7797ea-c2b9-4f22-a094-8d91780c0b23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:39.917903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7797ea-c2b9-4f22-a094-8d91780c0b23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:39.919363 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7797ea-c2b9-4f22-a094-8d91780c0b23 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:39.929270 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1203/2407] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:40.039339 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd8fe1-ef3f-4a08-8996-dcdab5f87bcf None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:40.050103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd8fe1-ef3f-4a08-8996-dcdab5f87bcf None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:40.054167 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae343a-b7f1-435b-a9d0-9ba42fcbf00b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:40.055312 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae343a-b7f1-435b-a9d0-9ba42fcbf00b service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:40.056290 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae343a-b7f1-435b-a9d0-9ba42fcbf00b service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:40.056776 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae343a-b7f1-435b-a9d0-9ba42fcbf00b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:40.150266 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae343a-b7f1-435b-a9d0-9ba42fcbf00b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:40.152306 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae343a-b7f1-435b-a9d0-9ba42fcbf00b service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:40.165864 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1205/2408] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:32:43.849168 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7797ea-c2b9-4f22-a094-8d91780c0b23 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:43.922741 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7797ea-c2b9-4f22-a094-8d91780c0b23 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:43.928622 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1048a-647c-46ca-ac2c-bdc65c4f417a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:43.929482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1048a-647c-46ca-ac2c-bdc65c4f417a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:43.929763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1048a-647c-46ca-ac2c-bdc65c4f417a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:43.930034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1048a-647c-46ca-ac2c-bdc65c4f417a admin admin] PATH_INFO: `/v3/users/5e07a41e948641b6860068632299e2bd` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:43.931809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1048a-647c-46ca-ac2c-bdc65c4f417a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e07a41e948641b6860068632299e2bd)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:43.933696 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1048a-647c-46ca-ac2c-bdc65c4f417a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:43.945978 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:43.993030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-60f1048a-647c-46ca-ac2c-bdc65c4f417a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e07a41e948641b6860068632299e2bd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:44.002262 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-60f1048a-647c-46ca-ac2c-bdc65c4f417a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e07a41e948641b6860068632299e2bd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:44.016022 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-60f1048a-647c-46ca-ac2c-bdc65c4f417a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e07a41e948641b6860068632299e2bd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:44.025072 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-60f1048a-647c-46ca-ac2c-bdc65c4f417a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e07a41e948641b6860068632299e2bd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:44.026037 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-60f1048a-647c-46ca-ac2c-bdc65c4f417a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e07a41e948641b6860068632299e2bd'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:44.033461 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1204/2409] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:43 2022] DELETE /identity/v3/users/5e07a41e948641b6860068632299e2bd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:44.038644 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b7ec7-3ea3-42a4-9870-719a00b61f52 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:44.039124 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b7ec7-3ea3-42a4-9870-719a00b61f52 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:44.039245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b7ec7-3ea3-42a4-9870-719a00b61f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:44.056727 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2a8b7ec7-3ea3-42a4-9870-719a00b61f52 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:44.058074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2a8b7ec7-3ea3-42a4-9870-719a00b61f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:44.072674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:44.127769 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1206/2410] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:44.137656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1048a-647c-46ca-ac2c-bdc65c4f417a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:44.139224 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-60f1048a-647c-46ca-ac2c-bdc65c4f417a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:44.234704 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1048a-647c-46ca-ac2c-bdc65c4f417a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:44.238532 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca41d07-a569-47b8-b295-9b2bb72ccf64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:44.239175 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca41d07-a569-47b8-b295-9b2bb72ccf64 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:44.239456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca41d07-a569-47b8-b295-9b2bb72ccf64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:44.239729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca41d07-a569-47b8-b295-9b2bb72ccf64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:44.249684 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca41d07-a569-47b8-b295-9b2bb72ccf64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:44.251236 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca41d07-a569-47b8-b295-9b2bb72ccf64 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:44.261833 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1205/2411] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:44.569822 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b7ec7-3ea3-42a4-9870-719a00b61f52 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:44.571837 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2a8b7ec7-3ea3-42a4-9870-719a00b61f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:44.588611 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b7ec7-3ea3-42a4-9870-719a00b61f52 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:44.594008 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ddb8b-a34f-4f98-87bc-d8ee3ce8bdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:44.595065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ddb8b-a34f-4f98-87bc-d8ee3ce8bdc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:44.595475 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ddb8b-a34f-4f98-87bc-d8ee3ce8bdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:44.595795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ddb8b-a34f-4f98-87bc-d8ee3ce8bdc1 admin admin] PATH_INFO: `/v3/projects/1b3e615f66144e968476089556784969` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:44.597215 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ddb8b-a34f-4f98-87bc-d8ee3ce8bdc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b3e615f66144e968476089556784969)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:44.599549 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ddb8b-a34f-4f98-87bc-d8ee3ce8bdc1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:44.655792 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-159ddb8b-a34f-4f98-87bc-d8ee3ce8bdc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b3e615f66144e968476089556784969', 'request_id': 'req-159ddb8b-a34f-4f98-87bc-d8ee3ce8bdc1'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:44.663031 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-159ddb8b-a34f-4f98-87bc-d8ee3ce8bdc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b3e615f66144e968476089556784969', 'request_id': 'req-159ddb8b-a34f-4f98-87bc-d8ee3ce8bdc1'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:44.669285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-159ddb8b-a34f-4f98-87bc-d8ee3ce8bdc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b3e615f66144e968476089556784969', 'request_id': 'req-159ddb8b-a34f-4f98-87bc-d8ee3ce8bdc1'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:44.683562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-159ddb8b-a34f-4f98-87bc-d8ee3ce8bdc1 admin admin] The token cache is being invalidate because project 1b3e615f66144e968476089556784969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:44.683853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-159ddb8b-a34f-4f98-87bc-d8ee3ce8bdc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:44.684486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-159ddb8b-a34f-4f98-87bc-d8ee3ce8bdc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:44.686053 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1207/2412] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:44 2022] DELETE /identity/v3/projects/1b3e615f66144e968476089556784969 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:44.690061 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca41d07-a569-47b8-b295-9b2bb72ccf64 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:44.700742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca41d07-a569-47b8-b295-9b2bb72ccf64 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:44.757709 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f266e01-5dd2-4215-a5f3-8125354c533c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:44.759104 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f266e01-5dd2-4215-a5f3-8125354c533c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:44.759382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f266e01-5dd2-4215-a5f3-8125354c533c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:44.759653 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f266e01-5dd2-4215-a5f3-8125354c533c admin admin] PATH_INFO: `/v3/users/2db6418439024c228617941742c219f7` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:44.760883 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f266e01-5dd2-4215-a5f3-8125354c533c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2db6418439024c228617941742c219f7)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:44.762799 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f266e01-5dd2-4215-a5f3-8125354c533c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:44.779433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:44.819456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7f266e01-5dd2-4215-a5f3-8125354c533c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2db6418439024c228617941742c219f7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:44.826776 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7f266e01-5dd2-4215-a5f3-8125354c533c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2db6418439024c228617941742c219f7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:44.839048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7f266e01-5dd2-4215-a5f3-8125354c533c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2db6418439024c228617941742c219f7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:44.847023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7f266e01-5dd2-4215-a5f3-8125354c533c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2db6418439024c228617941742c219f7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:44.847788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-7f266e01-5dd2-4215-a5f3-8125354c533c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2db6418439024c228617941742c219f7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:44.854026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1206/2413] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:44 2022] DELETE /identity/v3/users/2db6418439024c228617941742c219f7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:45.152322 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ddb8b-a34f-4f98-87bc-d8ee3ce8bdc1 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:45.154741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-159ddb8b-a34f-4f98-87bc-d8ee3ce8bdc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:45.178722 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ddb8b-a34f-4f98-87bc-d8ee3ce8bdc1 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:45.237657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb854dee-e558-4d79-8f03-63f65767c3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:45.238565 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb854dee-e558-4d79-8f03-63f65767c3e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:45.238833 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb854dee-e558-4d79-8f03-63f65767c3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:45.239112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb854dee-e558-4d79-8f03-63f65767c3e0 admin admin] PATH_INFO: `/v3/projects/edea8f57474947cca02bdef2cf93d00e` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:45.240308 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb854dee-e558-4d79-8f03-63f65767c3e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edea8f57474947cca02bdef2cf93d00e)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:45.242211 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb854dee-e558-4d79-8f03-63f65767c3e0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:45.289372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:45.294563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-fb854dee-e558-4d79-8f03-63f65767c3e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edea8f57474947cca02bdef2cf93d00e', 'request_id': 'req-fb854dee-e558-4d79-8f03-63f65767c3e0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:45.301611 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-fb854dee-e558-4d79-8f03-63f65767c3e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edea8f57474947cca02bdef2cf93d00e', 'request_id': 'req-fb854dee-e558-4d79-8f03-63f65767c3e0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:45.308559 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-fb854dee-e558-4d79-8f03-63f65767c3e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edea8f57474947cca02bdef2cf93d00e', 'request_id': 'req-fb854dee-e558-4d79-8f03-63f65767c3e0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:45.323386 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-fb854dee-e558-4d79-8f03-63f65767c3e0 admin admin] The token cache is being invalidate because project edea8f57474947cca02bdef2cf93d00e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:45.323841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-fb854dee-e558-4d79-8f03-63f65767c3e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:45.324658 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-fb854dee-e558-4d79-8f03-63f65767c3e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:45.326480 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1208/2414] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:45 2022] DELETE /identity/v3/projects/edea8f57474947cca02bdef2cf93d00e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:45.332040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d57720-c65d-4f39-a0e2-4c980bedb4e9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:45.332355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d57720-c65d-4f39-a0e2-4c980bedb4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:45.332725 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d57720-c65d-4f39-a0e2-4c980bedb4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:45.351870 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-59d57720-c65d-4f39-a0e2-4c980bedb4e9 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:45.353137 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-59d57720-c65d-4f39-a0e2-4c980bedb4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:45.421731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1207/2415] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:45.431475 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81232138-74dc-416f-8166-54312befefea None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:45.431764 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81232138-74dc-416f-8166-54312befefea None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:45.432045 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81232138-74dc-416f-8166-54312befefea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:45.455587 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-81232138-74dc-416f-8166-54312befefea None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:45.456835 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-81232138-74dc-416f-8166-54312befefea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:45.465745 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1209/2416] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:45.470575 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d57720-c65d-4f39-a0e2-4c980bedb4e9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:45.483285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d57720-c65d-4f39-a0e2-4c980bedb4e9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:45.491914 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cac8b8-7c55-4c2f-9e36-f5c585de1126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:45.492524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cac8b8-7c55-4c2f-9e36-f5c585de1126 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:45.492871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cac8b8-7c55-4c2f-9e36-f5c585de1126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:45.493666 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cac8b8-7c55-4c2f-9e36-f5c585de1126 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:45.494494 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cac8b8-7c55-4c2f-9e36-f5c585de1126 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:32:45.494789 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cac8b8-7c55-4c2f-9e36-f5c585de1126 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:45.496405 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cac8b8-7c55-4c2f-9e36-f5c585de1126 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:45.508497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1208/2417] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:32:45.513558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81232138-74dc-416f-8166-54312befefea None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:45.525493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81232138-74dc-416f-8166-54312befefea None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:45.534536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f413e1a-8152-4b3f-846f-7b8d7f778dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:45.535198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f413e1a-8152-4b3f-846f-7b8d7f778dea admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:45.535484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f413e1a-8152-4b3f-846f-7b8d7f778dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:45.535761 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f413e1a-8152-4b3f-846f-7b8d7f778dea admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:45.536452 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f413e1a-8152-4b3f-846f-7b8d7f778dea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:45.538391 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f413e1a-8152-4b3f-846f-7b8d7f778dea admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:45.586184 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1210/2418] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:32:45 2022] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:45.590436 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cac8b8-7c55-4c2f-9e36-f5c585de1126 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:45.604966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cac8b8-7c55-4c2f-9e36-f5c585de1126 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:45.676993 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef4292-ba24-4166-bab9-efcd605f86f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:45.677663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef4292-ba24-4166-bab9-efcd605f86f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:45.678034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef4292-ba24-4166-bab9-efcd605f86f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:45.678357 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef4292-ba24-4166-bab9-efcd605f86f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:45.679081 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef4292-ba24-4166-bab9-efcd605f86f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:45.681752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef4292-ba24-4166-bab9-efcd605f86f2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:45.702798 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1209/2419] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:32:45 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:45.708288 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f413e1a-8152-4b3f-846f-7b8d7f778dea admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:45.719153 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f413e1a-8152-4b3f-846f-7b8d7f778dea admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:45.723851 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57806aec-5663-4e74-9343-3b45b06c6e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:45.724685 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57806aec-5663-4e74-9343-3b45b06c6e00 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:45.724825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57806aec-5663-4e74-9343-3b45b06c6e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:45.725061 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57806aec-5663-4e74-9343-3b45b06c6e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:45.725789 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57806aec-5663-4e74-9343-3b45b06c6e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:45.727939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57806aec-5663-4e74-9343-3b45b06c6e00 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:45.738448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1211/2420] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:32:45.744500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef4292-ba24-4166-bab9-efcd605f86f2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:45.759023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef4292-ba24-4166-bab9-efcd605f86f2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:45.764288 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5445f-f748-4b87-899e-a75dd5632648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:45.764948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5445f-f748-4b87-899e-a75dd5632648 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:45.765226 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5445f-f748-4b87-899e-a75dd5632648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:45.765503 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5445f-f748-4b87-899e-a75dd5632648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:45.766224 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5445f-f748-4b87-899e-a75dd5632648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:45.767820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5445f-f748-4b87-899e-a75dd5632648 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:45.769970 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:45.785095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1210/2421] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:45.790433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57806aec-5663-4e74-9343-3b45b06c6e00 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:45.805129 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57806aec-5663-4e74-9343-3b45b06c6e00 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:45.813307 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea7e32-bc3e-4e57-9bfb-3a2fc25ada25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:45.814541 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea7e32-bc3e-4e57-9bfb-3a2fc25ada25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:45.814925 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea7e32-bc3e-4e57-9bfb-3a2fc25ada25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:45.815410 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea7e32-bc3e-4e57-9bfb-3a2fc25ada25 admin admin] PATH_INFO: `/v3/projects/0dec0adf6b70402c912a3098aa7482ae/users/13a10dbb833849aaaae5d46311367f54/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:45.835850 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea7e32-bc3e-4e57-9bfb-3a2fc25ada25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dec0adf6b70402c912a3098aa7482ae, user_id=13a10dbb833849aaaae5d46311367f54, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:45.838637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea7e32-bc3e-4e57-9bfb-3a2fc25ada25 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:45.853238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1212/2422] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:45 2022] PUT /identity/v3/projects/0dec0adf6b70402c912a3098aa7482ae/users/13a10dbb833849aaaae5d46311367f54/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:45.864810 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b22793-0d76-47ad-b4db-76076afc0a6e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:45.865328 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b22793-0d76-47ad-b4db-76076afc0a6e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:45.865438 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b22793-0d76-47ad-b4db-76076afc0a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:45.896657 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-90b22793-0d76-47ad-b4db-76076afc0a6e None None] MFA Rules not processed for user `13a10dbb833849aaaae5d46311367f54`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:45.898004 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-90b22793-0d76-47ad-b4db-76076afc0a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:45.982966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1211/2423] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:32:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:32:45.989833 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea7e32-bc3e-4e57-9bfb-3a2fc25ada25 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:46.058890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea7e32-bc3e-4e57-9bfb-3a2fc25ada25 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:46.063603 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275d12b-61d4-4f2c-a728-732beb149d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:46.064267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275d12b-61d4-4f2c-a728-732beb149d0b admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:46.064552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275d12b-61d4-4f2c-a728-732beb149d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:46.064833 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275d12b-61d4-4f2c-a728-732beb149d0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:46.065519 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275d12b-61d4-4f2c-a728-732beb149d0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:46.067599 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275d12b-61d4-4f2c-a728-732beb149d0b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:46.103462 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1213/2424] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:32:45 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:46.107926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b22793-0d76-47ad-b4db-76076afc0a6e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:46.119940 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b22793-0d76-47ad-b4db-76076afc0a6e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:46.180028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af7537-2ef0-478b-b3de-f2460b0a411f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:46.181399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af7537-2ef0-478b-b3de-f2460b0a411f admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:46.181684 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af7537-2ef0-478b-b3de-f2460b0a411f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:46.181960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af7537-2ef0-478b-b3de-f2460b0a411f admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:46.182697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af7537-2ef0-478b-b3de-f2460b0a411f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:46.184610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af7537-2ef0-478b-b3de-f2460b0a411f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:46.207674 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1212/2425] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:32:46 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:32:46.212773 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275d12b-61d4-4f2c-a728-732beb149d0b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:46.231693 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275d12b-61d4-4f2c-a728-732beb149d0b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:46.239484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c3c85-efc7-4873-af9e-f0ef65050e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:46.240628 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c3c85-efc7-4873-af9e-f0ef65050e0b admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:46.241135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c3c85-efc7-4873-af9e-f0ef65050e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:46.241792 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c3c85-efc7-4873-af9e-f0ef65050e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:46.243814 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c3c85-efc7-4873-af9e-f0ef65050e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:46.246360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c3c85-efc7-4873-af9e-f0ef65050e0b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:46.258687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1214/2426] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:46.269706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af7537-2ef0-478b-b3de-f2460b0a411f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:46.280315 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af7537-2ef0-478b-b3de-f2460b0a411f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:46.285560 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f8c06-c773-4844-8db1-9a79258274bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:46.286565 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f8c06-c773-4844-8db1-9a79258274bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:46.286875 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f8c06-c773-4844-8db1-9a79258274bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:46.287188 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f8c06-c773-4844-8db1-9a79258274bc admin admin] PATH_INFO: `/v3/projects/f93dddbff6d449c8a61fa7ae09342c50/users/6e789994e7604c4f8ebf9ce321f3859d/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:46.303119 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f8c06-c773-4844-8db1-9a79258274bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93dddbff6d449c8a61fa7ae09342c50, user_id=6e789994e7604c4f8ebf9ce321f3859d, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:46.306407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f8c06-c773-4844-8db1-9a79258274bc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:46.320468 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1213/2427] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:46 2022] PUT /identity/v3/projects/f93dddbff6d449c8a61fa7ae09342c50/users/6e789994e7604c4f8ebf9ce321f3859d/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:46.324431 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c3c85-efc7-4873-af9e-f0ef65050e0b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:46.334788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c3c85-efc7-4873-af9e-f0ef65050e0b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:46.383422 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:46.413194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374b23d-43a4-4207-b221-c08b4c3a7ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:46.413916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374b23d-43a4-4207-b221-c08b4c3a7ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:46.414185 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374b23d-43a4-4207-b221-c08b4c3a7ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:46.414489 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374b23d-43a4-4207-b221-c08b4c3a7ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:46.415727 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374b23d-43a4-4207-b221-c08b4c3a7ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:46.417335 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374b23d-43a4-4207-b221-c08b4c3a7ff6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:46.427768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1215/2428] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:46.433393 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f8c06-c773-4844-8db1-9a79258274bc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:46.444472 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f8c06-c773-4844-8db1-9a79258274bc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:46.450551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adc53e-ab3d-47b2-9cc4-81dd663008cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:46.451454 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adc53e-ab3d-47b2-9cc4-81dd663008cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:46.451736 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adc53e-ab3d-47b2-9cc4-81dd663008cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:46.452015 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adc53e-ab3d-47b2-9cc4-81dd663008cd admin admin] PATH_INFO: `/v3/projects/f93dddbff6d449c8a61fa7ae09342c50/users/6e789994e7604c4f8ebf9ce321f3859d/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:46.454257 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adc53e-ab3d-47b2-9cc4-81dd663008cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93dddbff6d449c8a61fa7ae09342c50, user_id=6e789994e7604c4f8ebf9ce321f3859d, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:46.457001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adc53e-ab3d-47b2-9cc4-81dd663008cd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:46.472396 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1214/2429] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:46 2022] PUT /identity/v3/projects/f93dddbff6d449c8a61fa7ae09342c50/users/6e789994e7604c4f8ebf9ce321f3859d/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:46.484307 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb7cdf-fb5c-4d46-b01a-b686efd16fd1 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:46.484595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb7cdf-fb5c-4d46-b01a-b686efd16fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:46.484868 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb7cdf-fb5c-4d46-b01a-b686efd16fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:46.523386 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a2bb7cdf-fb5c-4d46-b01a-b686efd16fd1 None None] MFA Rules not processed for user `6e789994e7604c4f8ebf9ce321f3859d`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:46.525266 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a2bb7cdf-fb5c-4d46-b01a-b686efd16fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:46.604360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1216/2430] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:32:46 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:46.615772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adc53e-ab3d-47b2-9cc4-81dd663008cd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:46.617526 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-78adc53e-ab3d-47b2-9cc4-81dd663008cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:46.667220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:46.705587 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adc53e-ab3d-47b2-9cc4-81dd663008cd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:46.709509 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e463f-7c4a-4369-89af-2779dfd21c93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:46.710155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e463f-7c4a-4369-89af-2779dfd21c93 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:46.710446 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e463f-7c4a-4369-89af-2779dfd21c93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:46.710800 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e463f-7c4a-4369-89af-2779dfd21c93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:46.720763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e463f-7c4a-4369-89af-2779dfd21c93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:46.722191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e463f-7c4a-4369-89af-2779dfd21c93 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:46.732521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1215/2431] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:46 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:46.821213 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb7cdf-fb5c-4d46-b01a-b686efd16fd1 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:46.831808 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb7cdf-fb5c-4d46-b01a-b686efd16fd1 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:46.835591 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ebf6e-cb73-4a8e-a9f5-76c29cf2219c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:46.836180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ebf6e-cb73-4a8e-a9f5-76c29cf2219c service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:46.837002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ebf6e-cb73-4a8e-a9f5-76c29cf2219c service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:46.837316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ebf6e-cb73-4a8e-a9f5-76c29cf2219c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:46.903195 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ebf6e-cb73-4a8e-a9f5-76c29cf2219c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:46.904783 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ebf6e-cb73-4a8e-a9f5-76c29cf2219c service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:46.915381 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1217/2432] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:51.199813 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc2f2d-efc2-4cc4-8832-4de373f18fa9 None None] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:51.200583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc2f2d-efc2-4cc4-8832-4de373f18fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:51.200583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc2f2d-efc2-4cc4-8832-4de373f18fa9 None None] PATH_INFO: `/` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:51.201906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1216/2433] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 20 19:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:32:51.209165 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb98c86-8e99-4501-8f55-4d6a3a980aad None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:51.210055 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb98c86-8e99-4501-8f55-4d6a3a980aad None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:51.210226 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb98c86-8e99-4501-8f55-4d6a3a980aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:51.248707 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-fcb98c86-8e99-4501-8f55-4d6a3a980aad None None] MFA Rules not processed for user `0c7b88e083d04718bf19d982724babd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:51.250059 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-fcb98c86-8e99-4501-8f55-4d6a3a980aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:51.322369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1218/2434] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 20 19:32:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:51.337761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc2f2d-efc2-4cc4-8832-4de373f18fa9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:51.339769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1efc2f2d-efc2-4cc4-8832-4de373f18fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:51.362771 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc2f2d-efc2-4cc4-8832-4de373f18fa9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:51.366382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6608409-14f5-45ac-8f7c-11564cb07a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:51.367022 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6608409-14f5-45ac-8f7c-11564cb07a8a service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:51.367299 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6608409-14f5-45ac-8f7c-11564cb07a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:51.367603 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6608409-14f5-45ac-8f7c-11564cb07a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:51.375918 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6608409-14f5-45ac-8f7c-11564cb07a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:51.377403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6608409-14f5-45ac-8f7c-11564cb07a8a service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:51.388824 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1217/2435] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:51.473835 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399da51a-9f60-43bb-bdd8-4b5169fd5990 None None] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:51.474124 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399da51a-9f60-43bb-bdd8-4b5169fd5990 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:51.474605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399da51a-9f60-43bb-bdd8-4b5169fd5990 None None] PATH_INFO: `/` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:51.476196 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1219/2436] 10.222.0.18 () {54 vars in 921 bytes} [Wed Jul 20 19:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 19:32:51.482982 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89456cf-488e-4c9f-a184-c0ea9472613c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:51.483269 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89456cf-488e-4c9f-a184-c0ea9472613c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:51.483551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89456cf-488e-4c9f-a184-c0ea9472613c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:51.520389 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d89456cf-488e-4c9f-a184-c0ea9472613c None None] MFA Rules not processed for user `a1f0f6bc94de4645a8c82038ff2bd34a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:51.521611 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d89456cf-488e-4c9f-a184-c0ea9472613c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:51.607575 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1218/2437] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Jul 20 19:32:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:32:51.618811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399da51a-9f60-43bb-bdd8-4b5169fd5990 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:51.624379 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:51.647561 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399da51a-9f60-43bb-bdd8-4b5169fd5990 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:51.651496 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d2343-e7e8-462a-a42f-a75830baea45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:51.652172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d2343-e7e8-462a-a42f-a75830baea45 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:51.652455 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d2343-e7e8-462a-a42f-a75830baea45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:51.652731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d2343-e7e8-462a-a42f-a75830baea45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:51.672920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d2343-e7e8-462a-a42f-a75830baea45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:51.674400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d2343-e7e8-462a-a42f-a75830baea45 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:51.687017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1220/2438] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:51.881268 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89456cf-488e-4c9f-a184-c0ea9472613c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:51.957472 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89456cf-488e-4c9f-a184-c0ea9472613c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:51.962035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca70db5-9bec-45a5-bdd7-0d577ea487fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:51.962922 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca70db5-9bec-45a5-bdd7-0d577ea487fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:51.963199 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca70db5-9bec-45a5-bdd7-0d577ea487fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:51.963467 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca70db5-9bec-45a5-bdd7-0d577ea487fe admin admin] PATH_INFO: `/v3/users/13a10dbb833849aaaae5d46311367f54` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:51.964645 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca70db5-9bec-45a5-bdd7-0d577ea487fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a10dbb833849aaaae5d46311367f54)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:51.966592 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca70db5-9bec-45a5-bdd7-0d577ea487fe admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:51.983959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:52.022795 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4ca70db5-9bec-45a5-bdd7-0d577ea487fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a10dbb833849aaaae5d46311367f54'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:52.030943 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4ca70db5-9bec-45a5-bdd7-0d577ea487fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a10dbb833849aaaae5d46311367f54'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:52.044531 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4ca70db5-9bec-45a5-bdd7-0d577ea487fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a10dbb833849aaaae5d46311367f54'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:52.052181 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4ca70db5-9bec-45a5-bdd7-0d577ea487fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a10dbb833849aaaae5d46311367f54'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:52.053361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4ca70db5-9bec-45a5-bdd7-0d577ea487fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a10dbb833849aaaae5d46311367f54'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:52.060428 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1219/2439] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:51 2022] DELETE /identity/v3/users/13a10dbb833849aaaae5d46311367f54 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:52.065945 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d574668-f47c-44b8-979d-aea98f7487d0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:52.066225 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d574668-f47c-44b8-979d-aea98f7487d0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:52.066551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d574668-f47c-44b8-979d-aea98f7487d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:52.086237 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1d574668-f47c-44b8-979d-aea98f7487d0 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:52.087490 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1d574668-f47c-44b8-979d-aea98f7487d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:52.160466 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1221/2440] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:52.170947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca70db5-9bec-45a5-bdd7-0d577ea487fe admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:52.172374 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4ca70db5-9bec-45a5-bdd7-0d577ea487fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:52.234590 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca70db5-9bec-45a5-bdd7-0d577ea487fe admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:52.238581 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274cbf9-1296-445a-b0c8-e37018055349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:52.239235 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274cbf9-1296-445a-b0c8-e37018055349 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:52.239513 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274cbf9-1296-445a-b0c8-e37018055349 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:52.239786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274cbf9-1296-445a-b0c8-e37018055349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:52.252454 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274cbf9-1296-445a-b0c8-e37018055349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:52.254447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5274cbf9-1296-445a-b0c8-e37018055349 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:52.266142 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1220/2441] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:52.601890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d574668-f47c-44b8-979d-aea98f7487d0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:52.604191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1d574668-f47c-44b8-979d-aea98f7487d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:52.616690 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d574668-f47c-44b8-979d-aea98f7487d0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:52.634534 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e92bf-8468-4176-b425-55d7f8365f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:52.635438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e92bf-8468-4176-b425-55d7f8365f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:52.635720 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e92bf-8468-4176-b425-55d7f8365f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:52.636000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e92bf-8468-4176-b425-55d7f8365f22 admin admin] PATH_INFO: `/v3/projects/0dec0adf6b70402c912a3098aa7482ae` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:52.637329 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e92bf-8468-4176-b425-55d7f8365f22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dec0adf6b70402c912a3098aa7482ae)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:52.639231 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e92bf-8468-4176-b425-55d7f8365f22 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:52.691673 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8e8e92bf-8468-4176-b425-55d7f8365f22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dec0adf6b70402c912a3098aa7482ae', 'request_id': 'req-8e8e92bf-8468-4176-b425-55d7f8365f22'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:52.699614 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8e8e92bf-8468-4176-b425-55d7f8365f22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dec0adf6b70402c912a3098aa7482ae', 'request_id': 'req-8e8e92bf-8468-4176-b425-55d7f8365f22'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:52.710329 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8e8e92bf-8468-4176-b425-55d7f8365f22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dec0adf6b70402c912a3098aa7482ae', 'request_id': 'req-8e8e92bf-8468-4176-b425-55d7f8365f22'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:52.723731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8e8e92bf-8468-4176-b425-55d7f8365f22 admin admin] The token cache is being invalidate because project 0dec0adf6b70402c912a3098aa7482ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:52.724022 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8e8e92bf-8468-4176-b425-55d7f8365f22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:52.724667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8e8e92bf-8468-4176-b425-55d7f8365f22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:52.726269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1222/2442] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:52 2022] DELETE /identity/v3/projects/0dec0adf6b70402c912a3098aa7482ae => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:52.730664 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274cbf9-1296-445a-b0c8-e37018055349 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:52.740739 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274cbf9-1296-445a-b0c8-e37018055349 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:52.806472 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bbf21-16bf-49dc-aaec-a1ca045d53cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:52.807371 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bbf21-16bf-49dc-aaec-a1ca045d53cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:52.807659 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bbf21-16bf-49dc-aaec-a1ca045d53cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:52.807942 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bbf21-16bf-49dc-aaec-a1ca045d53cb admin admin] PATH_INFO: `/v3/users/6e789994e7604c4f8ebf9ce321f3859d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:52.809161 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bbf21-16bf-49dc-aaec-a1ca045d53cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e789994e7604c4f8ebf9ce321f3859d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:52.811163 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bbf21-16bf-49dc-aaec-a1ca045d53cb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:52.853536 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:52.861692 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-252bbf21-16bf-49dc-aaec-a1ca045d53cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e789994e7604c4f8ebf9ce321f3859d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:52.869394 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-252bbf21-16bf-49dc-aaec-a1ca045d53cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e789994e7604c4f8ebf9ce321f3859d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:52.880915 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-252bbf21-16bf-49dc-aaec-a1ca045d53cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e789994e7604c4f8ebf9ce321f3859d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:52.895472 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-252bbf21-16bf-49dc-aaec-a1ca045d53cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e789994e7604c4f8ebf9ce321f3859d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:52.896178 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-252bbf21-16bf-49dc-aaec-a1ca045d53cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e789994e7604c4f8ebf9ce321f3859d'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:52.902654 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1221/2443] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:52 2022] DELETE /identity/v3/users/6e789994e7604c4f8ebf9ce321f3859d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:53.349747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e92bf-8468-4176-b425-55d7f8365f22 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:53.351636 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8e8e92bf-8468-4176-b425-55d7f8365f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:53.368611 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e92bf-8468-4176-b425-55d7f8365f22 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:53.474724 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc123bd-759c-4d71-b081-2e6b99500c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:53.475644 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc123bd-759c-4d71-b081-2e6b99500c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:53.475962 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc123bd-759c-4d71-b081-2e6b99500c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:53.476244 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc123bd-759c-4d71-b081-2e6b99500c68 admin admin] PATH_INFO: `/v3/projects/f93dddbff6d449c8a61fa7ae09342c50` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:53.477683 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc123bd-759c-4d71-b081-2e6b99500c68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f93dddbff6d449c8a61fa7ae09342c50)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:53.479716 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc123bd-759c-4d71-b081-2e6b99500c68 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:53.504094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:53.545454 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8fc123bd-759c-4d71-b081-2e6b99500c68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f93dddbff6d449c8a61fa7ae09342c50', 'request_id': 'req-8fc123bd-759c-4d71-b081-2e6b99500c68'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:53.558523 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8fc123bd-759c-4d71-b081-2e6b99500c68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f93dddbff6d449c8a61fa7ae09342c50', 'request_id': 'req-8fc123bd-759c-4d71-b081-2e6b99500c68'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:53.564940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8fc123bd-759c-4d71-b081-2e6b99500c68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f93dddbff6d449c8a61fa7ae09342c50', 'request_id': 'req-8fc123bd-759c-4d71-b081-2e6b99500c68'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:53.580206 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8fc123bd-759c-4d71-b081-2e6b99500c68 admin admin] The token cache is being invalidate because project f93dddbff6d449c8a61fa7ae09342c50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:53.580497 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8fc123bd-759c-4d71-b081-2e6b99500c68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:53.581268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8fc123bd-759c-4d71-b081-2e6b99500c68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:53.582963 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1223/2444] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:53 2022] DELETE /identity/v3/projects/f93dddbff6d449c8a61fa7ae09342c50 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:53.588005 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d89d35-35ef-4b63-b0f5-8e791294fbb8 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:53.588757 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d89d35-35ef-4b63-b0f5-8e791294fbb8 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:53.588757 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d89d35-35ef-4b63-b0f5-8e791294fbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:53.609693 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-96d89d35-35ef-4b63-b0f5-8e791294fbb8 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:53.611130 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-96d89d35-35ef-4b63-b0f5-8e791294fbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:53.684139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1222/2445] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:53.693657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d21eeb-be70-4cd6-bceb-8d5f5eb11b1b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:53.694277 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d21eeb-be70-4cd6-bceb-8d5f5eb11b1b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:53.694277 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d21eeb-be70-4cd6-bceb-8d5f5eb11b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:53.724336 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c1d21eeb-be70-4cd6-bceb-8d5f5eb11b1b None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:53.726223 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c1d21eeb-be70-4cd6-bceb-8d5f5eb11b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:53.735869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1224/2446] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:53.740149 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d89d35-35ef-4b63-b0f5-8e791294fbb8 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:53.751074 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d89d35-35ef-4b63-b0f5-8e791294fbb8 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:53.756466 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cab46b-c95e-4c04-b32d-8ddb5976a3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:53.757238 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cab46b-c95e-4c04-b32d-8ddb5976a3fd admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:53.757595 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cab46b-c95e-4c04-b32d-8ddb5976a3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:53.758026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cab46b-c95e-4c04-b32d-8ddb5976a3fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:53.759157 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cab46b-c95e-4c04-b32d-8ddb5976a3fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:32:53.759616 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cab46b-c95e-4c04-b32d-8ddb5976a3fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:53.761516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cab46b-c95e-4c04-b32d-8ddb5976a3fd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:53.774759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1223/2447] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:32:53.779185 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d21eeb-be70-4cd6-bceb-8d5f5eb11b1b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:53.790000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d21eeb-be70-4cd6-bceb-8d5f5eb11b1b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:53.795990 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e0c91-7c24-40a0-acab-747f3713cb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:53.796944 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e0c91-7c24-40a0-acab-747f3713cb6b admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:53.797428 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e0c91-7c24-40a0-acab-747f3713cb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:53.797900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e0c91-7c24-40a0-acab-747f3713cb6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:53.798846 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e0c91-7c24-40a0-acab-747f3713cb6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:53.801170 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e0c91-7c24-40a0-acab-747f3713cb6b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:53.829522 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1225/2448] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:32:53 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:53.833547 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cab46b-c95e-4c04-b32d-8ddb5976a3fd admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:53.844481 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cab46b-c95e-4c04-b32d-8ddb5976a3fd admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:53.904470 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d434b-1a75-4d2d-ae7a-f3f6dc4eeff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:53.905100 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d434b-1a75-4d2d-ae7a-f3f6dc4eeff5 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:53.905411 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d434b-1a75-4d2d-ae7a-f3f6dc4eeff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:53.905685 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d434b-1a75-4d2d-ae7a-f3f6dc4eeff5 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:53.906450 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d434b-1a75-4d2d-ae7a-f3f6dc4eeff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:53.908495 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d434b-1a75-4d2d-ae7a-f3f6dc4eeff5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:53.929088 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1224/2449] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:32:53 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:53.934150 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e0c91-7c24-40a0-acab-747f3713cb6b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:53.944437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e0c91-7c24-40a0-acab-747f3713cb6b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:53.949470 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db079db5-c2f4-4894-97cc-df3ed980505c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:53.950343 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db079db5-c2f4-4894-97cc-df3ed980505c admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:53.950667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db079db5-c2f4-4894-97cc-df3ed980505c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:53.951008 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db079db5-c2f4-4894-97cc-df3ed980505c admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:53.951715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db079db5-c2f4-4894-97cc-df3ed980505c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:53.953338 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db079db5-c2f4-4894-97cc-df3ed980505c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:53.964372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1226/2450] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:53.968831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d434b-1a75-4d2d-ae7a-f3f6dc4eeff5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:53.979495 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d434b-1a75-4d2d-ae7a-f3f6dc4eeff5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:53.984122 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1013592-cc86-4ab4-b8dd-874114311752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:53.984777 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1013592-cc86-4ab4-b8dd-874114311752 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:53.985057 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1013592-cc86-4ab4-b8dd-874114311752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:53.985334 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1013592-cc86-4ab4-b8dd-874114311752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:53.986058 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1013592-cc86-4ab4-b8dd-874114311752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:53.987687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1013592-cc86-4ab4-b8dd-874114311752 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:53.998121 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1225/2451] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:54.002855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db079db5-c2f4-4894-97cc-df3ed980505c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:54.013838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db079db5-c2f4-4894-97cc-df3ed980505c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:54.018518 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451ae7b-1b35-4232-a360-262c08e19082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:54.019411 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451ae7b-1b35-4232-a360-262c08e19082 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:54.019695 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451ae7b-1b35-4232-a360-262c08e19082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:54.019971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451ae7b-1b35-4232-a360-262c08e19082 admin admin] PATH_INFO: `/v3/projects/202f7e9f808c43e1b09355c1db35d2b2/users/c67224779f344c4a8cd85a4187af4143/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:54.036592 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451ae7b-1b35-4232-a360-262c08e19082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=202f7e9f808c43e1b09355c1db35d2b2, user_id=c67224779f344c4a8cd85a4187af4143, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:54.039446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451ae7b-1b35-4232-a360-262c08e19082 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:54.053883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1227/2452] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:54 2022] PUT /identity/v3/projects/202f7e9f808c43e1b09355c1db35d2b2/users/c67224779f344c4a8cd85a4187af4143/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:54.066091 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e6106-b20d-43d3-b4d3-fe21c0f6dbf1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:54.066468 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e6106-b20d-43d3-b4d3-fe21c0f6dbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:54.066805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e6106-b20d-43d3-b4d3-fe21c0f6dbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:54.096845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-fd0e6106-b20d-43d3-b4d3-fe21c0f6dbf1 None None] MFA Rules not processed for user `c67224779f344c4a8cd85a4187af4143`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:54.098132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fd0e6106-b20d-43d3-b4d3-fe21c0f6dbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:54.108480 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:54.167244 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1226/2453] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:32:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:54.178639 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451ae7b-1b35-4232-a360-262c08e19082 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:54.180950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b451ae7b-1b35-4232-a360-262c08e19082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:54.238061 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451ae7b-1b35-4232-a360-262c08e19082 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:54.241890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8ceae-520d-4dc4-880e-c596860199b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:54.243082 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8ceae-520d-4dc4-880e-c596860199b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:54.243367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8ceae-520d-4dc4-880e-c596860199b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:54.243648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8ceae-520d-4dc4-880e-c596860199b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:54.253409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8ceae-520d-4dc4-880e-c596860199b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:54.254927 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8ceae-520d-4dc4-880e-c596860199b2 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:54.265964 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1228/2454] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:56.836792 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e6106-b20d-43d3-b4d3-fe21c0f6dbf1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:56.906849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e6106-b20d-43d3-b4d3-fe21c0f6dbf1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:56.912361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69ee4b-72c1-463e-b578-aeeea55ddab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:56.913338 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69ee4b-72c1-463e-b578-aeeea55ddab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:56.913643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69ee4b-72c1-463e-b578-aeeea55ddab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:56.913939 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69ee4b-72c1-463e-b578-aeeea55ddab8 admin admin] PATH_INFO: `/v3/users/c67224779f344c4a8cd85a4187af4143` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:56.915486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69ee4b-72c1-463e-b578-aeeea55ddab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c67224779f344c4a8cd85a4187af4143)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:56.917633 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69ee4b-72c1-463e-b578-aeeea55ddab8 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:56.970742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fb69ee4b-72c1-463e-b578-aeeea55ddab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c67224779f344c4a8cd85a4187af4143'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:56.979056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fb69ee4b-72c1-463e-b578-aeeea55ddab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c67224779f344c4a8cd85a4187af4143'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:56.993388 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fb69ee4b-72c1-463e-b578-aeeea55ddab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c67224779f344c4a8cd85a4187af4143'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:57.001596 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fb69ee4b-72c1-463e-b578-aeeea55ddab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c67224779f344c4a8cd85a4187af4143'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:57.002527 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-fb69ee4b-72c1-463e-b578-aeeea55ddab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c67224779f344c4a8cd85a4187af4143'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:57.009440 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1227/2455] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:32:56 2022] DELETE /identity/v3/users/c67224779f344c4a8cd85a4187af4143 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:57.014095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42444200-08ed-489d-bfe5-cccd04255278 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:57.014711 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42444200-08ed-489d-bfe5-cccd04255278 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:57.014711 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42444200-08ed-489d-bfe5-cccd04255278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:57.034495 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-42444200-08ed-489d-bfe5-cccd04255278 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:57.035748 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-42444200-08ed-489d-bfe5-cccd04255278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:57.080215 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:57.104444 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1229/2456] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:57.114626 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69ee4b-72c1-463e-b578-aeeea55ddab8 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:57.116041 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-fb69ee4b-72c1-463e-b578-aeeea55ddab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:57.155188 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:57.184891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69ee4b-72c1-463e-b578-aeeea55ddab8 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:57.189039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71c87d-825c-428c-abb2-db32ad61e448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:57.189744 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71c87d-825c-428c-abb2-db32ad61e448 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:57.190465 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71c87d-825c-428c-abb2-db32ad61e448 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:57.190465 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71c87d-825c-428c-abb2-db32ad61e448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:57.202194 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71c87d-825c-428c-abb2-db32ad61e448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:57.203841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71c87d-825c-428c-abb2-db32ad61e448 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:57.215528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1228/2457] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:32:57.524906 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42444200-08ed-489d-bfe5-cccd04255278 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:57.527712 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-42444200-08ed-489d-bfe5-cccd04255278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:57.557612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42444200-08ed-489d-bfe5-cccd04255278 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:57.563799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfe4b0-1554-45d0-b248-efba16f7aea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:57.564724 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfe4b0-1554-45d0-b248-efba16f7aea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:57.565017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfe4b0-1554-45d0-b248-efba16f7aea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:57.565362 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfe4b0-1554-45d0-b248-efba16f7aea1 admin admin] PATH_INFO: `/v3/projects/202f7e9f808c43e1b09355c1db35d2b2` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:57.566676 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfe4b0-1554-45d0-b248-efba16f7aea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=202f7e9f808c43e1b09355c1db35d2b2)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:57.568732 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfe4b0-1554-45d0-b248-efba16f7aea1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:57.631933 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4bfe4b0-1554-45d0-b248-efba16f7aea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '202f7e9f808c43e1b09355c1db35d2b2', 'request_id': 'req-d4bfe4b0-1554-45d0-b248-efba16f7aea1'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:57.639495 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4bfe4b0-1554-45d0-b248-efba16f7aea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '202f7e9f808c43e1b09355c1db35d2b2', 'request_id': 'req-d4bfe4b0-1554-45d0-b248-efba16f7aea1'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:57.644640 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4bfe4b0-1554-45d0-b248-efba16f7aea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '202f7e9f808c43e1b09355c1db35d2b2', 'request_id': 'req-d4bfe4b0-1554-45d0-b248-efba16f7aea1'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:57.659963 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4bfe4b0-1554-45d0-b248-efba16f7aea1 admin admin] The token cache is being invalidate because project 202f7e9f808c43e1b09355c1db35d2b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:32:57.660333 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4bfe4b0-1554-45d0-b248-efba16f7aea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:57.661083 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-d4bfe4b0-1554-45d0-b248-efba16f7aea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:32:57.662895 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1230/2458] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:32:57 2022] DELETE /identity/v3/projects/202f7e9f808c43e1b09355c1db35d2b2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:57.669817 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1781b85-85a0-4993-99a4-eedcb07d056e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:57.670222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1781b85-85a0-4993-99a4-eedcb07d056e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:57.671658 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1781b85-85a0-4993-99a4-eedcb07d056e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:57.693560 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-d1781b85-85a0-4993-99a4-eedcb07d056e None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:57.694913 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d1781b85-85a0-4993-99a4-eedcb07d056e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:57.768393 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1229/2459] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:57.779682 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c0056-c534-4d36-9e64-ab9abe21575f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:57.779967 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c0056-c534-4d36-9e64-ab9abe21575f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:57.780247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c0056-c534-4d36-9e64-ab9abe21575f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:57.804725 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-836c0056-c534-4d36-9e64-ab9abe21575f None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:57.805942 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-836c0056-c534-4d36-9e64-ab9abe21575f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:57.816039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1231/2460] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:32:57.820583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1781b85-85a0-4993-99a4-eedcb07d056e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:57.831072 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1781b85-85a0-4993-99a4-eedcb07d056e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:57.835675 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fc442-7fa1-4e90-b993-3ef31515d39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:57.836805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fc442-7fa1-4e90-b993-3ef31515d39c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:57.837828 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fc442-7fa1-4e90-b993-3ef31515d39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:57.837828 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fc442-7fa1-4e90-b993-3ef31515d39c admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:57.838057 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fc442-7fa1-4e90-b993-3ef31515d39c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:32:57.838410 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fc442-7fa1-4e90-b993-3ef31515d39c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:57.839994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fc442-7fa1-4e90-b993-3ef31515d39c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:57.853656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1230/2461] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:32:57.858182 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c0056-c534-4d36-9e64-ab9abe21575f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:57.868468 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c0056-c534-4d36-9e64-ab9abe21575f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:57.873532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175eabc9-197e-45e4-880f-1da3a65b1b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:57.874225 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175eabc9-197e-45e4-880f-1da3a65b1b6b admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:57.874669 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175eabc9-197e-45e4-880f-1da3a65b1b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:57.874954 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175eabc9-197e-45e4-880f-1da3a65b1b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:57.875735 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175eabc9-197e-45e4-880f-1da3a65b1b6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:57.877764 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175eabc9-197e-45e4-880f-1da3a65b1b6b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:57.905847 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1232/2462] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:32:57 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:32:57.911637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fc442-7fa1-4e90-b993-3ef31515d39c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:57.922630 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fc442-7fa1-4e90-b993-3ef31515d39c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:57.979505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c992328-6cad-4383-a6d8-5b2572beed2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:57.980181 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c992328-6cad-4383-a6d8-5b2572beed2e admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:57.980495 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c992328-6cad-4383-a6d8-5b2572beed2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:57.980775 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c992328-6cad-4383-a6d8-5b2572beed2e admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:57.981465 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c992328-6cad-4383-a6d8-5b2572beed2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:57.983430 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c992328-6cad-4383-a6d8-5b2572beed2e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:58.004727 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1231/2463] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:32:57 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:32:58.009749 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175eabc9-197e-45e4-880f-1da3a65b1b6b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:58.021159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175eabc9-197e-45e4-880f-1da3a65b1b6b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:58.026613 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91d1bf-931d-493e-a55e-40d7bbf875bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:58.027629 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91d1bf-931d-493e-a55e-40d7bbf875bd admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:58.027941 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91d1bf-931d-493e-a55e-40d7bbf875bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:58.028295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91d1bf-931d-493e-a55e-40d7bbf875bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:58.029310 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91d1bf-931d-493e-a55e-40d7bbf875bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:58.030966 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d91d1bf-931d-493e-a55e-40d7bbf875bd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:58.042854 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1233/2464] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:32:58.047364 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c992328-6cad-4383-a6d8-5b2572beed2e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:58.058169 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c992328-6cad-4383-a6d8-5b2572beed2e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:58.063138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc957b-d983-4b62-b2bf-43ee31c8639b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:58.063794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc957b-d983-4b62-b2bf-43ee31c8639b admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:58.064076 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc957b-d983-4b62-b2bf-43ee31c8639b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:58.064351 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc957b-d983-4b62-b2bf-43ee31c8639b admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:58.065089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc957b-d983-4b62-b2bf-43ee31c8639b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:58.066742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc957b-d983-4b62-b2bf-43ee31c8639b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:58.077839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1232/2465] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:32:58.082399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91d1bf-931d-493e-a55e-40d7bbf875bd admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:58.092525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91d1bf-931d-493e-a55e-40d7bbf875bd admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:58.097161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bb489-c102-46a4-8981-fc7076e8e124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:58.098038 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bb489-c102-46a4-8981-fc7076e8e124 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:58.098354 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bb489-c102-46a4-8981-fc7076e8e124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:58.098644 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bb489-c102-46a4-8981-fc7076e8e124 admin admin] PATH_INFO: `/v3/projects/e08adda7e2a2443bab4885b21974c66a/users/a30ea1cbc4314bc18489e5e106d751d9/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:58.113360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bb489-c102-46a4-8981-fc7076e8e124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08adda7e2a2443bab4885b21974c66a, user_id=a30ea1cbc4314bc18489e5e106d751d9, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:58.116063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bb489-c102-46a4-8981-fc7076e8e124 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:58.129989 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1234/2466] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:32:58 2022] PUT /identity/v3/projects/e08adda7e2a2443bab4885b21974c66a/users/a30ea1cbc4314bc18489e5e106d751d9/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:32:58.194998 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee719f1-102f-4af9-9dee-5f58d95f53c9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:58.195289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee719f1-102f-4af9-9dee-5f58d95f53c9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:58.195601 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee719f1-102f-4af9-9dee-5f58d95f53c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:58.222452 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-eee719f1-102f-4af9-9dee-5f58d95f53c9 None None] MFA Rules not processed for user `a30ea1cbc4314bc18489e5e106d751d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:32:58.223587 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-eee719f1-102f-4af9-9dee-5f58d95f53c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:58.253924 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:32:58.291702 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1233/2467] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:32:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:32:58.302965 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bb489-c102-46a4-8981-fc7076e8e124 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:32:58.305218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9f6bb489-c102-46a4-8981-fc7076e8e124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:32:58.362008 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bb489-c102-46a4-8981-fc7076e8e124 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:32:58.365631 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb49a87-7478-491e-b731-f947b1e9c7db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:32:58.366278 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb49a87-7478-491e-b731-f947b1e9c7db service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:32:58.366597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb49a87-7478-491e-b731-f947b1e9c7db service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:32:58.366897 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb49a87-7478-491e-b731-f947b1e9c7db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:32:58.376031 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb49a87-7478-491e-b731-f947b1e9c7db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:32:58.377466 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb49a87-7478-491e-b731-f947b1e9c7db service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:32:58.386778 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1235/2468] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:32:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:33:08.288321 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=14 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:08.382903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:08.663046 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee719f1-102f-4af9-9dee-5f58d95f53c9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:08.725255 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee719f1-102f-4af9-9dee-5f58d95f53c9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:08.730758 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca72c34-358e-473c-9d80-3a14b0d3ab71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:08.731651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca72c34-358e-473c-9d80-3a14b0d3ab71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:08.731931 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca72c34-358e-473c-9d80-3a14b0d3ab71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:08.732231 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca72c34-358e-473c-9d80-3a14b0d3ab71 admin admin] PATH_INFO: `/v3/users/a30ea1cbc4314bc18489e5e106d751d9` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:08.733410 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca72c34-358e-473c-9d80-3a14b0d3ab71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a30ea1cbc4314bc18489e5e106d751d9)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:08.735379 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca72c34-358e-473c-9d80-3a14b0d3ab71 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:08.787034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eca72c34-358e-473c-9d80-3a14b0d3ab71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a30ea1cbc4314bc18489e5e106d751d9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:08.793696 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eca72c34-358e-473c-9d80-3a14b0d3ab71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a30ea1cbc4314bc18489e5e106d751d9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:08.805514 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eca72c34-358e-473c-9d80-3a14b0d3ab71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a30ea1cbc4314bc18489e5e106d751d9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:08.816352 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eca72c34-358e-473c-9d80-3a14b0d3ab71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a30ea1cbc4314bc18489e5e106d751d9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:08.817075 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eca72c34-358e-473c-9d80-3a14b0d3ab71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a30ea1cbc4314bc18489e5e106d751d9'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:08.824396 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1234/2469] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:33:08 2022] DELETE /identity/v3/users/a30ea1cbc4314bc18489e5e106d751d9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:33:08.828584 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331572f9-81a2-47c7-a2e4-2e0a3284f17f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:08.828878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331572f9-81a2-47c7-a2e4-2e0a3284f17f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:08.829160 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331572f9-81a2-47c7-a2e4-2e0a3284f17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:08.847519 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-331572f9-81a2-47c7-a2e4-2e0a3284f17f None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:08.848742 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-331572f9-81a2-47c7-a2e4-2e0a3284f17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:08.906944 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1236/2470] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:33:08.917054 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca72c34-358e-473c-9d80-3a14b0d3ab71 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:08.918508 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-eca72c34-358e-473c-9d80-3a14b0d3ab71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:08.975720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca72c34-358e-473c-9d80-3a14b0d3ab71 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:08.979956 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de0f37-477f-43f2-8bba-d06f36f52c47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:08.980603 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de0f37-477f-43f2-8bba-d06f36f52c47 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:08.980886 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de0f37-477f-43f2-8bba-d06f36f52c47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:08.981160 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de0f37-477f-43f2-8bba-d06f36f52c47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:08.991250 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de0f37-477f-43f2-8bba-d06f36f52c47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:08.993275 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de0f37-477f-43f2-8bba-d06f36f52c47 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:09.003006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1235/2471] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:33:09.269678 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331572f9-81a2-47c7-a2e4-2e0a3284f17f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:09.271168 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-331572f9-81a2-47c7-a2e4-2e0a3284f17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:09.284012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331572f9-81a2-47c7-a2e4-2e0a3284f17f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:09.289343 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651b41a-b77d-4c73-a309-6271d85ef738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:09.290204 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651b41a-b77d-4c73-a309-6271d85ef738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:09.290517 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651b41a-b77d-4c73-a309-6271d85ef738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:09.290793 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651b41a-b77d-4c73-a309-6271d85ef738 admin admin] PATH_INFO: `/v3/projects/e08adda7e2a2443bab4885b21974c66a` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:09.291991 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651b41a-b77d-4c73-a309-6271d85ef738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08adda7e2a2443bab4885b21974c66a)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:09.293909 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651b41a-b77d-4c73-a309-6271d85ef738 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:09.342089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e651b41a-b77d-4c73-a309-6271d85ef738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08adda7e2a2443bab4885b21974c66a', 'request_id': 'req-e651b41a-b77d-4c73-a309-6271d85ef738'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:09.348071 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e651b41a-b77d-4c73-a309-6271d85ef738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08adda7e2a2443bab4885b21974c66a', 'request_id': 'req-e651b41a-b77d-4c73-a309-6271d85ef738'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:09.354581 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e651b41a-b77d-4c73-a309-6271d85ef738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08adda7e2a2443bab4885b21974c66a', 'request_id': 'req-e651b41a-b77d-4c73-a309-6271d85ef738'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:09.367247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e651b41a-b77d-4c73-a309-6271d85ef738 admin admin] The token cache is being invalidate because project e08adda7e2a2443bab4885b21974c66a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:33:09.367541 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e651b41a-b77d-4c73-a309-6271d85ef738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:09.368166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e651b41a-b77d-4c73-a309-6271d85ef738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:33:09.369745 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1237/2472] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:33:09 2022] DELETE /identity/v3/projects/e08adda7e2a2443bab4885b21974c66a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:09.374765 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedd58d-4795-4ce2-afd4-ea4bdeeff404 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:09.375360 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedd58d-4795-4ce2-afd4-ea4bdeeff404 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:09.375360 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedd58d-4795-4ce2-afd4-ea4bdeeff404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:09.393431 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-cfedd58d-4795-4ce2-afd4-ea4bdeeff404 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:09.394722 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cfedd58d-4795-4ce2-afd4-ea4bdeeff404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:09.412411 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:09.462039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1236/2473] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:09.469669 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cfa78-2bc6-464e-8fc4-69873b627788 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:09.470227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cfa78-2bc6-464e-8fc4-69873b627788 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:09.470227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cfa78-2bc6-464e-8fc4-69873b627788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:09.489535 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-574cfa78-2bc6-464e-8fc4-69873b627788 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:09.490555 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-574cfa78-2bc6-464e-8fc4-69873b627788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:09.499289 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1238/2474] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:09.503583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedd58d-4795-4ce2-afd4-ea4bdeeff404 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:09.513354 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedd58d-4795-4ce2-afd4-ea4bdeeff404 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:09.517931 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe6938-0b39-4401-84c4-5035dbe585ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:09.518613 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe6938-0b39-4401-84c4-5035dbe585ee admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:09.518899 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe6938-0b39-4401-84c4-5035dbe585ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:09.519174 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe6938-0b39-4401-84c4-5035dbe585ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:09.519900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe6938-0b39-4401-84c4-5035dbe585ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:33:09.520211 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe6938-0b39-4401-84c4-5035dbe585ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:09.521798 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe6938-0b39-4401-84c4-5035dbe585ee admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:09.533855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1237/2475] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:33:09.539016 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cfa78-2bc6-464e-8fc4-69873b627788 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:09.552278 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cfa78-2bc6-464e-8fc4-69873b627788 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:09.558056 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2d593-574c-4f14-8578-e1f0d4581f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:09.558841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2d593-574c-4f14-8578-e1f0d4581f7b admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:09.559224 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2d593-574c-4f14-8578-e1f0d4581f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:09.559536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2d593-574c-4f14-8578-e1f0d4581f7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:09.560308 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2d593-574c-4f14-8578-e1f0d4581f7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:09.562484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2d593-574c-4f14-8578-e1f0d4581f7b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:09.592633 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1239/2476] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:33:09 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:33:09.596931 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe6938-0b39-4401-84c4-5035dbe585ee admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:09.607524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe6938-0b39-4401-84c4-5035dbe585ee admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:09.664496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273df20-3cfe-4722-ab1e-802e68a6ace9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:09.665166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273df20-3cfe-4722-ab1e-802e68a6ace9 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:09.665461 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273df20-3cfe-4722-ab1e-802e68a6ace9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:09.665741 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273df20-3cfe-4722-ab1e-802e68a6ace9 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:09.666461 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e273df20-3cfe-4722-ab1e-802e68a6ace9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:09.668383 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e273df20-3cfe-4722-ab1e-802e68a6ace9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:09.689870 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1238/2477] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:33:09 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:33:09.694020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2d593-574c-4f14-8578-e1f0d4581f7b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:09.704304 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2d593-574c-4f14-8578-e1f0d4581f7b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:09.709299 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020c78e-5494-4d3b-9071-780ff2f4a3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:09.709954 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020c78e-5494-4d3b-9071-780ff2f4a3fd admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:09.710242 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020c78e-5494-4d3b-9071-780ff2f4a3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:09.710561 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020c78e-5494-4d3b-9071-780ff2f4a3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:09.711289 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020c78e-5494-4d3b-9071-780ff2f4a3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:09.712897 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020c78e-5494-4d3b-9071-780ff2f4a3fd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:09.723391 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1240/2478] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:33:09.728255 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273df20-3cfe-4722-ab1e-802e68a6ace9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:09.738407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273df20-3cfe-4722-ab1e-802e68a6ace9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:09.743658 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69b301-f332-4977-9ccf-bc4fa0bccd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:09.744321 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69b301-f332-4977-9ccf-bc4fa0bccd88 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:09.744605 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69b301-f332-4977-9ccf-bc4fa0bccd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:09.744883 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69b301-f332-4977-9ccf-bc4fa0bccd88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:09.745646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69b301-f332-4977-9ccf-bc4fa0bccd88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:09.747291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c69b301-f332-4977-9ccf-bc4fa0bccd88 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:09.758047 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1239/2479] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:33:09.762291 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020c78e-5494-4d3b-9071-780ff2f4a3fd admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:09.772668 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020c78e-5494-4d3b-9071-780ff2f4a3fd admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:09.777849 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ee804-8a0b-40fb-96c2-a1bf7aaa5274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:09.778771 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ee804-8a0b-40fb-96c2-a1bf7aaa5274 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:09.779205 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ee804-8a0b-40fb-96c2-a1bf7aaa5274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:09.779540 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ee804-8a0b-40fb-96c2-a1bf7aaa5274 admin admin] PATH_INFO: `/v3/projects/2e5221f807a54b3b83990a79b8b8520b/users/fd7465e584324715a826e3255ff6f9d0/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:09.796317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ee804-8a0b-40fb-96c2-a1bf7aaa5274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5221f807a54b3b83990a79b8b8520b, user_id=fd7465e584324715a826e3255ff6f9d0, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:09.799002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ee804-8a0b-40fb-96c2-a1bf7aaa5274 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:09.818437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1241/2480] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:33:09 2022] PUT /identity/v3/projects/2e5221f807a54b3b83990a79b8b8520b/users/fd7465e584324715a826e3255ff6f9d0/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:09.824119 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e47459-0976-4120-bde8-a705078b2a81 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:09.824413 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e47459-0976-4120-bde8-a705078b2a81 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:09.824690 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e47459-0976-4120-bde8-a705078b2a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:09.842743 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-22e47459-0976-4120-bde8-a705078b2a81 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:09.843882 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-22e47459-0976-4120-bde8-a705078b2a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:09.902963 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1240/2481] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:09.913212 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ee804-8a0b-40fb-96c2-a1bf7aaa5274 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:09.915017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2e9ee804-8a0b-40fb-96c2-a1bf7aaa5274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:09.937485 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:09.974793 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ee804-8a0b-40fb-96c2-a1bf7aaa5274 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:09.978546 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac2d71-79fd-482c-84cf-b72db0f9cd9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:09.979198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac2d71-79fd-482c-84cf-b72db0f9cd9c service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:09.979484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac2d71-79fd-482c-84cf-b72db0f9cd9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:09.979765 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac2d71-79fd-482c-84cf-b72db0f9cd9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:09.989029 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac2d71-79fd-482c-84cf-b72db0f9cd9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:09.990498 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac2d71-79fd-482c-84cf-b72db0f9cd9c service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:10.000443 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1242/2482] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:33:14.004770 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b25e4-79a4-4918-93f9-edec06970578 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:14.005302 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b25e4-79a4-4918-93f9-edec06970578 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:14.005465 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b25e4-79a4-4918-93f9-edec06970578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:14.034239 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c79b25e4-79a4-4918-93f9-edec06970578 None None] MFA Rules not processed for user `fd7465e584324715a826e3255ff6f9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:14.035509 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c79b25e4-79a4-4918-93f9-edec06970578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:14.053095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:14.104184 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1241/2483] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:33:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:14.108829 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac2d71-79fd-482c-84cf-b72db0f9cd9c service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:14.119558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac2d71-79fd-482c-84cf-b72db0f9cd9c service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:14.125331 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f7212-6f20-4973-9ee5-32c15fad1fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:14.126896 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f7212-6f20-4973-9ee5-32c15fad1fdd admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:14.126896 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f7212-6f20-4973-9ee5-32c15fad1fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:14.126896 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f7212-6f20-4973-9ee5-32c15fad1fdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:14.127803 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f7212-6f20-4973-9ee5-32c15fad1fdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:14.130807 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f7212-6f20-4973-9ee5-32c15fad1fdd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:14.160786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1243/2484] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:33:14 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:33:14.164942 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b25e4-79a4-4918-93f9-edec06970578 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:14.176157 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b25e4-79a4-4918-93f9-edec06970578 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:14.242283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520bdcf-5f61-4280-b2f2-c148bc3ee98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:14.242899 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520bdcf-5f61-4280-b2f2-c148bc3ee98a admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:14.243188 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520bdcf-5f61-4280-b2f2-c148bc3ee98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:14.243470 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520bdcf-5f61-4280-b2f2-c148bc3ee98a admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:14.244212 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520bdcf-5f61-4280-b2f2-c148bc3ee98a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:14.246170 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520bdcf-5f61-4280-b2f2-c148bc3ee98a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:14.267677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1242/2485] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:33:14 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:33:14.271955 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f7212-6f20-4973-9ee5-32c15fad1fdd admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:14.283248 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f7212-6f20-4973-9ee5-32c15fad1fdd admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:14.289013 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db36581-0b30-4874-8da3-5fbb8589614d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:14.289764 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db36581-0b30-4874-8da3-5fbb8589614d admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:14.290129 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db36581-0b30-4874-8da3-5fbb8589614d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:14.290498 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db36581-0b30-4874-8da3-5fbb8589614d admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:14.291303 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db36581-0b30-4874-8da3-5fbb8589614d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:14.293022 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db36581-0b30-4874-8da3-5fbb8589614d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:14.313904 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1244/2486] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:33:14.318600 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520bdcf-5f61-4280-b2f2-c148bc3ee98a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:14.331001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520bdcf-5f61-4280-b2f2-c148bc3ee98a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:14.336300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad03c2-e992-4ef5-bbc3-4e4f3a3411de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:14.337182 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad03c2-e992-4ef5-bbc3-4e4f3a3411de admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:14.337503 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad03c2-e992-4ef5-bbc3-4e4f3a3411de admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:14.337786 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad03c2-e992-4ef5-bbc3-4e4f3a3411de admin admin] PATH_INFO: `/v3/projects/351126bfcac343c885532328acc2c77e/users/443e1c3323ec4ef6960a3d43a7557f01/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:14.356180 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad03c2-e992-4ef5-bbc3-4e4f3a3411de admin admin] RBAC: Authorizing `identity:create_grant(project_id=351126bfcac343c885532328acc2c77e, user_id=443e1c3323ec4ef6960a3d43a7557f01, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:14.358997 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad03c2-e992-4ef5-bbc3-4e4f3a3411de admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:14.373503 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1243/2487] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:33:14 2022] PUT /identity/v3/projects/351126bfcac343c885532328acc2c77e/users/443e1c3323ec4ef6960a3d43a7557f01/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:14.377521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db36581-0b30-4874-8da3-5fbb8589614d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:14.388379 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db36581-0b30-4874-8da3-5fbb8589614d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:14.453540 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059b14d-9678-42d5-baf0-e2773395a4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:14.454217 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059b14d-9678-42d5-baf0-e2773395a4bc admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:14.454547 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059b14d-9678-42d5-baf0-e2773395a4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:14.454827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059b14d-9678-42d5-baf0-e2773395a4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:14.455556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059b14d-9678-42d5-baf0-e2773395a4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:14.457155 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059b14d-9678-42d5-baf0-e2773395a4bc admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:14.468050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1245/2488] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:33:14.472192 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad03c2-e992-4ef5-bbc3-4e4f3a3411de admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:14.482933 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad03c2-e992-4ef5-bbc3-4e4f3a3411de admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:14.487799 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a48b45-7d57-42a7-b370-5fd28f8f6822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:14.488765 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a48b45-7d57-42a7-b370-5fd28f8f6822 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:14.489716 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a48b45-7d57-42a7-b370-5fd28f8f6822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:14.489716 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a48b45-7d57-42a7-b370-5fd28f8f6822 admin admin] PATH_INFO: `/v3/projects/351126bfcac343c885532328acc2c77e/users/443e1c3323ec4ef6960a3d43a7557f01/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:14.491914 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a48b45-7d57-42a7-b370-5fd28f8f6822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=351126bfcac343c885532328acc2c77e, user_id=443e1c3323ec4ef6960a3d43a7557f01, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:14.494648 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a48b45-7d57-42a7-b370-5fd28f8f6822 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:14.505958 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1244/2489] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:33:14 2022] PUT /identity/v3/projects/351126bfcac343c885532328acc2c77e/users/443e1c3323ec4ef6960a3d43a7557f01/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:33:19.269427 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe4200-ae67-4094-9146-caa68976c859 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:19.269957 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe4200-ae67-4094-9146-caa68976c859 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:19.270057 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe4200-ae67-4094-9146-caa68976c859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:19.297557 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f8fe4200-ae67-4094-9146-caa68976c859 None None] MFA Rules not processed for user `443e1c3323ec4ef6960a3d43a7557f01`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:19.298742 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f8fe4200-ae67-4094-9146-caa68976c859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:19.373366 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1246/2490] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:33:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:19.386078 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a48b45-7d57-42a7-b370-5fd28f8f6822 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:19.387887 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e1a48b45-7d57-42a7-b370-5fd28f8f6822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:19.468146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a48b45-7d57-42a7-b370-5fd28f8f6822 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:19.473603 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583e4fb-febb-48b7-8f53-7954e7b5afd9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f646c526a044e8b5b6e74aa64cf6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:19.474281 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583e4fb-febb-48b7-8f53-7954e7b5afd9 service glance] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:19.474791 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583e4fb-febb-48b7-8f53-7954e7b5afd9 service glance] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:19.475087 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583e4fb-febb-48b7-8f53-7954e7b5afd9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:19.503867 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:19.556009 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583e4fb-febb-48b7-8f53-7954e7b5afd9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:19.557453 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583e4fb-febb-48b7-8f53-7954e7b5afd9 service glance] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:19.568018 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1245/2491] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:33:19.723755 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17c13c-84c8-491b-9a3f-b16d7b94b133 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:19.724003 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17c13c-84c8-491b-9a3f-b16d7b94b133 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:19.726415 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17c13c-84c8-491b-9a3f-b16d7b94b133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:19.750708 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0e17c13c-84c8-491b-9a3f-b16d7b94b133 None None] MFA Rules not processed for user `e78792e617d84a7cbb384ed764c391fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:19.752120 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0e17c13c-84c8-491b-9a3f-b16d7b94b133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:19.758418 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:19.826111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1247/2492] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 20 19:33:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:19.883440 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583e4fb-febb-48b7-8f53-7954e7b5afd9 service glance] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:19.885140 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8583e4fb-febb-48b7-8f53-7954e7b5afd9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:19.961034 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583e4fb-febb-48b7-8f53-7954e7b5afd9 service glance] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:19.966515 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a5432-0f1e-41db-8cb7-cbf0eb3c0f95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebd7c59f0014a3886fa75fb35a40e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:19.967176 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a5432-0f1e-41db-8cb7-cbf0eb3c0f95 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:19.967484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a5432-0f1e-41db-8cb7-cbf0eb3c0f95 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:19.967763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a5432-0f1e-41db-8cb7-cbf0eb3c0f95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:19.977369 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a5432-0f1e-41db-8cb7-cbf0eb3c0f95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:19.979162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a5432-0f1e-41db-8cb7-cbf0eb3c0f95 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:19.988299 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1246/2493] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 20 19:33:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:33:27.367874 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17c13c-84c8-491b-9a3f-b16d7b94b133 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:27.369483 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0e17c13c-84c8-491b-9a3f-b16d7b94b133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:27.485575 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17c13c-84c8-491b-9a3f-b16d7b94b133 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:27.491654 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a707dd5-cca1-4bd3-b15f-3e5845a980a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd310799ac43e42bc9c7810e1296ddb9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:27.492376 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a707dd5-cca1-4bd3-b15f-3e5845a980a2 service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:27.492663 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a707dd5-cca1-4bd3-b15f-3e5845a980a2 service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:27.492935 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a707dd5-cca1-4bd3-b15f-3e5845a980a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:27.494786 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4a707dd5-cca1-4bd3-b15f-3e5845a980a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:27.513505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a707dd5-cca1-4bd3-b15f-3e5845a980a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:27.515219 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a707dd5-cca1-4bd3-b15f-3e5845a980a2 service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:27.536517 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1248/2494] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:33:28.632705 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfdc2b-a67e-471b-8c71-5cc0abfc4f03 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:28.633242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfdc2b-a67e-471b-8c71-5cc0abfc4f03 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:28.633343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfdc2b-a67e-471b-8c71-5cc0abfc4f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:28.651561 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3ebfdc2b-a67e-471b-8c71-5cc0abfc4f03 None None] MFA Rules not processed for user `fd7465e584324715a826e3255ff6f9d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:28.652770 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3ebfdc2b-a67e-471b-8c71-5cc0abfc4f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:28.660075 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1247/2495] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:33:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:28.923788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a707dd5-cca1-4bd3-b15f-3e5845a980a2 service placement] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:28.925437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4a707dd5-cca1-4bd3-b15f-3e5845a980a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:28.984530 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a707dd5-cca1-4bd3-b15f-3e5845a980a2 service placement] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:28.988128 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceef3a7-f0ae-45da-afd9-93d51ebc7f3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:28.988807 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceef3a7-f0ae-45da-afd9-93d51ebc7f3c service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:28.989090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceef3a7-f0ae-45da-afd9-93d51ebc7f3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:28.989369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceef3a7-f0ae-45da-afd9-93d51ebc7f3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:28.991209 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7ceef3a7-f0ae-45da-afd9-93d51ebc7f3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:29.000758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceef3a7-f0ae-45da-afd9-93d51ebc7f3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:29.002177 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceef3a7-f0ae-45da-afd9-93d51ebc7f3c service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:29.010596 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1249/2496] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:33:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:33:30.685006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43699a2-1e37-4c48-b246-fac396d25d29 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:30.685544 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43699a2-1e37-4c48-b246-fac396d25d29 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:30.685544 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43699a2-1e37-4c48-b246-fac396d25d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:30.703267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a43699a2-1e37-4c48-b246-fac396d25d29 None None] MFA Rules not processed for user `e78792e617d84a7cbb384ed764c391fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:33:30.704468 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a43699a2-1e37-4c48-b246-fac396d25d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:33:30.712838 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1248/2497] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 20 19:33:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:33:30.724919 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceef3a7-f0ae-45da-afd9-93d51ebc7f3c service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:33:30.736930 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceef3a7-f0ae-45da-afd9-93d51ebc7f3c service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:33:30.742360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612943c-3fe8-49cb-b5d0-0962fd885df7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebd7c59f0014a3886fa75fb35a40e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:33:30.743013 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612943c-3fe8-49cb-b5d0-0962fd885df7 service swift] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:33:30.743291 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612943c-3fe8-49cb-b5d0-0962fd885df7 service swift] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:33:30.743567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612943c-3fe8-49cb-b5d0-0962fd885df7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:33:30.752994 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612943c-3fe8-49cb-b5d0-0962fd885df7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:33:30.754602 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a612943c-3fe8-49cb-b5d0-0962fd885df7 service swift] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:33:30.763747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1250/2498] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 20 19:33:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:33:40.698260 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=54 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:33:40.760720 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=93 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:01.221005 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43699a2-1e37-4c48-b246-fac396d25d29 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:01.230096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43699a2-1e37-4c48-b246-fac396d25d29 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:01.233620 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cf3fb-4955-4254-81d8-d9a0e0911992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:01.234286 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cf3fb-4955-4254-81d8-d9a0e0911992 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:01.234614 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cf3fb-4955-4254-81d8-d9a0e0911992 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:01.234886 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cf3fb-4955-4254-81d8-d9a0e0911992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:01.244155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585cf3fb-4955-4254-81d8-d9a0e0911992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:01.245607 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585cf3fb-4955-4254-81d8-d9a0e0911992 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:01.256114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1249/2499] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:34:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:34:11.250884 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:13.894284 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c971d-580c-4242-ac28-4f005c135b53 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:13.895380 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c971d-580c-4242-ac28-4f005c135b53 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:13.895576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c971d-580c-4242-ac28-4f005c135b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:13.917414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1c3c971d-580c-4242-ac28-4f005c135b53 None None] MFA Rules not processed for user `e78792e617d84a7cbb384ed764c391fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:13.918651 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1c3c971d-580c-4242-ac28-4f005c135b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:13.926728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1251/2500] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 20 19:34:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:13.938978 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cf3fb-4955-4254-81d8-d9a0e0911992 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:13.950533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cf3fb-4955-4254-81d8-d9a0e0911992 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:13.955509 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5fec1-900d-4879-8e90-0cf57d3abda3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebd7c59f0014a3886fa75fb35a40e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:13.956128 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5fec1-900d-4879-8e90-0cf57d3abda3 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:13.956409 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5fec1-900d-4879-8e90-0cf57d3abda3 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:13.957352 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5fec1-900d-4879-8e90-0cf57d3abda3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:13.965318 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5fec1-900d-4879-8e90-0cf57d3abda3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:13.966920 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5fec1-900d-4879-8e90-0cf57d3abda3 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:13.975430 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1250/2501] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 20 19:34:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:34:23.911195 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:23.971857 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=6 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:34.843897 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92208920-c674-498e-8ae4-1abb3fc7d59f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:34.844434 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92208920-c674-498e-8ae4-1abb3fc7d59f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:34.844566 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92208920-c674-498e-8ae4-1abb3fc7d59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:34.861938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-92208920-c674-498e-8ae4-1abb3fc7d59f None None] MFA Rules not processed for user `1198a00eb02c41bc9f3b511f14e4503b`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:34.863768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-92208920-c674-498e-8ae4-1abb3fc7d59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:34.928959 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1252/2502] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:34:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:36.391291 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5fec1-900d-4879-8e90-0cf57d3abda3 service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:36.393472 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-ffc5fec1-900d-4879-8e90-0cf57d3abda3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:36.452059 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5fec1-900d-4879-8e90-0cf57d3abda3 service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:36.455854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68ccc7-54e0-4a98-9a93-829db2319a3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:36.457099 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68ccc7-54e0-4a98-9a93-829db2319a3c service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:36.457387 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68ccc7-54e0-4a98-9a93-829db2319a3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:36.457757 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68ccc7-54e0-4a98-9a93-829db2319a3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:36.459657 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bc68ccc7-54e0-4a98-9a93-829db2319a3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:36.539588 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68ccc7-54e0-4a98-9a93-829db2319a3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:36.541498 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68ccc7-54e0-4a98-9a93-829db2319a3c service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:36.555989 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1251/2503] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:34:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:34:37.719091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92208920-c674-498e-8ae4-1abb3fc7d59f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:37.731662 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92208920-c674-498e-8ae4-1abb3fc7d59f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:37.740072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392096de-c3ac-4ea3-a9e1-3d9ad5e24d78 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f646c526a044e8b5b6e74aa64cf6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:37.741018 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392096de-c3ac-4ea3-a9e1-3d9ad5e24d78 service glance] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:37.741306 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392096de-c3ac-4ea3-a9e1-3d9ad5e24d78 service glance] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:37.741747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392096de-c3ac-4ea3-a9e1-3d9ad5e24d78 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:37.743906 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-392096de-c3ac-4ea3-a9e1-3d9ad5e24d78 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:37.759825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392096de-c3ac-4ea3-a9e1-3d9ad5e24d78 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:37.761993 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392096de-c3ac-4ea3-a9e1-3d9ad5e24d78 service glance] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:37.779212 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1253/2504] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:34:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:34:37.895988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68ccc7-54e0-4a98-9a93-829db2319a3c service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:37.911562 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68ccc7-54e0-4a98-9a93-829db2319a3c service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:37.915731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392096de-c3ac-4ea3-a9e1-3d9ad5e24d78 service glance] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:37.917534 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7f3fb-6e64-4fc7-90b1-b69909b6d387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:37.918417 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7f3fb-6e64-4fc7-90b1-b69909b6d387 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:37.918877 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7f3fb-6e64-4fc7-90b1-b69909b6d387 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:37.919300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7f3fb-6e64-4fc7-90b1-b69909b6d387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:37.922132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-7be7f3fb-6e64-4fc7-90b1-b69909b6d387 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:37.928529 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392096de-c3ac-4ea3-a9e1-3d9ad5e24d78 service glance] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:37.937604 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3b708-e58b-46e7-9ecd-113e9f296d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:37.938274 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3b708-e58b-46e7-9ecd-113e9f296d1a service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:37.938587 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3b708-e58b-46e7-9ecd-113e9f296d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:37.938870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3b708-e58b-46e7-9ecd-113e9f296d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:37.940767 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-74a3b708-e58b-46e7-9ecd-113e9f296d1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:37.954448 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7f3fb-6e64-4fc7-90b1-b69909b6d387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:37.957417 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7f3fb-6e64-4fc7-90b1-b69909b6d387 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:37.960044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3b708-e58b-46e7-9ecd-113e9f296d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:37.961753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3b708-e58b-46e7-9ecd-113e9f296d1a service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:37.972584 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1254/2505] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:34:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:34:37.973773 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1252/2506] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:34:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:34:38.129721 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3b708-e58b-46e7-9ecd-113e9f296d1a service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:38.143502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3b708-e58b-46e7-9ecd-113e9f296d1a service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:38.157555 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567acf9e-8fa5-4d1d-9cf1-c1512c3118c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:38.158669 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567acf9e-8fa5-4d1d-9cf1-c1512c3118c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:38.159062 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567acf9e-8fa5-4d1d-9cf1-c1512c3118c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:38.159986 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567acf9e-8fa5-4d1d-9cf1-c1512c3118c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:38.162603 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-567acf9e-8fa5-4d1d-9cf1-c1512c3118c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:38.179987 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567acf9e-8fa5-4d1d-9cf1-c1512c3118c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:38.181602 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567acf9e-8fa5-4d1d-9cf1-c1512c3118c5 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:38.196799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1255/2507] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:34:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:34:40.007741 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925431c-a149-4be8-b903-62eedde6fe83 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:40.008246 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925431c-a149-4be8-b903-62eedde6fe83 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:40.008334 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925431c-a149-4be8-b903-62eedde6fe83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:40.027687 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e925431c-a149-4be8-b903-62eedde6fe83 None None] MFA Rules not processed for user `e78792e617d84a7cbb384ed764c391fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:40.028942 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e925431c-a149-4be8-b903-62eedde6fe83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:40.036625 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1253/2508] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 20 19:34:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:40.048596 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567acf9e-8fa5-4d1d-9cf1-c1512c3118c5 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:40.060470 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567acf9e-8fa5-4d1d-9cf1-c1512c3118c5 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:40.067998 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e7c17-39ca-4635-bcab-b0fb3b561710 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebd7c59f0014a3886fa75fb35a40e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:40.068778 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e7c17-39ca-4635-bcab-b0fb3b561710 service swift] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:40.069072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e7c17-39ca-4635-bcab-b0fb3b561710 service swift] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:40.069355 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e7c17-39ca-4635-bcab-b0fb3b561710 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:40.078069 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e7c17-39ca-4635-bcab-b0fb3b561710 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:40.079738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e7c17-39ca-4635-bcab-b0fb3b561710 service swift] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:40.087881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1256/2509] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 20 19:34:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:34:42.756863 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925431c-a149-4be8-b903-62eedde6fe83 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:42.766275 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925431c-a149-4be8-b903-62eedde6fe83 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:42.770464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefa982-c66f-470d-aa90-f0a6487092be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:42.771101 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefa982-c66f-470d-aa90-f0a6487092be service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:42.771387 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefa982-c66f-470d-aa90-f0a6487092be service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:42.771666 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefa982-c66f-470d-aa90-f0a6487092be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:42.773450 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-9aefa982-c66f-470d-aa90-f0a6487092be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:42.845052 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefa982-c66f-470d-aa90-f0a6487092be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:42.846521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefa982-c66f-470d-aa90-f0a6487092be service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:42.858511 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1254/2510] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:34:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:34:47.101256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e7c17-39ca-4635-bcab-b0fb3b561710 service swift] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:47.102830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-752e7c17-39ca-4635-bcab-b0fb3b561710 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:47.118347 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e7c17-39ca-4635-bcab-b0fb3b561710 service swift] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:47.121951 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0155f7-30bb-4230-96b3-c645a902de13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:47.122859 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0155f7-30bb-4230-96b3-c645a902de13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:47.123156 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0155f7-30bb-4230-96b3-c645a902de13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:47.123425 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0155f7-30bb-4230-96b3-c645a902de13 admin admin] PATH_INFO: `/v3/users/4eaf9d8ee17e45c99c415e80e72ef868` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:47.140286 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0155f7-30bb-4230-96b3-c645a902de13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eaf9d8ee17e45c99c415e80e72ef868)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:47.142781 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0155f7-30bb-4230-96b3-c645a902de13 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:47.202739 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6e0155f7-30bb-4230-96b3-c645a902de13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eaf9d8ee17e45c99c415e80e72ef868'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:47.210282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6e0155f7-30bb-4230-96b3-c645a902de13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eaf9d8ee17e45c99c415e80e72ef868'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:47.217734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6e0155f7-30bb-4230-96b3-c645a902de13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eaf9d8ee17e45c99c415e80e72ef868'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:47.218539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6e0155f7-30bb-4230-96b3-c645a902de13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eaf9d8ee17e45c99c415e80e72ef868'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:47.219210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6e0155f7-30bb-4230-96b3-c645a902de13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eaf9d8ee17e45c99c415e80e72ef868'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:47.242616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1257/2511] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:34:47 2022] DELETE /identity/v3/users/4eaf9d8ee17e45c99c415e80e72ef868 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:34:47.437133 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefa982-c66f-470d-aa90-f0a6487092be service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:47.448900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefa982-c66f-470d-aa90-f0a6487092be service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:47.465314 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:47.516054 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70890141-b293-497f-b651-6b2a4b5fd9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:47.517368 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70890141-b293-497f-b651-6b2a4b5fd9f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:47.517890 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70890141-b293-497f-b651-6b2a4b5fd9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:47.518417 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70890141-b293-497f-b651-6b2a4b5fd9f6 admin admin] PATH_INFO: `/v3/projects/5eeb1824f10d48e0ae90a55946bb94d9` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:47.530820 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70890141-b293-497f-b651-6b2a4b5fd9f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eeb1824f10d48e0ae90a55946bb94d9)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:47.533165 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70890141-b293-497f-b651-6b2a4b5fd9f6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:47.585999 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-70890141-b293-497f-b651-6b2a4b5fd9f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eeb1824f10d48e0ae90a55946bb94d9', 'request_id': 'req-70890141-b293-497f-b651-6b2a4b5fd9f6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:47.594663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-70890141-b293-497f-b651-6b2a4b5fd9f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eeb1824f10d48e0ae90a55946bb94d9', 'request_id': 'req-70890141-b293-497f-b651-6b2a4b5fd9f6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:47.604902 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-70890141-b293-497f-b651-6b2a4b5fd9f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eeb1824f10d48e0ae90a55946bb94d9', 'request_id': 'req-70890141-b293-497f-b651-6b2a4b5fd9f6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:47.624251 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-70890141-b293-497f-b651-6b2a4b5fd9f6 admin admin] The token cache is being invalidate because project 5eeb1824f10d48e0ae90a55946bb94d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:34:47.624565 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-70890141-b293-497f-b651-6b2a4b5fd9f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:47.625414 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-70890141-b293-497f-b651-6b2a4b5fd9f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:47.627361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1255/2512] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:34:47 2022] DELETE /identity/v3/projects/5eeb1824f10d48e0ae90a55946bb94d9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:34:47.633307 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c12da-3896-4a38-9e1a-48f689c49a2e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:47.633626 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c12da-3896-4a38-9e1a-48f689c49a2e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:47.633933 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c12da-3896-4a38-9e1a-48f689c49a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:47.660818 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1c4c12da-3896-4a38-9e1a-48f689c49a2e None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:47.662195 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1c4c12da-3896-4a38-9e1a-48f689c49a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:47.671386 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:47.742181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1258/2513] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:47.751235 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b8b05-d3f8-49d9-b2c6-09b00a34432a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:47.751521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b8b05-d3f8-49d9-b2c6-09b00a34432a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:47.751806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b8b05-d3f8-49d9-b2c6-09b00a34432a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:47.774709 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-728b8b05-d3f8-49d9-b2c6-09b00a34432a None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:47.776501 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-728b8b05-d3f8-49d9-b2c6-09b00a34432a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:47.792162 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1256/2514] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:47.796539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c12da-3896-4a38-9e1a-48f689c49a2e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:47.809430 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c12da-3896-4a38-9e1a-48f689c49a2e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:47.814531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9502643-38ac-476c-b8e4-3e6e9b665fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:47.815236 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9502643-38ac-476c-b8e4-3e6e9b665fda admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:47.816063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9502643-38ac-476c-b8e4-3e6e9b665fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:47.816360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9502643-38ac-476c-b8e4-3e6e9b665fda admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:47.817201 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9502643-38ac-476c-b8e4-3e6e9b665fda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:34:47.817477 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9502643-38ac-476c-b8e4-3e6e9b665fda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:47.819229 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9502643-38ac-476c-b8e4-3e6e9b665fda admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:47.836793 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b8b05-d3f8-49d9-b2c6-09b00a34432a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:47.842435 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1259/2515] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:34:47.848039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b8b05-d3f8-49d9-b2c6-09b00a34432a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:47.853170 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc50d00-6324-4db0-bb76-80a329fd7daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:47.854181 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc50d00-6324-4db0-bb76-80a329fd7daa admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:47.854513 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc50d00-6324-4db0-bb76-80a329fd7daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:47.854796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc50d00-6324-4db0-bb76-80a329fd7daa admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:47.855977 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc50d00-6324-4db0-bb76-80a329fd7daa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:47.858388 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc50d00-6324-4db0-bb76-80a329fd7daa admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:47.899623 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1257/2516] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:34:47 2022] POST /identity/v3/projects => generated 389 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:34:47.903889 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9502643-38ac-476c-b8e4-3e6e9b665fda admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:47.915062 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9502643-38ac-476c-b8e4-3e6e9b665fda admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:47.994729 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ae4d2-309b-4018-bd98-dca048ed7ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:47.995411 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ae4d2-309b-4018-bd98-dca048ed7ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:47.995851 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ae4d2-309b-4018-bd98-dca048ed7ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:47.996139 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ae4d2-309b-4018-bd98-dca048ed7ff0 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:47.996843 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ae4d2-309b-4018-bd98-dca048ed7ff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:47.998799 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ae4d2-309b-4018-bd98-dca048ed7ff0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:48.024032 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1260/2517] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:34:47 2022] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:34:48.028615 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc50d00-6324-4db0-bb76-80a329fd7daa admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:48.040019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc50d00-6324-4db0-bb76-80a329fd7daa admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:48.044710 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c197ec2-6129-42cb-8529-e9c5dc15adc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:48.045373 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c197ec2-6129-42cb-8529-e9c5dc15adc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:48.045652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c197ec2-6129-42cb-8529-e9c5dc15adc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:48.045925 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c197ec2-6129-42cb-8529-e9c5dc15adc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:48.046683 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c197ec2-6129-42cb-8529-e9c5dc15adc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:48.048283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c197ec2-6129-42cb-8529-e9c5dc15adc6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:48.059430 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1258/2518] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:34:48.063255 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ae4d2-309b-4018-bd98-dca048ed7ff0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:48.075417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ae4d2-309b-4018-bd98-dca048ed7ff0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:48.080314 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1ba08-ffbe-4e04-9a33-efb8e104bb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:48.080986 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1ba08-ffbe-4e04-9a33-efb8e104bb95 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:48.081300 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1ba08-ffbe-4e04-9a33-efb8e104bb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:48.081579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1ba08-ffbe-4e04-9a33-efb8e104bb95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:48.082317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1ba08-ffbe-4e04-9a33-efb8e104bb95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:48.083946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb1ba08-ffbe-4e04-9a33-efb8e104bb95 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:48.095211 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1261/2519] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:34:48.101628 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c197ec2-6129-42cb-8529-e9c5dc15adc6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:48.109559 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c197ec2-6129-42cb-8529-e9c5dc15adc6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:48.114831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235cdec-856c-4600-9a98-96992302a611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:48.115787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235cdec-856c-4600-9a98-96992302a611 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:48.116144 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235cdec-856c-4600-9a98-96992302a611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:48.116503 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235cdec-856c-4600-9a98-96992302a611 admin admin] PATH_INFO: `/v3/projects/bb924630fc7549a6995626fbc65aa0e4/users/61e9c1a1c69940fcab3aee94d1328a39/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:48.132965 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235cdec-856c-4600-9a98-96992302a611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb924630fc7549a6995626fbc65aa0e4, user_id=61e9c1a1c69940fcab3aee94d1328a39, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:48.135748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235cdec-856c-4600-9a98-96992302a611 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:48.150894 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1259/2520] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:34:48 2022] PUT /identity/v3/projects/bb924630fc7549a6995626fbc65aa0e4/users/61e9c1a1c69940fcab3aee94d1328a39/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:34:48.161857 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a373abe-a7a7-4c0a-a69f-d2304927afb8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:48.162598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a373abe-a7a7-4c0a-a69f-d2304927afb8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:48.162598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a373abe-a7a7-4c0a-a69f-d2304927afb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:48.192210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-9a373abe-a7a7-4c0a-a69f-d2304927afb8 None None] MFA Rules not processed for user `61e9c1a1c69940fcab3aee94d1328a39`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:48.193763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9a373abe-a7a7-4c0a-a69f-d2304927afb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:48.272623 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1262/2521] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:34:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:48.277441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235cdec-856c-4600-9a98-96992302a611 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:48.307541 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:48.350366 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235cdec-856c-4600-9a98-96992302a611 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:48.355396 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95ff10-98da-452c-af1c-eb9a460c6d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:48.356172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95ff10-98da-452c-af1c-eb9a460c6d2c admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:48.356533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95ff10-98da-452c-af1c-eb9a460c6d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:48.356913 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95ff10-98da-452c-af1c-eb9a460c6d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:48.357751 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95ff10-98da-452c-af1c-eb9a460c6d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:48.359920 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95ff10-98da-452c-af1c-eb9a460c6d2c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:48.388459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1260/2522] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:34:48 2022] POST /identity/v3/projects => generated 389 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:34:48.392788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a373abe-a7a7-4c0a-a69f-d2304927afb8 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:48.404010 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a373abe-a7a7-4c0a-a69f-d2304927afb8 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:48.409816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:48.466566 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af75f8-cba2-42d9-85ca-771fe1aa3c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:48.467561 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af75f8-cba2-42d9-85ca-771fe1aa3c4b admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:48.467852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af75f8-cba2-42d9-85ca-771fe1aa3c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:48.468241 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af75f8-cba2-42d9-85ca-771fe1aa3c4b admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:48.469114 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af75f8-cba2-42d9-85ca-771fe1aa3c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:48.471548 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af75f8-cba2-42d9-85ca-771fe1aa3c4b admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:48.496640 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1263/2523] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:34:48 2022] POST /identity/v3/users => generated 301 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:34:48.500690 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95ff10-98da-452c-af1c-eb9a460c6d2c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:48.514809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95ff10-98da-452c-af1c-eb9a460c6d2c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:48.520136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e96eab-70aa-4933-9f2e-81aa86a4c681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:48.520832 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e96eab-70aa-4933-9f2e-81aa86a4c681 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:48.521120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e96eab-70aa-4933-9f2e-81aa86a4c681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:48.521400 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e96eab-70aa-4933-9f2e-81aa86a4c681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:48.522138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e96eab-70aa-4933-9f2e-81aa86a4c681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:48.523895 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e96eab-70aa-4933-9f2e-81aa86a4c681 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:48.537524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1261/2524] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:34:48.546631 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af75f8-cba2-42d9-85ca-771fe1aa3c4b admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:48.562638 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af75f8-cba2-42d9-85ca-771fe1aa3c4b admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:48.568985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e6b8b-bbdb-4012-b735-e3f635b6135d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:48.569891 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e6b8b-bbdb-4012-b735-e3f635b6135d admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:48.570181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e6b8b-bbdb-4012-b735-e3f635b6135d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:48.570514 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e6b8b-bbdb-4012-b735-e3f635b6135d admin admin] PATH_INFO: `/v3/projects/afbcb4fb62cc47049fc20941e71560c6/users/87de36a7ace4403bbc159c98f6b6784a/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:48.599339 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e6b8b-bbdb-4012-b735-e3f635b6135d admin admin] RBAC: Authorizing `identity:create_grant(project_id=afbcb4fb62cc47049fc20941e71560c6, user_id=87de36a7ace4403bbc159c98f6b6784a, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:48.602014 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e6b8b-bbdb-4012-b735-e3f635b6135d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:48.615562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1264/2525] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:34:48 2022] PUT /identity/v3/projects/afbcb4fb62cc47049fc20941e71560c6/users/87de36a7ace4403bbc159c98f6b6784a/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:34:48.622090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e96eab-70aa-4933-9f2e-81aa86a4c681 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:48.637499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e96eab-70aa-4933-9f2e-81aa86a4c681 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:48.701759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8e6ed-3533-48aa-b9c8-14f1dbd4991d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:48.702783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8e6ed-3533-48aa-b9c8-14f1dbd4991d admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:48.703066 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8e6ed-3533-48aa-b9c8-14f1dbd4991d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:48.703344 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8e6ed-3533-48aa-b9c8-14f1dbd4991d admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:48.704279 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8e6ed-3533-48aa-b9c8-14f1dbd4991d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:48.707806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8e6ed-3533-48aa-b9c8-14f1dbd4991d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:48.719232 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1262/2526] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:34:48.724206 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e6b8b-bbdb-4012-b735-e3f635b6135d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:48.735752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e6b8b-bbdb-4012-b735-e3f635b6135d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:48.740886 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615e9fc-a38f-413d-9e48-dd266a46e2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:48.741825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615e9fc-a38f-413d-9e48-dd266a46e2dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:48.742117 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615e9fc-a38f-413d-9e48-dd266a46e2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:48.742433 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615e9fc-a38f-413d-9e48-dd266a46e2dc admin admin] PATH_INFO: `/v3/projects/afbcb4fb62cc47049fc20941e71560c6/users/87de36a7ace4403bbc159c98f6b6784a/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:48.744477 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615e9fc-a38f-413d-9e48-dd266a46e2dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=afbcb4fb62cc47049fc20941e71560c6, user_id=87de36a7ace4403bbc159c98f6b6784a, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:48.747419 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615e9fc-a38f-413d-9e48-dd266a46e2dc admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:48.759870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1265/2527] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:34:48 2022] PUT /identity/v3/projects/afbcb4fb62cc47049fc20941e71560c6/users/87de36a7ace4403bbc159c98f6b6784a/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:34:48.772308 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577fd03-13ab-4e01-8654-b9f47a819fdd None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:48.772602 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577fd03-13ab-4e01-8654-b9f47a819fdd None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:48.772888 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577fd03-13ab-4e01-8654-b9f47a819fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:48.814727 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0577fd03-13ab-4e01-8654-b9f47a819fdd None None] MFA Rules not processed for user `87de36a7ace4403bbc159c98f6b6784a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:48.816663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0577fd03-13ab-4e01-8654-b9f47a819fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:48.930322 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1263/2528] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:34:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:48.957835 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615e9fc-a38f-413d-9e48-dd266a46e2dc admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:48.959681 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0615e9fc-a38f-413d-9e48-dd266a46e2dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:49.037981 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615e9fc-a38f-413d-9e48-dd266a46e2dc admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:49.042211 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389fa47-4b0b-48d2-9ae8-e0f8ba8a35e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:49.042892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389fa47-4b0b-48d2-9ae8-e0f8ba8a35e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:49.043358 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389fa47-4b0b-48d2-9ae8-e0f8ba8a35e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:49.043648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389fa47-4b0b-48d2-9ae8-e0f8ba8a35e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:49.055388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389fa47-4b0b-48d2-9ae8-e0f8ba8a35e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:49.056725 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389fa47-4b0b-48d2-9ae8-e0f8ba8a35e0 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:49.074393 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1266/2529] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:34:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:34:49.210499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577fd03-13ab-4e01-8654-b9f47a819fdd None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:49.237661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:49.288194 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577fd03-13ab-4e01-8654-b9f47a819fdd None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:49.293802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be430d8-b283-4825-a2b8-65060a53c006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:49.294720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be430d8-b283-4825-a2b8-65060a53c006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:49.295007 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be430d8-b283-4825-a2b8-65060a53c006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:49.295287 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be430d8-b283-4825-a2b8-65060a53c006 admin admin] PATH_INFO: `/v3/users/61e9c1a1c69940fcab3aee94d1328a39` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:49.296550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be430d8-b283-4825-a2b8-65060a53c006 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61e9c1a1c69940fcab3aee94d1328a39)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:49.298504 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be430d8-b283-4825-a2b8-65060a53c006 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:49.359694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4be430d8-b283-4825-a2b8-65060a53c006 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61e9c1a1c69940fcab3aee94d1328a39'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:49.367132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4be430d8-b283-4825-a2b8-65060a53c006 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61e9c1a1c69940fcab3aee94d1328a39'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:49.380190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4be430d8-b283-4825-a2b8-65060a53c006 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61e9c1a1c69940fcab3aee94d1328a39'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:49.388036 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4be430d8-b283-4825-a2b8-65060a53c006 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61e9c1a1c69940fcab3aee94d1328a39'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:49.388663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4be430d8-b283-4825-a2b8-65060a53c006 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61e9c1a1c69940fcab3aee94d1328a39'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:49.395626 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1264/2530] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:34:49 2022] DELETE /identity/v3/users/61e9c1a1c69940fcab3aee94d1328a39 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:34:49.400134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d763de4-8d2a-48e8-9237-9ee6efa605d9 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:49.400686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d763de4-8d2a-48e8-9237-9ee6efa605d9 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:49.400686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d763de4-8d2a-48e8-9237-9ee6efa605d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:49.420051 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2d763de4-8d2a-48e8-9237-9ee6efa605d9 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:49.421470 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2d763de4-8d2a-48e8-9237-9ee6efa605d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:49.513608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1267/2531] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:49.521312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be430d8-b283-4825-a2b8-65060a53c006 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:49.523734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4be430d8-b283-4825-a2b8-65060a53c006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:49.607007 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be430d8-b283-4825-a2b8-65060a53c006 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:49.611394 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b8e1a-c0b2-420f-aa5e-3b20c93d397c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:49.612032 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b8e1a-c0b2-420f-aa5e-3b20c93d397c service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:49.612352 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b8e1a-c0b2-420f-aa5e-3b20c93d397c service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:49.612669 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b8e1a-c0b2-420f-aa5e-3b20c93d397c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:49.624649 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b8e1a-c0b2-420f-aa5e-3b20c93d397c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:49.625949 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b8e1a-c0b2-420f-aa5e-3b20c93d397c service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:49.637181 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1265/2532] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:34:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:34:49.938882 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d763de4-8d2a-48e8-9237-9ee6efa605d9 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:49.942363 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2d763de4-8d2a-48e8-9237-9ee6efa605d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:49.953418 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:49.958643 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d763de4-8d2a-48e8-9237-9ee6efa605d9 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:49.966767 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c995864-78ef-4d23-b484-539e4645411f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:49.967924 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c995864-78ef-4d23-b484-539e4645411f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:49.968405 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c995864-78ef-4d23-b484-539e4645411f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:49.968940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c995864-78ef-4d23-b484-539e4645411f admin admin] PATH_INFO: `/v3/projects/bb924630fc7549a6995626fbc65aa0e4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:49.970333 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c995864-78ef-4d23-b484-539e4645411f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb924630fc7549a6995626fbc65aa0e4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:49.972605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c995864-78ef-4d23-b484-539e4645411f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:50.047698 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6c995864-78ef-4d23-b484-539e4645411f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb924630fc7549a6995626fbc65aa0e4', 'request_id': 'req-6c995864-78ef-4d23-b484-539e4645411f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:50.056463 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6c995864-78ef-4d23-b484-539e4645411f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb924630fc7549a6995626fbc65aa0e4', 'request_id': 'req-6c995864-78ef-4d23-b484-539e4645411f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:50.062971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6c995864-78ef-4d23-b484-539e4645411f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb924630fc7549a6995626fbc65aa0e4', 'request_id': 'req-6c995864-78ef-4d23-b484-539e4645411f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:50.079406 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6c995864-78ef-4d23-b484-539e4645411f admin admin] The token cache is being invalidate because project bb924630fc7549a6995626fbc65aa0e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:34:50.079695 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6c995864-78ef-4d23-b484-539e4645411f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:50.080337 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-6c995864-78ef-4d23-b484-539e4645411f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:50.081936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1268/2533] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:34:49 2022] DELETE /identity/v3/projects/bb924630fc7549a6995626fbc65aa0e4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:34:50.086009 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b8e1a-c0b2-420f-aa5e-3b20c93d397c service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:50.096399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b8e1a-c0b2-420f-aa5e-3b20c93d397c service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:50.146087 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:50.171683 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdcd7f-b00c-460d-b4d6-321c84423245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:50.172813 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdcd7f-b00c-460d-b4d6-321c84423245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:50.173167 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdcd7f-b00c-460d-b4d6-321c84423245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:50.173560 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdcd7f-b00c-460d-b4d6-321c84423245 admin admin] PATH_INFO: `/v3/users/87de36a7ace4403bbc159c98f6b6784a` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:50.179339 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdcd7f-b00c-460d-b4d6-321c84423245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87de36a7ace4403bbc159c98f6b6784a)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:50.181770 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdcd7f-b00c-460d-b4d6-321c84423245 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:50.270155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d6bdcd7f-b00c-460d-b4d6-321c84423245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87de36a7ace4403bbc159c98f6b6784a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:50.278499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d6bdcd7f-b00c-460d-b4d6-321c84423245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87de36a7ace4403bbc159c98f6b6784a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:50.292191 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d6bdcd7f-b00c-460d-b4d6-321c84423245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87de36a7ace4403bbc159c98f6b6784a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:50.300992 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d6bdcd7f-b00c-460d-b4d6-321c84423245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87de36a7ace4403bbc159c98f6b6784a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:50.304677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d6bdcd7f-b00c-460d-b4d6-321c84423245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87de36a7ace4403bbc159c98f6b6784a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:50.311472 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1266/2534] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:34:50 2022] DELETE /identity/v3/users/87de36a7ace4403bbc159c98f6b6784a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:34:50.630170 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c995864-78ef-4d23-b484-539e4645411f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:50.631789 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-6c995864-78ef-4d23-b484-539e4645411f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:50.645817 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c995864-78ef-4d23-b484-539e4645411f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:50.709210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9245e-4262-44a1-9ef6-1a49ded66ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:50.710080 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9245e-4262-44a1-9ef6-1a49ded66ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:50.710408 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9245e-4262-44a1-9ef6-1a49ded66ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:50.710724 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9245e-4262-44a1-9ef6-1a49ded66ada admin admin] PATH_INFO: `/v3/projects/afbcb4fb62cc47049fc20941e71560c6` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:50.711918 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9245e-4262-44a1-9ef6-1a49ded66ada admin admin] RBAC: Authorizing `identity:delete_project(project_id=afbcb4fb62cc47049fc20941e71560c6)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:50.713878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9245e-4262-44a1-9ef6-1a49ded66ada admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:50.763619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b4d9245e-4262-44a1-9ef6-1a49ded66ada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afbcb4fb62cc47049fc20941e71560c6', 'request_id': 'req-b4d9245e-4262-44a1-9ef6-1a49ded66ada'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:50.770098 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b4d9245e-4262-44a1-9ef6-1a49ded66ada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afbcb4fb62cc47049fc20941e71560c6', 'request_id': 'req-b4d9245e-4262-44a1-9ef6-1a49ded66ada'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:50.775611 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b4d9245e-4262-44a1-9ef6-1a49ded66ada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afbcb4fb62cc47049fc20941e71560c6', 'request_id': 'req-b4d9245e-4262-44a1-9ef6-1a49ded66ada'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:50.789819 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b4d9245e-4262-44a1-9ef6-1a49ded66ada admin admin] The token cache is being invalidate because project afbcb4fb62cc47049fc20941e71560c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:34:50.790094 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b4d9245e-4262-44a1-9ef6-1a49ded66ada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:50.790773 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b4d9245e-4262-44a1-9ef6-1a49ded66ada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:50.792345 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1269/2535] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:34:50 2022] DELETE /identity/v3/projects/afbcb4fb62cc47049fc20941e71560c6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:34:50.797550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadfcf7-eded-461a-9c07-99e631888c7e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:50.798165 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadfcf7-eded-461a-9c07-99e631888c7e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:50.798165 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbadfcf7-eded-461a-9c07-99e631888c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:50.817553 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-bbadfcf7-eded-461a-9c07-99e631888c7e None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:50.818812 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bbadfcf7-eded-461a-9c07-99e631888c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:50.880383 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1267/2536] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:50.889383 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0e650-33e0-45a5-948c-a8e0377a1afc None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:50.889700 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0e650-33e0-45a5-948c-a8e0377a1afc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:50.889983 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0e650-33e0-45a5-948c-a8e0377a1afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:50.910777 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ded0e650-33e0-45a5-948c-a8e0377a1afc None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:50.911919 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ded0e650-33e0-45a5-948c-a8e0377a1afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:50.919920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1270/2537] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:34:50.924902 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbadfcf7-eded-461a-9c07-99e631888c7e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:50.935281 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbadfcf7-eded-461a-9c07-99e631888c7e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:50.939983 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23397e6a-9348-4b22-82b1-89226bf48e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:50.941171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23397e6a-9348-4b22-82b1-89226bf48e88 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:50.941453 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23397e6a-9348-4b22-82b1-89226bf48e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:50.941730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23397e6a-9348-4b22-82b1-89226bf48e88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:50.942505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23397e6a-9348-4b22-82b1-89226bf48e88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:34:50.942813 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23397e6a-9348-4b22-82b1-89226bf48e88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:50.944426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23397e6a-9348-4b22-82b1-89226bf48e88 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:50.965766 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1268/2538] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:34:50.970039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0e650-33e0-45a5-948c-a8e0377a1afc None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:50.979495 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0e650-33e0-45a5-948c-a8e0377a1afc None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:50.984228 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a58c6-a5eb-425c-bdb2-1fdbf281faba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:50.984881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a58c6-a5eb-425c-bdb2-1fdbf281faba admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:50.985165 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a58c6-a5eb-425c-bdb2-1fdbf281faba admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:50.985449 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a58c6-a5eb-425c-bdb2-1fdbf281faba admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:50.986135 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a58c6-a5eb-425c-bdb2-1fdbf281faba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:50.988099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a58c6-a5eb-425c-bdb2-1fdbf281faba admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:50.998958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:51.022604 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1271/2539] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:34:50 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:34:51.023719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23397e6a-9348-4b22-82b1-89226bf48e88 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:51.037266 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23397e6a-9348-4b22-82b1-89226bf48e88 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:51.085230 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:51.098504 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07bdad-1f47-45ca-824c-1fe4e27b4734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:51.099184 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07bdad-1f47-45ca-824c-1fe4e27b4734 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:51.099467 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07bdad-1f47-45ca-824c-1fe4e27b4734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:51.099749 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07bdad-1f47-45ca-824c-1fe4e27b4734 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:51.100496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07bdad-1f47-45ca-824c-1fe4e27b4734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:51.102556 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07bdad-1f47-45ca-824c-1fe4e27b4734 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:51.123530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1269/2540] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:34:51 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:34:51.127640 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a58c6-a5eb-425c-bdb2-1fdbf281faba admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:51.138912 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a58c6-a5eb-425c-bdb2-1fdbf281faba admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:51.143493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0756d-1663-4485-8921-3b6f0ef73dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:51.144193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0756d-1663-4485-8921-3b6f0ef73dca admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:51.144474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0756d-1663-4485-8921-3b6f0ef73dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:51.144750 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0756d-1663-4485-8921-3b6f0ef73dca admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:51.145471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0756d-1663-4485-8921-3b6f0ef73dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:51.147113 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0756d-1663-4485-8921-3b6f0ef73dca admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:51.167568 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1272/2541] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:34:51.168838 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07bdad-1f47-45ca-824c-1fe4e27b4734 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:51.179518 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07bdad-1f47-45ca-824c-1fe4e27b4734 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:51.184105 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66637c23-7fc2-408d-93b2-58febc7b2e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:51.184757 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66637c23-7fc2-408d-93b2-58febc7b2e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:51.185043 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66637c23-7fc2-408d-93b2-58febc7b2e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:51.185328 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66637c23-7fc2-408d-93b2-58febc7b2e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:51.186054 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66637c23-7fc2-408d-93b2-58febc7b2e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:51.187681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66637c23-7fc2-408d-93b2-58febc7b2e78 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:51.198916 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1270/2542] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:34:51.202997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0756d-1663-4485-8921-3b6f0ef73dca admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:51.213596 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0756d-1663-4485-8921-3b6f0ef73dca admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:51.228236 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b13fc5-5b1a-4049-8740-40f59d92a2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:51.229143 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b13fc5-5b1a-4049-8740-40f59d92a2e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:51.229532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b13fc5-5b1a-4049-8740-40f59d92a2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:51.229717 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b13fc5-5b1a-4049-8740-40f59d92a2e4 admin admin] PATH_INFO: `/v3/projects/be7ee97f97734e84845275520325f419/users/37b9a4bcdbe3485ca231932a419810ce/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:51.247458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b13fc5-5b1a-4049-8740-40f59d92a2e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7ee97f97734e84845275520325f419, user_id=37b9a4bcdbe3485ca231932a419810ce, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:51.250152 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b13fc5-5b1a-4049-8740-40f59d92a2e4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:51.271031 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1273/2543] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:34:51 2022] PUT /identity/v3/projects/be7ee97f97734e84845275520325f419/users/37b9a4bcdbe3485ca231932a419810ce/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:34:51.281321 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835d217-cfeb-4812-a6c0-4a7840476078 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:51.281629 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835d217-cfeb-4812-a6c0-4a7840476078 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:51.281890 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835d217-cfeb-4812-a6c0-4a7840476078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:51.336287 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2835d217-cfeb-4812-a6c0-4a7840476078 None None] MFA Rules not processed for user `37b9a4bcdbe3485ca231932a419810ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:51.337561 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2835d217-cfeb-4812-a6c0-4a7840476078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:51.434848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1271/2544] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:34:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:51.436837 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b13fc5-5b1a-4049-8740-40f59d92a2e4 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:51.522346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b13fc5-5b1a-4049-8740-40f59d92a2e4 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:51.527850 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ebafd-ca5e-42c9-9334-d0f066256459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:51.528760 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ebafd-ca5e-42c9-9334-d0f066256459 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:51.529229 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ebafd-ca5e-42c9-9334-d0f066256459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:51.529505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ebafd-ca5e-42c9-9334-d0f066256459 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:51.530210 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ebafd-ca5e-42c9-9334-d0f066256459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:51.532350 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ebafd-ca5e-42c9-9334-d0f066256459 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:51.575189 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1274/2545] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:34:51 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:34:51.581138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835d217-cfeb-4812-a6c0-4a7840476078 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:51.592270 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835d217-cfeb-4812-a6c0-4a7840476078 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:51.654449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0440c-ecf0-47da-8d81-d9ea5687d55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:51.655263 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0440c-ecf0-47da-8d81-d9ea5687d55e admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:51.655619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0440c-ecf0-47da-8d81-d9ea5687d55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:51.655988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0440c-ecf0-47da-8d81-d9ea5687d55e admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:51.656784 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0440c-ecf0-47da-8d81-d9ea5687d55e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:51.659130 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0440c-ecf0-47da-8d81-d9ea5687d55e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:51.684706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1272/2546] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:34:51 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:34:51.688809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ebafd-ca5e-42c9-9334-d0f066256459 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:51.699540 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ebafd-ca5e-42c9-9334-d0f066256459 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:51.704434 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53524e07-8ac7-4d7f-99ec-31034697d9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:51.705092 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53524e07-8ac7-4d7f-99ec-31034697d9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:51.705382 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53524e07-8ac7-4d7f-99ec-31034697d9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:51.705660 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53524e07-8ac7-4d7f-99ec-31034697d9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:51.706474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53524e07-8ac7-4d7f-99ec-31034697d9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:51.708190 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53524e07-8ac7-4d7f-99ec-31034697d9e1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:51.718844 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1275/2547] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:34:51.723802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0440c-ecf0-47da-8d81-d9ea5687d55e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:51.734533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0440c-ecf0-47da-8d81-d9ea5687d55e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:51.740096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268e2df-f92b-4d24-b35f-4ac4f007be59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:51.741002 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268e2df-f92b-4d24-b35f-4ac4f007be59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:51.741288 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268e2df-f92b-4d24-b35f-4ac4f007be59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:51.741567 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268e2df-f92b-4d24-b35f-4ac4f007be59 admin admin] PATH_INFO: `/v3/projects/4fd75bb9bc284299bba971a29947421e/users/daaaa1ab869c49a394e7dc3078408a20/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:51.757902 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268e2df-f92b-4d24-b35f-4ac4f007be59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd75bb9bc284299bba971a29947421e, user_id=daaaa1ab869c49a394e7dc3078408a20, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:51.760972 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268e2df-f92b-4d24-b35f-4ac4f007be59 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:51.775559 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1273/2548] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:34:51 2022] PUT /identity/v3/projects/4fd75bb9bc284299bba971a29947421e/users/daaaa1ab869c49a394e7dc3078408a20/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:34:51.779481 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53524e07-8ac7-4d7f-99ec-31034697d9e1 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:51.790313 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53524e07-8ac7-4d7f-99ec-31034697d9e1 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:51.850835 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ea0b8-4186-436c-acbc-d372d9e5ee0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:51.851505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ea0b8-4186-436c-acbc-d372d9e5ee0f admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:51.851788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ea0b8-4186-436c-acbc-d372d9e5ee0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:51.852065 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ea0b8-4186-436c-acbc-d372d9e5ee0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:51.852902 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ea0b8-4186-436c-acbc-d372d9e5ee0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:51.854534 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ea0b8-4186-436c-acbc-d372d9e5ee0f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:51.869707 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1276/2549] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:34:51.871913 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268e2df-f92b-4d24-b35f-4ac4f007be59 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:51.891476 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268e2df-f92b-4d24-b35f-4ac4f007be59 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:51.902187 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25821d2-f178-4fc3-ba68-8c9dd57a242b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:51.903297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25821d2-f178-4fc3-ba68-8c9dd57a242b admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:51.903587 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25821d2-f178-4fc3-ba68-8c9dd57a242b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:51.903967 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25821d2-f178-4fc3-ba68-8c9dd57a242b admin admin] PATH_INFO: `/v3/projects/4fd75bb9bc284299bba971a29947421e/users/daaaa1ab869c49a394e7dc3078408a20/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:51.906073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25821d2-f178-4fc3-ba68-8c9dd57a242b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd75bb9bc284299bba971a29947421e, user_id=daaaa1ab869c49a394e7dc3078408a20, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:51.909098 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25821d2-f178-4fc3-ba68-8c9dd57a242b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:51.920012 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1274/2550] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:34:51 2022] PUT /identity/v3/projects/4fd75bb9bc284299bba971a29947421e/users/daaaa1ab869c49a394e7dc3078408a20/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:34:51.931775 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5d8bb-1291-4f3c-9359-c5a76bd0a6d8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:51.932076 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5d8bb-1291-4f3c-9359-c5a76bd0a6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:51.932359 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5d8bb-1291-4f3c-9359-c5a76bd0a6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:51.961531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-b4d5d8bb-1291-4f3c-9359-c5a76bd0a6d8 None None] MFA Rules not processed for user `daaaa1ab869c49a394e7dc3078408a20`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:51.962876 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b4d5d8bb-1291-4f3c-9359-c5a76bd0a6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:51.976810 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:52.038405 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1277/2551] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:34:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:52.050470 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25821d2-f178-4fc3-ba68-8c9dd57a242b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:52.052189 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d25821d2-f178-4fc3-ba68-8c9dd57a242b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:52.073240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:52.134551 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25821d2-f178-4fc3-ba68-8c9dd57a242b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:52.138319 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390ce0f-4630-4cd1-b0aa-c95a6f491be2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:52.139150 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390ce0f-4630-4cd1-b0aa-c95a6f491be2 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:52.139445 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390ce0f-4630-4cd1-b0aa-c95a6f491be2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:52.139727 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390ce0f-4630-4cd1-b0aa-c95a6f491be2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:52.151067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390ce0f-4630-4cd1-b0aa-c95a6f491be2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:52.152762 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390ce0f-4630-4cd1-b0aa-c95a6f491be2 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:52.164177 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1275/2552] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:34:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:34:52.869543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5d8bb-1291-4f3c-9359-c5a76bd0a6d8 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:52.938489 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5d8bb-1291-4f3c-9359-c5a76bd0a6d8 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:52.943299 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852f980-d5cb-4ed5-98b5-b89d4b3982e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:52.944313 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852f980-d5cb-4ed5-98b5-b89d4b3982e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:52.944680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852f980-d5cb-4ed5-98b5-b89d4b3982e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:52.945032 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852f980-d5cb-4ed5-98b5-b89d4b3982e5 admin admin] PATH_INFO: `/v3/users/37b9a4bcdbe3485ca231932a419810ce` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:52.946424 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852f980-d5cb-4ed5-98b5-b89d4b3982e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37b9a4bcdbe3485ca231932a419810ce)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:52.948788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852f980-d5cb-4ed5-98b5-b89d4b3982e5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:53.007603 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7852f980-d5cb-4ed5-98b5-b89d4b3982e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37b9a4bcdbe3485ca231932a419810ce'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:53.015958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7852f980-d5cb-4ed5-98b5-b89d4b3982e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37b9a4bcdbe3485ca231932a419810ce'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:53.023893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7852f980-d5cb-4ed5-98b5-b89d4b3982e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37b9a4bcdbe3485ca231932a419810ce'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:53.024561 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7852f980-d5cb-4ed5-98b5-b89d4b3982e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37b9a4bcdbe3485ca231932a419810ce'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:53.025172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7852f980-d5cb-4ed5-98b5-b89d4b3982e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37b9a4bcdbe3485ca231932a419810ce'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:53.043918 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1278/2553] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:34:52 2022] DELETE /identity/v3/users/37b9a4bcdbe3485ca231932a419810ce => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:34:53.048507 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d41dc-e070-46f8-845c-165a689dbf93 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:53.049072 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d41dc-e070-46f8-845c-165a689dbf93 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:53.049072 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d41dc-e070-46f8-845c-165a689dbf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:53.080956 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-319d41dc-e070-46f8-845c-165a689dbf93 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:53.082243 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-319d41dc-e070-46f8-845c-165a689dbf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:53.144537 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1276/2554] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:53.154351 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852f980-d5cb-4ed5-98b5-b89d4b3982e5 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:53.155784 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7852f980-d5cb-4ed5-98b5-b89d4b3982e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:53.190085 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:53.218219 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852f980-d5cb-4ed5-98b5-b89d4b3982e5 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:53.222856 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad278ac-5ac1-4fc5-b2c9-4adc804ba4b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:53.223511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad278ac-5ac1-4fc5-b2c9-4adc804ba4b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:53.223797 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad278ac-5ac1-4fc5-b2c9-4adc804ba4b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:53.224075 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad278ac-5ac1-4fc5-b2c9-4adc804ba4b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:53.233763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad278ac-5ac1-4fc5-b2c9-4adc804ba4b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:53.235414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad278ac-5ac1-4fc5-b2c9-4adc804ba4b6 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:53.245712 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1279/2555] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:34:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:34:53.531051 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d41dc-e070-46f8-845c-165a689dbf93 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:53.532666 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-319d41dc-e070-46f8-845c-165a689dbf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:53.547202 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d41dc-e070-46f8-845c-165a689dbf93 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:53.552856 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0daa02-bf2d-4cb0-9302-ebb0632d7ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:53.553953 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0daa02-bf2d-4cb0-9302-ebb0632d7ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:53.554236 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0daa02-bf2d-4cb0-9302-ebb0632d7ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:53.554548 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0daa02-bf2d-4cb0-9302-ebb0632d7ef2 admin admin] PATH_INFO: `/v3/projects/be7ee97f97734e84845275520325f419` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:53.555767 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0daa02-bf2d-4cb0-9302-ebb0632d7ef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be7ee97f97734e84845275520325f419)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:53.557679 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0daa02-bf2d-4cb0-9302-ebb0632d7ef2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:53.606098 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4e0daa02-bf2d-4cb0-9302-ebb0632d7ef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be7ee97f97734e84845275520325f419', 'request_id': 'req-4e0daa02-bf2d-4cb0-9302-ebb0632d7ef2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:53.612172 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4e0daa02-bf2d-4cb0-9302-ebb0632d7ef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be7ee97f97734e84845275520325f419', 'request_id': 'req-4e0daa02-bf2d-4cb0-9302-ebb0632d7ef2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:53.619462 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4e0daa02-bf2d-4cb0-9302-ebb0632d7ef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be7ee97f97734e84845275520325f419', 'request_id': 'req-4e0daa02-bf2d-4cb0-9302-ebb0632d7ef2'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:53.630486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4e0daa02-bf2d-4cb0-9302-ebb0632d7ef2 admin admin] The token cache is being invalidate because project be7ee97f97734e84845275520325f419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:34:53.630778 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4e0daa02-bf2d-4cb0-9302-ebb0632d7ef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:53.631417 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4e0daa02-bf2d-4cb0-9302-ebb0632d7ef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:53.632950 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1277/2556] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:34:53 2022] DELETE /identity/v3/projects/be7ee97f97734e84845275520325f419 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:34:53.637374 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad278ac-5ac1-4fc5-b2c9-4adc804ba4b6 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:53.648108 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad278ac-5ac1-4fc5-b2c9-4adc804ba4b6 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:53.713584 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20048af2-e69f-4de4-b6c7-99e299551abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:53.714612 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20048af2-e69f-4de4-b6c7-99e299551abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:53.714896 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20048af2-e69f-4de4-b6c7-99e299551abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:53.715172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20048af2-e69f-4de4-b6c7-99e299551abd admin admin] PATH_INFO: `/v3/users/daaaa1ab869c49a394e7dc3078408a20` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:53.716372 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20048af2-e69f-4de4-b6c7-99e299551abd admin admin] RBAC: Authorizing `identity:delete_user(user_id=daaaa1ab869c49a394e7dc3078408a20)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:53.718331 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20048af2-e69f-4de4-b6c7-99e299551abd admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:53.768779 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-20048af2-e69f-4de4-b6c7-99e299551abd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daaaa1ab869c49a394e7dc3078408a20'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:53.775777 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-20048af2-e69f-4de4-b6c7-99e299551abd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daaaa1ab869c49a394e7dc3078408a20'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:53.783708 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-20048af2-e69f-4de4-b6c7-99e299551abd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daaaa1ab869c49a394e7dc3078408a20'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:53.784903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-20048af2-e69f-4de4-b6c7-99e299551abd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daaaa1ab869c49a394e7dc3078408a20'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:53.785974 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-20048af2-e69f-4de4-b6c7-99e299551abd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daaaa1ab869c49a394e7dc3078408a20'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:53.804816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1280/2557] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:34:53 2022] DELETE /identity/v3/users/daaaa1ab869c49a394e7dc3078408a20 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:34:54.105976 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0daa02-bf2d-4cb0-9302-ebb0632d7ef2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:54.107519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4e0daa02-bf2d-4cb0-9302-ebb0632d7ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:54.122437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0daa02-bf2d-4cb0-9302-ebb0632d7ef2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:54.155911 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:54.182942 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53d414-df1d-4d38-a54b-f747ee7e9a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:54.183803 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53d414-df1d-4d38-a54b-f747ee7e9a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:54.184080 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53d414-df1d-4d38-a54b-f747ee7e9a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:54.184360 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53d414-df1d-4d38-a54b-f747ee7e9a14 admin admin] PATH_INFO: `/v3/projects/4fd75bb9bc284299bba971a29947421e` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:54.185534 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53d414-df1d-4d38-a54b-f747ee7e9a14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd75bb9bc284299bba971a29947421e)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:54.187465 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53d414-df1d-4d38-a54b-f747ee7e9a14 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:54.233525 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc53d414-df1d-4d38-a54b-f747ee7e9a14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd75bb9bc284299bba971a29947421e', 'request_id': 'req-bc53d414-df1d-4d38-a54b-f747ee7e9a14'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:54.239672 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc53d414-df1d-4d38-a54b-f747ee7e9a14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd75bb9bc284299bba971a29947421e', 'request_id': 'req-bc53d414-df1d-4d38-a54b-f747ee7e9a14'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:54.247202 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc53d414-df1d-4d38-a54b-f747ee7e9a14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd75bb9bc284299bba971a29947421e', 'request_id': 'req-bc53d414-df1d-4d38-a54b-f747ee7e9a14'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:54.258423 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc53d414-df1d-4d38-a54b-f747ee7e9a14 admin admin] The token cache is being invalidate because project 4fd75bb9bc284299bba971a29947421e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:34:54.258750 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc53d414-df1d-4d38-a54b-f747ee7e9a14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:54.259391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc53d414-df1d-4d38-a54b-f747ee7e9a14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:54.261470 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1278/2558] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:34:54 2022] DELETE /identity/v3/projects/4fd75bb9bc284299bba971a29947421e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:34:54.266965 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915f267-37ad-4af6-8c7f-a38b00ca8664 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:54.267473 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915f267-37ad-4af6-8c7f-a38b00ca8664 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:54.267591 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915f267-37ad-4af6-8c7f-a38b00ca8664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:54.286003 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-7915f267-37ad-4af6-8c7f-a38b00ca8664 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:54.287259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-7915f267-37ad-4af6-8c7f-a38b00ca8664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:54.334927 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:54.350390 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1281/2559] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:54.357871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6068899-f897-4b27-b833-5a912ece3c24 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:54.358157 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6068899-f897-4b27-b833-5a912ece3c24 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:54.358467 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6068899-f897-4b27-b833-5a912ece3c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:54.377502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-a6068899-f897-4b27-b833-5a912ece3c24 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:54.379345 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a6068899-f897-4b27-b833-5a912ece3c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:54.387214 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1279/2560] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:54.391800 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915f267-37ad-4af6-8c7f-a38b00ca8664 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:54.401536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915f267-37ad-4af6-8c7f-a38b00ca8664 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:54.406180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8b4cb-7ab9-4aaf-b966-112c8c2514a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:54.406863 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8b4cb-7ab9-4aaf-b966-112c8c2514a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:54.407264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8b4cb-7ab9-4aaf-b966-112c8c2514a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:54.407417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8b4cb-7ab9-4aaf-b966-112c8c2514a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:54.408142 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8b4cb-7ab9-4aaf-b966-112c8c2514a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:34:54.408704 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8b4cb-7ab9-4aaf-b966-112c8c2514a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:54.410853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8b4cb-7ab9-4aaf-b966-112c8c2514a5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:54.422256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1282/2561] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:34:54.427226 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6068899-f897-4b27-b833-5a912ece3c24 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:54.436618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6068899-f897-4b27-b833-5a912ece3c24 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:54.441978 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13a507-7249-4241-a44f-7d39f8c597f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:54.442661 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13a507-7249-4241-a44f-7d39f8c597f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:54.442949 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13a507-7249-4241-a44f-7d39f8c597f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:54.443226 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13a507-7249-4241-a44f-7d39f8c597f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:54.443918 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13a507-7249-4241-a44f-7d39f8c597f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:54.445812 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13a507-7249-4241-a44f-7d39f8c597f5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:54.471281 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1280/2562] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:34:54 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:34:54.475452 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8b4cb-7ab9-4aaf-b966-112c8c2514a5 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:54.485370 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8b4cb-7ab9-4aaf-b966-112c8c2514a5 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:54.541247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672cda5-ec57-436c-8f3a-917d41c762c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:54.541982 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672cda5-ec57-436c-8f3a-917d41c762c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:54.542327 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672cda5-ec57-436c-8f3a-917d41c762c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:54.542793 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672cda5-ec57-436c-8f3a-917d41c762c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:54.543490 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672cda5-ec57-436c-8f3a-917d41c762c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:54.545552 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672cda5-ec57-436c-8f3a-917d41c762c7 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:54.566502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1283/2563] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:34:54 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:34:54.570759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13a507-7249-4241-a44f-7d39f8c597f5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:54.582118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13a507-7249-4241-a44f-7d39f8c597f5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:54.587081 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb531a-e388-457b-b88d-93193b14a083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:54.587688 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb531a-e388-457b-b88d-93193b14a083 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:54.587973 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb531a-e388-457b-b88d-93193b14a083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:54.588258 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb531a-e388-457b-b88d-93193b14a083 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:54.588988 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb531a-e388-457b-b88d-93193b14a083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:54.590617 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb531a-e388-457b-b88d-93193b14a083 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:54.601976 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1281/2564] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:34:54.606162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672cda5-ec57-436c-8f3a-917d41c762c7 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:54.616576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672cda5-ec57-436c-8f3a-917d41c762c7 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:54.621391 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a10a04-cfe3-480f-93f8-8adfe2c16d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:54.622051 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a10a04-cfe3-480f-93f8-8adfe2c16d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:54.622367 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a10a04-cfe3-480f-93f8-8adfe2c16d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:54.622654 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a10a04-cfe3-480f-93f8-8adfe2c16d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:54.623380 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a10a04-cfe3-480f-93f8-8adfe2c16d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:54.624998 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a10a04-cfe3-480f-93f8-8adfe2c16d1a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:54.635537 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1284/2565] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:34:54.639545 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb531a-e388-457b-b88d-93193b14a083 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:54.649569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb531a-e388-457b-b88d-93193b14a083 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:54.654190 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542a248-33d0-48e0-9102-7a4725a02949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:54.655094 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542a248-33d0-48e0-9102-7a4725a02949 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:54.655378 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542a248-33d0-48e0-9102-7a4725a02949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:54.655655 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542a248-33d0-48e0-9102-7a4725a02949 admin admin] PATH_INFO: `/v3/projects/e673bd6801b44630b94075613f6cabf8/users/57ef65889d554f7fb3a4481866c370be/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:54.670666 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542a248-33d0-48e0-9102-7a4725a02949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e673bd6801b44630b94075613f6cabf8, user_id=57ef65889d554f7fb3a4481866c370be, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:54.673309 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542a248-33d0-48e0-9102-7a4725a02949 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:54.687021 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1282/2566] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:34:54 2022] PUT /identity/v3/projects/e673bd6801b44630b94075613f6cabf8/users/57ef65889d554f7fb3a4481866c370be/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:34:54.697825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f0258-afd1-4f63-8bd1-8475211e1039 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:54.698412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f0258-afd1-4f63-8bd1-8475211e1039 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:54.698956 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f0258-afd1-4f63-8bd1-8475211e1039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:54.734609 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-5c8f0258-afd1-4f63-8bd1-8475211e1039 None None] MFA Rules not processed for user `57ef65889d554f7fb3a4481866c370be`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:54.736409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5c8f0258-afd1-4f63-8bd1-8475211e1039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:54.816052 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1285/2567] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:34:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:54.823052 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542a248-33d0-48e0-9102-7a4725a02949 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:54.824802 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f542a248-33d0-48e0-9102-7a4725a02949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:54.882783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542a248-33d0-48e0-9102-7a4725a02949 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:54.886358 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a0599-15ce-4c28-a364-cda291b527db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:54.887009 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a0599-15ce-4c28-a364-cda291b527db service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:54.887297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a0599-15ce-4c28-a364-cda291b527db service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:54.887578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a0599-15ce-4c28-a364-cda291b527db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:54.896696 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a0599-15ce-4c28-a364-cda291b527db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:54.898117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a0599-15ce-4c28-a364-cda291b527db service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:54.907608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1283/2568] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:34:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:34:54.928134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f0258-afd1-4f63-8bd1-8475211e1039 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:54.982341 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:54.999992 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f0258-afd1-4f63-8bd1-8475211e1039 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:55.005378 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bb788-23f6-47fa-9ef1-4c2ea231da9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:55.006288 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bb788-23f6-47fa-9ef1-4c2ea231da9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:55.006595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bb788-23f6-47fa-9ef1-4c2ea231da9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:55.006879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bb788-23f6-47fa-9ef1-4c2ea231da9c admin admin] PATH_INFO: `/v3/users/57ef65889d554f7fb3a4481866c370be` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:55.008158 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70bb788-23f6-47fa-9ef1-4c2ea231da9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=57ef65889d554f7fb3a4481866c370be)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:55.010270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70bb788-23f6-47fa-9ef1-4c2ea231da9c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:55.059740 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c70bb788-23f6-47fa-9ef1-4c2ea231da9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57ef65889d554f7fb3a4481866c370be'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:55.066945 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c70bb788-23f6-47fa-9ef1-4c2ea231da9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57ef65889d554f7fb3a4481866c370be'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:55.077417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c70bb788-23f6-47fa-9ef1-4c2ea231da9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57ef65889d554f7fb3a4481866c370be'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:55.078172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c70bb788-23f6-47fa-9ef1-4c2ea231da9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57ef65889d554f7fb3a4481866c370be'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:55.078825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-c70bb788-23f6-47fa-9ef1-4c2ea231da9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57ef65889d554f7fb3a4481866c370be'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:55.105687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1286/2569] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:34:54 2022] DELETE /identity/v3/users/57ef65889d554f7fb3a4481866c370be => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:34:55.111139 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340c99a-2392-4f3c-92dd-0577e715fcde None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:55.111642 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340c99a-2392-4f3c-92dd-0577e715fcde None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:55.111805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340c99a-2392-4f3c-92dd-0577e715fcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:55.119044 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:55.131366 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-2340c99a-2392-4f3c-92dd-0577e715fcde None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:55.133316 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2340c99a-2392-4f3c-92dd-0577e715fcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:55.194706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1284/2570] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:55.204632 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bb788-23f6-47fa-9ef1-4c2ea231da9c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:55.206204 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c70bb788-23f6-47fa-9ef1-4c2ea231da9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:55.262863 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bb788-23f6-47fa-9ef1-4c2ea231da9c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:55.266627 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5f7d5-70fa-4f04-9e17-431854b2bc2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:55.267274 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5f7d5-70fa-4f04-9e17-431854b2bc2b service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:55.267892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5f7d5-70fa-4f04-9e17-431854b2bc2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:55.267892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5f7d5-70fa-4f04-9e17-431854b2bc2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:55.277884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5f7d5-70fa-4f04-9e17-431854b2bc2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:55.279377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5f7d5-70fa-4f04-9e17-431854b2bc2b service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:55.289007 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1287/2571] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:34:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:34:55.560235 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340c99a-2392-4f3c-92dd-0577e715fcde None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:55.561995 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2340c99a-2392-4f3c-92dd-0577e715fcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:55.575112 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340c99a-2392-4f3c-92dd-0577e715fcde None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:55.585801 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c94ad-0ed8-48d0-a260-398e81caa9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:55.586733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c94ad-0ed8-48d0-a260-398e81caa9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:55.587020 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c94ad-0ed8-48d0-a260-398e81caa9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:55.587298 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c94ad-0ed8-48d0-a260-398e81caa9b3 admin admin] PATH_INFO: `/v3/projects/e673bd6801b44630b94075613f6cabf8` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:55.588559 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c94ad-0ed8-48d0-a260-398e81caa9b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e673bd6801b44630b94075613f6cabf8)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:55.590499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c94ad-0ed8-48d0-a260-398e81caa9b3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:55.637838 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-896c94ad-0ed8-48d0-a260-398e81caa9b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e673bd6801b44630b94075613f6cabf8', 'request_id': 'req-896c94ad-0ed8-48d0-a260-398e81caa9b3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:55.644655 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-896c94ad-0ed8-48d0-a260-398e81caa9b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e673bd6801b44630b94075613f6cabf8', 'request_id': 'req-896c94ad-0ed8-48d0-a260-398e81caa9b3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:55.651906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-896c94ad-0ed8-48d0-a260-398e81caa9b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e673bd6801b44630b94075613f6cabf8', 'request_id': 'req-896c94ad-0ed8-48d0-a260-398e81caa9b3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:55.663340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-896c94ad-0ed8-48d0-a260-398e81caa9b3 admin admin] The token cache is being invalidate because project e673bd6801b44630b94075613f6cabf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:34:55.663627 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-896c94ad-0ed8-48d0-a260-398e81caa9b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:55.664253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-896c94ad-0ed8-48d0-a260-398e81caa9b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:55.665788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1285/2572] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:34:55 2022] DELETE /identity/v3/projects/e673bd6801b44630b94075613f6cabf8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:34:55.670713 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d0d1a-9539-4464-99f2-f13519d17776 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:55.671001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d0d1a-9539-4464-99f2-f13519d17776 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:55.671277 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d0d1a-9539-4464-99f2-f13519d17776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:55.688547 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-c30d0d1a-9539-4464-99f2-f13519d17776 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:55.689675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c30d0d1a-9539-4464-99f2-f13519d17776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:55.749661 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1288/2573] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:55.760094 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a006238-9f3d-463c-8683-ee5ec4989716 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:55.760611 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a006238-9f3d-463c-8683-ee5ec4989716 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:55.761084 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a006238-9f3d-463c-8683-ee5ec4989716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:55.781433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8a006238-9f3d-463c-8683-ee5ec4989716 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:55.782688 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8a006238-9f3d-463c-8683-ee5ec4989716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:55.791514 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1286/2574] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:55.795772 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d0d1a-9539-4464-99f2-f13519d17776 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:55.806129 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d0d1a-9539-4464-99f2-f13519d17776 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:55.810828 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219db38-efd1-4ee8-bacf-e0cea3ea05b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:55.811479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219db38-efd1-4ee8-bacf-e0cea3ea05b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:55.811767 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219db38-efd1-4ee8-bacf-e0cea3ea05b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:55.812048 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219db38-efd1-4ee8-bacf-e0cea3ea05b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:55.812772 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219db38-efd1-4ee8-bacf-e0cea3ea05b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:34:55.813117 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219db38-efd1-4ee8-bacf-e0cea3ea05b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:55.814767 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219db38-efd1-4ee8-bacf-e0cea3ea05b9 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:55.817898 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:55.830258 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1289/2575] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:34:55.834430 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a006238-9f3d-463c-8683-ee5ec4989716 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:55.843711 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a006238-9f3d-463c-8683-ee5ec4989716 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:55.848368 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c2c9d-181d-4a49-8cc7-4fc1717f6ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:55.849010 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c2c9d-181d-4a49-8cc7-4fc1717f6ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:55.849294 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c2c9d-181d-4a49-8cc7-4fc1717f6ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:55.849571 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c2c9d-181d-4a49-8cc7-4fc1717f6ea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:55.850254 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c2c9d-181d-4a49-8cc7-4fc1717f6ea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:55.852180 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c2c9d-181d-4a49-8cc7-4fc1717f6ea4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:55.877058 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1287/2576] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:34:55 2022] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:34:55.881689 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219db38-efd1-4ee8-bacf-e0cea3ea05b9 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:55.892393 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219db38-efd1-4ee8-bacf-e0cea3ea05b9 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:55.948881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23f5f2-f29b-490b-89db-5345c26410b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:55.949472 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23f5f2-f29b-490b-89db-5345c26410b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:55.949762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23f5f2-f29b-490b-89db-5345c26410b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:55.950045 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23f5f2-f29b-490b-89db-5345c26410b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:55.950758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23f5f2-f29b-490b-89db-5345c26410b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:55.952693 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23f5f2-f29b-490b-89db-5345c26410b9 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:55.972641 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1290/2577] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:34:55 2022] POST /identity/v3/users => generated 281 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:34:55.976804 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c2c9d-181d-4a49-8cc7-4fc1717f6ea4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:55.987617 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c2c9d-181d-4a49-8cc7-4fc1717f6ea4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:55.992833 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c2d00-3dcb-4386-a4e7-b2a563882efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:55.993489 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c2d00-3dcb-4386-a4e7-b2a563882efa admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:55.993775 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c2d00-3dcb-4386-a4e7-b2a563882efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:55.994051 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c2d00-3dcb-4386-a4e7-b2a563882efa admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:55.994801 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c2d00-3dcb-4386-a4e7-b2a563882efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:55.996360 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2c2d00-3dcb-4386-a4e7-b2a563882efa admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:56.007198 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1288/2578] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:34:56.011254 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23f5f2-f29b-490b-89db-5345c26410b9 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:56.021432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23f5f2-f29b-490b-89db-5345c26410b9 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:56.026183 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070b70c-a5db-4dd6-a580-d957e323747d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:56.026897 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070b70c-a5db-4dd6-a580-d957e323747d admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:56.027165 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070b70c-a5db-4dd6-a580-d957e323747d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:56.027447 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070b70c-a5db-4dd6-a580-d957e323747d admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:56.028171 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070b70c-a5db-4dd6-a580-d957e323747d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:56.029789 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070b70c-a5db-4dd6-a580-d957e323747d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:56.044193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1291/2579] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:34:56.047390 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c2d00-3dcb-4386-a4e7-b2a563882efa admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:56.058340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c2d00-3dcb-4386-a4e7-b2a563882efa admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:56.063103 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698faddd-161f-47e7-aa04-25e9e70e767e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:56.064013 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698faddd-161f-47e7-aa04-25e9e70e767e admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:56.064297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698faddd-161f-47e7-aa04-25e9e70e767e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:56.064573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698faddd-161f-47e7-aa04-25e9e70e767e admin admin] PATH_INFO: `/v3/projects/36bec38d2fba4fc78760b0bd8727fe80/users/b49264575a6c4b8aa3e5e85eea0e8e3c/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:56.080216 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698faddd-161f-47e7-aa04-25e9e70e767e admin admin] RBAC: Authorizing `identity:create_grant(project_id=36bec38d2fba4fc78760b0bd8727fe80, user_id=b49264575a6c4b8aa3e5e85eea0e8e3c, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:56.083273 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698faddd-161f-47e7-aa04-25e9e70e767e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:56.098844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1289/2580] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:34:56 2022] PUT /identity/v3/projects/36bec38d2fba4fc78760b0bd8727fe80/users/b49264575a6c4b8aa3e5e85eea0e8e3c/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:34:56.109324 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a1d49-50d8-4085-b4d1-93f7cd199832 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:56.109616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a1d49-50d8-4085-b4d1-93f7cd199832 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:56.109896 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a1d49-50d8-4085-b4d1-93f7cd199832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:56.139493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4c7a1d49-50d8-4085-b4d1-93f7cd199832 None None] MFA Rules not processed for user `b49264575a6c4b8aa3e5e85eea0e8e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:56.140826 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4c7a1d49-50d8-4085-b4d1-93f7cd199832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:56.216680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1292/2581] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:34:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:56.243173 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698faddd-161f-47e7-aa04-25e9e70e767e admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:56.244935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-698faddd-161f-47e7-aa04-25e9e70e767e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:56.275589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:56.308136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698faddd-161f-47e7-aa04-25e9e70e767e admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:56.311932 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85218b1-fac0-478c-84e8-d6fc338279cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:56.312663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85218b1-fac0-478c-84e8-d6fc338279cb service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:56.313006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85218b1-fac0-478c-84e8-d6fc338279cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:56.313355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85218b1-fac0-478c-84e8-d6fc338279cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:56.323087 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85218b1-fac0-478c-84e8-d6fc338279cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:56.324510 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85218b1-fac0-478c-84e8-d6fc338279cb service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:56.336343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1290/2582] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:34:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:34:56.350625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a1d49-50d8-4085-b4d1-93f7cd199832 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:56.414971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a1d49-50d8-4085-b4d1-93f7cd199832 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:56.419701 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919516d0-e6a8-4041-98bc-4d2271233aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:56.420571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919516d0-e6a8-4041-98bc-4d2271233aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:56.420854 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919516d0-e6a8-4041-98bc-4d2271233aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:56.421131 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919516d0-e6a8-4041-98bc-4d2271233aaa admin admin] PATH_INFO: `/v3/users/b49264575a6c4b8aa3e5e85eea0e8e3c` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:56.422387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919516d0-e6a8-4041-98bc-4d2271233aaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b49264575a6c4b8aa3e5e85eea0e8e3c)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:56.424488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919516d0-e6a8-4041-98bc-4d2271233aaa admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:56.429715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:34:56.473008 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-919516d0-e6a8-4041-98bc-4d2271233aaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b49264575a6c4b8aa3e5e85eea0e8e3c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:56.479891 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-919516d0-e6a8-4041-98bc-4d2271233aaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b49264575a6c4b8aa3e5e85eea0e8e3c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:56.486735 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-919516d0-e6a8-4041-98bc-4d2271233aaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b49264575a6c4b8aa3e5e85eea0e8e3c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:56.487362 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-919516d0-e6a8-4041-98bc-4d2271233aaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b49264575a6c4b8aa3e5e85eea0e8e3c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:56.487970 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-919516d0-e6a8-4041-98bc-4d2271233aaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b49264575a6c4b8aa3e5e85eea0e8e3c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:56.504877 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1293/2583] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:34:56 2022] DELETE /identity/v3/users/b49264575a6c4b8aa3e5e85eea0e8e3c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:34:56.509491 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774db7d-985c-493d-9e7d-d4c43ac57193 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:56.509785 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774db7d-985c-493d-9e7d-d4c43ac57193 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:56.510107 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774db7d-985c-493d-9e7d-d4c43ac57193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:56.528156 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8774db7d-985c-493d-9e7d-d4c43ac57193 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:34:56.529366 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8774db7d-985c-493d-9e7d-d4c43ac57193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:56.589002 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1291/2584] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:34:56.600026 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919516d0-e6a8-4041-98bc-4d2271233aaa admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:56.601615 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-919516d0-e6a8-4041-98bc-4d2271233aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:56.661987 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919516d0-e6a8-4041-98bc-4d2271233aaa admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:56.665798 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282cf813-9f18-4946-9551-4da9c59417b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:56.666473 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cf813-9f18-4946-9551-4da9c59417b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:56.666763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cf813-9f18-4946-9551-4da9c59417b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:56.667078 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cf813-9f18-4946-9551-4da9c59417b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:56.676316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282cf813-9f18-4946-9551-4da9c59417b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:56.677830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282cf813-9f18-4946-9551-4da9c59417b8 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:56.687853 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1294/2585] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:34:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:34:56.951277 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774db7d-985c-493d-9e7d-d4c43ac57193 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:34:56.952771 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8774db7d-985c-493d-9e7d-d4c43ac57193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:34:56.967265 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774db7d-985c-493d-9e7d-d4c43ac57193 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:34:56.972782 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766aeccd-de50-405c-a2d5-bbcfa211b859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:34:56.973652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aeccd-de50-405c-a2d5-bbcfa211b859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:34:56.973938 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aeccd-de50-405c-a2d5-bbcfa211b859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:34:56.974216 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766aeccd-de50-405c-a2d5-bbcfa211b859 admin admin] PATH_INFO: `/v3/projects/36bec38d2fba4fc78760b0bd8727fe80` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:34:56.975459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766aeccd-de50-405c-a2d5-bbcfa211b859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36bec38d2fba4fc78760b0bd8727fe80)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:34:56.977371 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766aeccd-de50-405c-a2d5-bbcfa211b859 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:34:57.029587 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-766aeccd-de50-405c-a2d5-bbcfa211b859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36bec38d2fba4fc78760b0bd8727fe80', 'request_id': 'req-766aeccd-de50-405c-a2d5-bbcfa211b859'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:57.036379 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-766aeccd-de50-405c-a2d5-bbcfa211b859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36bec38d2fba4fc78760b0bd8727fe80', 'request_id': 'req-766aeccd-de50-405c-a2d5-bbcfa211b859'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:57.044550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-766aeccd-de50-405c-a2d5-bbcfa211b859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36bec38d2fba4fc78760b0bd8727fe80', 'request_id': 'req-766aeccd-de50-405c-a2d5-bbcfa211b859'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:57.055443 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-766aeccd-de50-405c-a2d5-bbcfa211b859 admin admin] The token cache is being invalidate because project 36bec38d2fba4fc78760b0bd8727fe80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:34:57.055734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-766aeccd-de50-405c-a2d5-bbcfa211b859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:57.056358 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-766aeccd-de50-405c-a2d5-bbcfa211b859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:34:57.057908 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1292/2586] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:34:56 2022] DELETE /identity/v3/projects/36bec38d2fba4fc78760b0bd8727fe80 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:35:00.782709 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282cf813-9f18-4946-9551-4da9c59417b8 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:00.793204 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282cf813-9f18-4946-9551-4da9c59417b8 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:00.843264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649524d-1c6f-44e0-b08e-584d76c56afa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:00.843921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649524d-1c6f-44e0-b08e-584d76c56afa service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:00.844207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649524d-1c6f-44e0-b08e-584d76c56afa service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:00.844486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649524d-1c6f-44e0-b08e-584d76c56afa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:00.846332 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f649524d-1c6f-44e0-b08e-584d76c56afa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:00.856622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649524d-1c6f-44e0-b08e-584d76c56afa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:00.858061 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649524d-1c6f-44e0-b08e-584d76c56afa service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:00.866152 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1295/2587] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:35:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:35:06.212571 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8ab21-b99b-4c8a-84b2-dc2fded870f9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:06.213053 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8ab21-b99b-4c8a-84b2-dc2fded870f9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:06.213163 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8ab21-b99b-4c8a-84b2-dc2fded870f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:06.261715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-aaf8ab21-b99b-4c8a-84b2-dc2fded870f9 None None] MFA Rules not processed for user `e78792e617d84a7cbb384ed764c391fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:35:06.262884 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-aaf8ab21-b99b-4c8a-84b2-dc2fded870f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:06.283102 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:06.328838 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1293/2588] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jul 20 19:35:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:35:06.341864 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649524d-1c6f-44e0-b08e-584d76c56afa service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:06.343401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f649524d-1c6f-44e0-b08e-584d76c56afa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:06.377603 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:06.440133 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649524d-1c6f-44e0-b08e-584d76c56afa service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:06.445741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39550d71-1546-4036-b165-46ee974e68b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebd7c59f0014a3886fa75fb35a40e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:06.446421 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39550d71-1546-4036-b165-46ee974e68b7 service swift] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:06.446712 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39550d71-1546-4036-b165-46ee974e68b7 service swift] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:06.446996 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39550d71-1546-4036-b165-46ee974e68b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:06.455385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39550d71-1546-4036-b165-46ee974e68b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:06.458836 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39550d71-1546-4036-b165-46ee974e68b7 service swift] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:06.467715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1296/2589] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 20 19:35:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:35:12.711173 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8ab21-b99b-4c8a-84b2-dc2fded870f9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:12.712632 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-aaf8ab21-b99b-4c8a-84b2-dc2fded870f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:12.724021 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8ab21-b99b-4c8a-84b2-dc2fded870f9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:12.727733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb7a2d-0bef-4765-b423-c9a41842062c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:12.728378 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb7a2d-0bef-4765-b423-c9a41842062c service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:12.728664 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb7a2d-0bef-4765-b423-c9a41842062c service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:12.728941 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb7a2d-0bef-4765-b423-c9a41842062c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:12.730723 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d1bb7a2d-0bef-4765-b423-c9a41842062c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:12.790851 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb7a2d-0bef-4765-b423-c9a41842062c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:12.792350 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb7a2d-0bef-4765-b423-c9a41842062c service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:12.801718 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1294/2590] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:35:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:35:16.464940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=28 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:16.466489 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39550d71-1546-4036-b165-46ee974e68b7 service swift] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:16.468638 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-39550d71-1546-4036-b165-46ee974e68b7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:16.569614 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39550d71-1546-4036-b165-46ee974e68b7 service swift] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:16.580666 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37284006-5758-42b8-9663-610bcd57a141 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:16.580666 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37284006-5758-42b8-9663-610bcd57a141 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:16.580666 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37284006-5758-42b8-9663-610bcd57a141 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:16.580666 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37284006-5758-42b8-9663-610bcd57a141 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:16.581838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-37284006-5758-42b8-9663-610bcd57a141 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:16.602474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37284006-5758-42b8-9663-610bcd57a141 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:16.602474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37284006-5758-42b8-9663-610bcd57a141 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:16.609502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1297/2591] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:35:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:35:17.845071 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb7a2d-0bef-4765-b423-c9a41842062c service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:17.846521 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d1bb7a2d-0bef-4765-b423-c9a41842062c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:17.857457 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb7a2d-0bef-4765-b423-c9a41842062c service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:17.861261 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748abb9-b949-4235-98e8-033019456d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:17.861930 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748abb9-b949-4235-98e8-033019456d47 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:17.862212 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748abb9-b949-4235-98e8-033019456d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:17.862524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748abb9-b949-4235-98e8-033019456d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:17.864278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2748abb9-b949-4235-98e8-033019456d47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:17.927714 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748abb9-b949-4235-98e8-033019456d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:17.929127 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748abb9-b949-4235-98e8-033019456d47 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:17.938682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1295/2592] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:35:21.197750 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37284006-5758-42b8-9663-610bcd57a141 service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:21.200593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-37284006-5758-42b8-9663-610bcd57a141 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:21.291749 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37284006-5758-42b8-9663-610bcd57a141 service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:21.304508 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403630d7-489c-4b3f-b419-97b1cb2436d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd310799ac43e42bc9c7810e1296ddb9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:21.305460 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403630d7-489c-4b3f-b419-97b1cb2436d5 service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:21.305984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403630d7-489c-4b3f-b419-97b1cb2436d5 service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:21.306658 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403630d7-489c-4b3f-b419-97b1cb2436d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:21.309787 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-403630d7-489c-4b3f-b419-97b1cb2436d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:21.325151 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403630d7-489c-4b3f-b419-97b1cb2436d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:21.326924 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403630d7-489c-4b3f-b419-97b1cb2436d5 service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:21.344791 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1298/2593] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:35:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:35:24.346175 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748abb9-b949-4235-98e8-033019456d47 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:24.348285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2748abb9-b949-4235-98e8-033019456d47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:24.363232 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748abb9-b949-4235-98e8-033019456d47 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:24.369141 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8537ad-ae74-46c1-819d-be8d0fee18d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:24.370278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8537ad-ae74-46c1-819d-be8d0fee18d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:24.370805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8537ad-ae74-46c1-819d-be8d0fee18d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:24.371308 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8537ad-ae74-46c1-819d-be8d0fee18d6 admin admin] PATH_INFO: `/v3/users/62ef5bec99e2415582fd9be9e5eec6eb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:24.373000 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8537ad-ae74-46c1-819d-be8d0fee18d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62ef5bec99e2415582fd9be9e5eec6eb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:24.375700 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8537ad-ae74-46c1-819d-be8d0fee18d6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:24.429271 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-de8537ad-ae74-46c1-819d-be8d0fee18d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62ef5bec99e2415582fd9be9e5eec6eb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:24.431568 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:24.445545 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-de8537ad-ae74-46c1-819d-be8d0fee18d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62ef5bec99e2415582fd9be9e5eec6eb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:24.457897 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-de8537ad-ae74-46c1-819d-be8d0fee18d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62ef5bec99e2415582fd9be9e5eec6eb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:24.466778 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-de8537ad-ae74-46c1-819d-be8d0fee18d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62ef5bec99e2415582fd9be9e5eec6eb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:24.467450 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-de8537ad-ae74-46c1-819d-be8d0fee18d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62ef5bec99e2415582fd9be9e5eec6eb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:24.473873 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1296/2594] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:35:24 2022] DELETE /identity/v3/users/62ef5bec99e2415582fd9be9e5eec6eb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:35:24.654816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403630d7-489c-4b3f-b419-97b1cb2436d5 service placement] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:24.668193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403630d7-489c-4b3f-b419-97b1cb2436d5 service placement] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:24.734821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02b0a2-68cd-41c1-86df-886c6216ce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:24.735695 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02b0a2-68cd-41c1-86df-886c6216ce17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:24.735982 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02b0a2-68cd-41c1-86df-886c6216ce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:24.736267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02b0a2-68cd-41c1-86df-886c6216ce17 admin admin] PATH_INFO: `/v3/projects/c9f93d1e6cc74a1aaa65a786ca163d9e` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:24.737597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02b0a2-68cd-41c1-86df-886c6216ce17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f93d1e6cc74a1aaa65a786ca163d9e)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:24.740113 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02b0a2-68cd-41c1-86df-886c6216ce17 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:24.758332 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:24.789505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-de02b0a2-68cd-41c1-86df-886c6216ce17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f93d1e6cc74a1aaa65a786ca163d9e', 'request_id': 'req-de02b0a2-68cd-41c1-86df-886c6216ce17'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:24.795637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-de02b0a2-68cd-41c1-86df-886c6216ce17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f93d1e6cc74a1aaa65a786ca163d9e', 'request_id': 'req-de02b0a2-68cd-41c1-86df-886c6216ce17'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:24.802555 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-de02b0a2-68cd-41c1-86df-886c6216ce17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f93d1e6cc74a1aaa65a786ca163d9e', 'request_id': 'req-de02b0a2-68cd-41c1-86df-886c6216ce17'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:24.814475 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-de02b0a2-68cd-41c1-86df-886c6216ce17 admin admin] The token cache is being invalidate because project c9f93d1e6cc74a1aaa65a786ca163d9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:35:24.814764 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-de02b0a2-68cd-41c1-86df-886c6216ce17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:24.815387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-de02b0a2-68cd-41c1-86df-886c6216ce17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:24.816943 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1299/2595] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:35:24 2022] DELETE /identity/v3/projects/c9f93d1e6cc74a1aaa65a786ca163d9e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:35:24.821626 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8537ad-ae74-46c1-819d-be8d0fee18d6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:24.823053 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-de8537ad-ae74-46c1-819d-be8d0fee18d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:24.835921 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8537ad-ae74-46c1-819d-be8d0fee18d6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:24.891401 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ce870-2cd9-48a5-b4a5-9ee2efad7208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:24.892270 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ce870-2cd9-48a5-b4a5-9ee2efad7208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:24.892547 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ce870-2cd9-48a5-b4a5-9ee2efad7208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:24.892821 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ce870-2cd9-48a5-b4a5-9ee2efad7208 admin admin] PATH_INFO: `/v3/users/4d5007be3bbd47889b48e9ccf6fe1c3f` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:24.894040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ce870-2cd9-48a5-b4a5-9ee2efad7208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d5007be3bbd47889b48e9ccf6fe1c3f)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:24.896006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ce870-2cd9-48a5-b4a5-9ee2efad7208 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:24.941692 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5c9ce870-2cd9-48a5-b4a5-9ee2efad7208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d5007be3bbd47889b48e9ccf6fe1c3f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:24.948976 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5c9ce870-2cd9-48a5-b4a5-9ee2efad7208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d5007be3bbd47889b48e9ccf6fe1c3f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:24.960410 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5c9ce870-2cd9-48a5-b4a5-9ee2efad7208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d5007be3bbd47889b48e9ccf6fe1c3f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:24.968730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5c9ce870-2cd9-48a5-b4a5-9ee2efad7208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d5007be3bbd47889b48e9ccf6fe1c3f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:24.969350 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5c9ce870-2cd9-48a5-b4a5-9ee2efad7208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d5007be3bbd47889b48e9ccf6fe1c3f'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:24.975205 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1297/2596] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:35:24 2022] DELETE /identity/v3/users/4d5007be3bbd47889b48e9ccf6fe1c3f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:35:25.155456 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02b0a2-68cd-41c1-86df-886c6216ce17 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:35:25.156971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-de02b0a2-68cd-41c1-86df-886c6216ce17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:35:25.171685 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02b0a2-68cd-41c1-86df-886c6216ce17 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:35:25.230244 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9ab7f-a4e5-4f4a-a4a2-dfd8e531b168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:35:25.231139 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9ab7f-a4e5-4f4a-a4a2-dfd8e531b168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:35:25.231421 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9ab7f-a4e5-4f4a-a4a2-dfd8e531b168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:35:25.231699 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9ab7f-a4e5-4f4a-a4a2-dfd8e531b168 admin admin] PATH_INFO: `/v3/projects/3831035eb9264cee85c2678a124ceb85` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:35:25.232888 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9ab7f-a4e5-4f4a-a4a2-dfd8e531b168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3831035eb9264cee85c2678a124ceb85)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:35:25.234915 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9ab7f-a4e5-4f4a-a4a2-dfd8e531b168 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:35:25.288313 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-25f9ab7f-a4e5-4f4a-a4a2-dfd8e531b168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3831035eb9264cee85c2678a124ceb85', 'request_id': 'req-25f9ab7f-a4e5-4f4a-a4a2-dfd8e531b168'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:25.294630 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-25f9ab7f-a4e5-4f4a-a4a2-dfd8e531b168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3831035eb9264cee85c2678a124ceb85', 'request_id': 'req-25f9ab7f-a4e5-4f4a-a4a2-dfd8e531b168'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:25.299968 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-25f9ab7f-a4e5-4f4a-a4a2-dfd8e531b168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3831035eb9264cee85c2678a124ceb85', 'request_id': 'req-25f9ab7f-a4e5-4f4a-a4a2-dfd8e531b168'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:25.314710 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-25f9ab7f-a4e5-4f4a-a4a2-dfd8e531b168 admin admin] The token cache is being invalidate because project 3831035eb9264cee85c2678a124ceb85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:35:25.315137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-25f9ab7f-a4e5-4f4a-a4a2-dfd8e531b168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:25.316019 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-25f9ab7f-a4e5-4f4a-a4a2-dfd8e531b168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:35:25.318110 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1300/2597] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:35:25 2022] DELETE /identity/v3/projects/3831035eb9264cee85c2678a124ceb85 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:35:34.971718 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=64,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:35:35.311128 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=68,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:15.380879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ce870-2cd9-48a5-b4a5-9ee2efad7208 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:15.382282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5c9ce870-2cd9-48a5-b4a5-9ee2efad7208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:15.446109 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ce870-2cd9-48a5-b4a5-9ee2efad7208 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:15.499151 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865b690-0c36-4da8-97d8-74d7f067afb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:15.499805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b690-0c36-4da8-97d8-74d7f067afb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:15.500089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b690-0c36-4da8-97d8-74d7f067afb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:15.500369 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b690-0c36-4da8-97d8-74d7f067afb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:15.502178 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e865b690-0c36-4da8-97d8-74d7f067afb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:15.585322 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865b690-0c36-4da8-97d8-74d7f067afb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:15.586851 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865b690-0c36-4da8-97d8-74d7f067afb8 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:15.606086 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1298/2598] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:22.647125 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9ab7f-a4e5-4f4a-a4a2-dfd8e531b168 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:22.648634 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-25f9ab7f-a4e5-4f4a-a4a2-dfd8e531b168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:22.713583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9ab7f-a4e5-4f4a-a4a2-dfd8e531b168 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:22.717322 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b4d0b-a834-4849-a198-ae88dba29280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:22.717996 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b4d0b-a834-4849-a198-ae88dba29280 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:22.718280 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b4d0b-a834-4849-a198-ae88dba29280 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:22.719159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b4d0b-a834-4849-a198-ae88dba29280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:22.720392 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-924b4d0b-a834-4849-a198-ae88dba29280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:22.783575 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b4d0b-a834-4849-a198-ae88dba29280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:22.785013 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b4d0b-a834-4849-a198-ae88dba29280 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:22.795484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1301/2599] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:25.603025 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=81 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:25.890497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865b690-0c36-4da8-97d8-74d7f067afb8 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:25.892336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e865b690-0c36-4da8-97d8-74d7f067afb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:25.908130 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865b690-0c36-4da8-97d8-74d7f067afb8 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:25.912979 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf3d64-bf5a-4ede-81e3-cc1a49789239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:25.913861 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf3d64-bf5a-4ede-81e3-cc1a49789239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:25.914142 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf3d64-bf5a-4ede-81e3-cc1a49789239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:25.914450 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf3d64-bf5a-4ede-81e3-cc1a49789239 admin admin] PATH_INFO: `/v3/users/31bfcbd417344e5cadf0f2e6f504fafb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:25.915706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf3d64-bf5a-4ede-81e3-cc1a49789239 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31bfcbd417344e5cadf0f2e6f504fafb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:25.918240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf3d64-bf5a-4ede-81e3-cc1a49789239 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:25.969267 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b8bf3d64-bf5a-4ede-81e3-cc1a49789239 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31bfcbd417344e5cadf0f2e6f504fafb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:25.976069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b8bf3d64-bf5a-4ede-81e3-cc1a49789239 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31bfcbd417344e5cadf0f2e6f504fafb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:25.988874 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b8bf3d64-bf5a-4ede-81e3-cc1a49789239 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31bfcbd417344e5cadf0f2e6f504fafb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:25.996136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b8bf3d64-bf5a-4ede-81e3-cc1a49789239 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31bfcbd417344e5cadf0f2e6f504fafb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:25.996739 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b8bf3d64-bf5a-4ede-81e3-cc1a49789239 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31bfcbd417344e5cadf0f2e6f504fafb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:26.002840 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1299/2600] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:25 2022] DELETE /identity/v3/users/31bfcbd417344e5cadf0f2e6f504fafb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:26.178757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b4d0b-a834-4849-a198-ae88dba29280 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:26.189160 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b4d0b-a834-4849-a198-ae88dba29280 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:26.245346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c43b1-4c3f-491e-900e-278c8cebb2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:26.246197 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c43b1-4c3f-491e-900e-278c8cebb2d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:26.246506 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c43b1-4c3f-491e-900e-278c8cebb2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:26.246783 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c43b1-4c3f-491e-900e-278c8cebb2d4 admin admin] PATH_INFO: `/v3/projects/c5da7099d61d49a194ef4940292d213c` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:26.247952 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c43b1-4c3f-491e-900e-278c8cebb2d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5da7099d61d49a194ef4940292d213c)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:26.249946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c43b1-4c3f-491e-900e-278c8cebb2d4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:26.296397 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bd9c43b1-4c3f-491e-900e-278c8cebb2d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5da7099d61d49a194ef4940292d213c', 'request_id': 'req-bd9c43b1-4c3f-491e-900e-278c8cebb2d4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:26.298248 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:26.302957 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bd9c43b1-4c3f-491e-900e-278c8cebb2d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5da7099d61d49a194ef4940292d213c', 'request_id': 'req-bd9c43b1-4c3f-491e-900e-278c8cebb2d4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:26.308974 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bd9c43b1-4c3f-491e-900e-278c8cebb2d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5da7099d61d49a194ef4940292d213c', 'request_id': 'req-bd9c43b1-4c3f-491e-900e-278c8cebb2d4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:26.320884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bd9c43b1-4c3f-491e-900e-278c8cebb2d4 admin admin] The token cache is being invalidate because project c5da7099d61d49a194ef4940292d213c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:26.321165 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bd9c43b1-4c3f-491e-900e-278c8cebb2d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:26.321779 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bd9c43b1-4c3f-491e-900e-278c8cebb2d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:26.323974 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1302/2601] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:26 2022] DELETE /identity/v3/projects/c5da7099d61d49a194ef4940292d213c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:26.328863 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca69530-cddf-4741-95d1-89db5d9d47a2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:26.329143 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca69530-cddf-4741-95d1-89db5d9d47a2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:26.329417 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca69530-cddf-4741-95d1-89db5d9d47a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:26.347800 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-5ca69530-cddf-4741-95d1-89db5d9d47a2 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:26.348992 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-5ca69530-cddf-4741-95d1-89db5d9d47a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:26.407052 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1300/2602] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:26.415017 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdb170-cc72-451c-9c32-f67bbad96585 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:26.415310 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdb170-cc72-451c-9c32-f67bbad96585 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:26.415591 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdb170-cc72-451c-9c32-f67bbad96585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:26.433661 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-68bdb170-cc72-451c-9c32-f67bbad96585 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:26.434987 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-68bdb170-cc72-451c-9c32-f67bbad96585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:26.443201 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1303/2603] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:26.447895 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca69530-cddf-4741-95d1-89db5d9d47a2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:26.457933 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca69530-cddf-4741-95d1-89db5d9d47a2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:26.462490 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb9a3a-1531-454b-ad8b-fe5aa09dca04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:26.463711 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb9a3a-1531-454b-ad8b-fe5aa09dca04 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:26.463997 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb9a3a-1531-454b-ad8b-fe5aa09dca04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:26.464277 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb9a3a-1531-454b-ad8b-fe5aa09dca04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:26.465004 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb9a3a-1531-454b-ad8b-fe5aa09dca04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:36:26.465309 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb9a3a-1531-454b-ad8b-fe5aa09dca04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:26.466911 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb9a3a-1531-454b-ad8b-fe5aa09dca04 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:26.479284 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1301/2604] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:36:26.483521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bdb170-cc72-451c-9c32-f67bbad96585 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:26.492808 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bdb170-cc72-451c-9c32-f67bbad96585 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:26.497515 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933440f7-b3e9-4d8a-8112-cf5684aed089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:26.498175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933440f7-b3e9-4d8a-8112-cf5684aed089 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:26.498511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933440f7-b3e9-4d8a-8112-cf5684aed089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:26.498793 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933440f7-b3e9-4d8a-8112-cf5684aed089 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:26.499485 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933440f7-b3e9-4d8a-8112-cf5684aed089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:26.501412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933440f7-b3e9-4d8a-8112-cf5684aed089 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:26.527777 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1304/2605] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:26 2022] POST /identity/v3/projects => generated 401 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:26.531926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb9a3a-1531-454b-ad8b-fe5aa09dca04 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:26.541977 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb9a3a-1531-454b-ad8b-fe5aa09dca04 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:26.599385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c20632-47a0-4593-81f6-aa1039cc8714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:26.600055 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c20632-47a0-4593-81f6-aa1039cc8714 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:26.600342 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c20632-47a0-4593-81f6-aa1039cc8714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:26.600619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c20632-47a0-4593-81f6-aa1039cc8714 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:26.601314 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c20632-47a0-4593-81f6-aa1039cc8714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:26.603891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c20632-47a0-4593-81f6-aa1039cc8714 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:26.610412 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:26.625331 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1302/2606] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:26 2022] POST /identity/v3/users => generated 301 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:26.629044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933440f7-b3e9-4d8a-8112-cf5684aed089 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:26.639523 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933440f7-b3e9-4d8a-8112-cf5684aed089 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:26.644650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6ab88-865e-464c-92ab-fbd25e61e827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:26.645306 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6ab88-865e-464c-92ab-fbd25e61e827 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:26.645593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6ab88-865e-464c-92ab-fbd25e61e827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:26.645874 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6ab88-865e-464c-92ab-fbd25e61e827 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:26.646632 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6ab88-865e-464c-92ab-fbd25e61e827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:26.648224 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6ab88-865e-464c-92ab-fbd25e61e827 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:26.659311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1305/2607] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:26.663394 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c20632-47a0-4593-81f6-aa1039cc8714 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:26.673991 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c20632-47a0-4593-81f6-aa1039cc8714 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:26.678677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac3251-8827-4827-ac1c-534c6d1009c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:26.679424 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac3251-8827-4827-ac1c-534c6d1009c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:26.679608 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac3251-8827-4827-ac1c-534c6d1009c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:26.679891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac3251-8827-4827-ac1c-534c6d1009c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:26.680621 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac3251-8827-4827-ac1c-534c6d1009c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:26.682220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac3251-8827-4827-ac1c-534c6d1009c6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:26.692407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1303/2608] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:26.697045 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6ab88-865e-464c-92ab-fbd25e61e827 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:26.711999 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6ab88-865e-464c-92ab-fbd25e61e827 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:26.717170 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583da1e-88f6-487c-b8fc-b32fe95f7a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:26.718047 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583da1e-88f6-487c-b8fc-b32fe95f7a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:26.718350 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583da1e-88f6-487c-b8fc-b32fe95f7a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:26.718625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583da1e-88f6-487c-b8fc-b32fe95f7a23 admin admin] PATH_INFO: `/v3/projects/89dfad66026745758a0afba2f924d3de/users/50354a87e1cf4e1c8844b465e07b94d4/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:26.734207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583da1e-88f6-487c-b8fc-b32fe95f7a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89dfad66026745758a0afba2f924d3de, user_id=50354a87e1cf4e1c8844b465e07b94d4, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:26.737173 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583da1e-88f6-487c-b8fc-b32fe95f7a23 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:26.750294 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1306/2609] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:26 2022] PUT /identity/v3/projects/89dfad66026745758a0afba2f924d3de/users/50354a87e1cf4e1c8844b465e07b94d4/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:26.761134 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de0636-6f27-41d3-b4e3-4981998a4fce None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:26.761503 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de0636-6f27-41d3-b4e3-4981998a4fce None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:26.761905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de0636-6f27-41d3-b4e3-4981998a4fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:26.791923 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f6de0636-6f27-41d3-b4e3-4981998a4fce None None] MFA Rules not processed for user `50354a87e1cf4e1c8844b465e07b94d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:26.793240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f6de0636-6f27-41d3-b4e3-4981998a4fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:26.863264 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1304/2610] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:26.868191 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583da1e-88f6-487c-b8fc-b32fe95f7a23 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:26.938561 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583da1e-88f6-487c-b8fc-b32fe95f7a23 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:26.943229 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181077fd-b0bf-4536-95fa-d87fb07cad30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:26.943893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181077fd-b0bf-4536-95fa-d87fb07cad30 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:26.944183 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181077fd-b0bf-4536-95fa-d87fb07cad30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:26.944476 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181077fd-b0bf-4536-95fa-d87fb07cad30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:26.945173 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181077fd-b0bf-4536-95fa-d87fb07cad30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:26.947105 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181077fd-b0bf-4536-95fa-d87fb07cad30 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:26.972758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1307/2611] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:26 2022] POST /identity/v3/projects => generated 405 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:26.976794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de0636-6f27-41d3-b4e3-4981998a4fce None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:26.989841 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de0636-6f27-41d3-b4e3-4981998a4fce None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:27.046474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8e931-766c-41b3-a049-e3d657dfdc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:27.047142 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8e931-766c-41b3-a049-e3d657dfdc5f admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:27.047426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8e931-766c-41b3-a049-e3d657dfdc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:27.047703 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8e931-766c-41b3-a049-e3d657dfdc5f admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:27.048400 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8e931-766c-41b3-a049-e3d657dfdc5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:27.050293 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8e931-766c-41b3-a049-e3d657dfdc5f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:27.070458 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1305/2612] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:26 2022] POST /identity/v3/users => generated 309 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:27.074419 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181077fd-b0bf-4536-95fa-d87fb07cad30 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:27.084974 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181077fd-b0bf-4536-95fa-d87fb07cad30 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:27.089942 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4781ad9-090d-4c0e-84cf-c5c076e325e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:27.090648 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4781ad9-090d-4c0e-84cf-c5c076e325e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:27.090939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4781ad9-090d-4c0e-84cf-c5c076e325e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:27.091221 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4781ad9-090d-4c0e-84cf-c5c076e325e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:27.091970 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4781ad9-090d-4c0e-84cf-c5c076e325e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:27.093616 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4781ad9-090d-4c0e-84cf-c5c076e325e2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:27.104981 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1308/2613] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:27.109168 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8e931-766c-41b3-a049-e3d657dfdc5f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:27.119571 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8e931-766c-41b3-a049-e3d657dfdc5f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:27.124221 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12447c4e-a130-4911-b9b9-77da40167dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:27.125098 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12447c4e-a130-4911-b9b9-77da40167dd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:27.125382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12447c4e-a130-4911-b9b9-77da40167dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:27.125657 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12447c4e-a130-4911-b9b9-77da40167dd9 admin admin] PATH_INFO: `/v3/projects/17843c9a0c07464b8eae99200a40ccaf/users/c68d0cc8a6464cf189ea482df454b528/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:27.140173 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12447c4e-a130-4911-b9b9-77da40167dd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17843c9a0c07464b8eae99200a40ccaf, user_id=c68d0cc8a6464cf189ea482df454b528, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:27.142857 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12447c4e-a130-4911-b9b9-77da40167dd9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:27.156778 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1306/2614] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:27 2022] PUT /identity/v3/projects/17843c9a0c07464b8eae99200a40ccaf/users/c68d0cc8a6464cf189ea482df454b528/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:27.161225 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4781ad9-090d-4c0e-84cf-c5c076e325e2 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:27.172516 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4781ad9-090d-4c0e-84cf-c5c076e325e2 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:27.219216 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:27.230941 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b94081-919b-41f5-875c-a7b24b4dcb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:27.231615 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b94081-919b-41f5-875c-a7b24b4dcb21 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:27.231900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b94081-919b-41f5-875c-a7b24b4dcb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:27.232180 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b94081-919b-41f5-875c-a7b24b4dcb21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:27.232909 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b94081-919b-41f5-875c-a7b24b4dcb21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:27.234528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b94081-919b-41f5-875c-a7b24b4dcb21 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:27.244988 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1309/2615] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:36:27.249324 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12447c4e-a130-4911-b9b9-77da40167dd9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:27.264021 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12447c4e-a130-4911-b9b9-77da40167dd9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:27.268749 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73438483-6431-4526-8656-09a7af957cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:27.270651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73438483-6431-4526-8656-09a7af957cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:27.270651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73438483-6431-4526-8656-09a7af957cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:27.270651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73438483-6431-4526-8656-09a7af957cf0 admin admin] PATH_INFO: `/v3/projects/17843c9a0c07464b8eae99200a40ccaf/users/c68d0cc8a6464cf189ea482df454b528/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:27.274897 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73438483-6431-4526-8656-09a7af957cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17843c9a0c07464b8eae99200a40ccaf, user_id=c68d0cc8a6464cf189ea482df454b528, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:27.278051 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73438483-6431-4526-8656-09a7af957cf0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:27.291569 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1307/2616] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:27 2022] PUT /identity/v3/projects/17843c9a0c07464b8eae99200a40ccaf/users/c68d0cc8a6464cf189ea482df454b528/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:36:27.301682 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93660ce0-18d6-4aa9-8b26-abc5d5fdf659 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:27.301972 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93660ce0-18d6-4aa9-8b26-abc5d5fdf659 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:27.302251 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93660ce0-18d6-4aa9-8b26-abc5d5fdf659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:27.328419 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-93660ce0-18d6-4aa9-8b26-abc5d5fdf659 None None] MFA Rules not processed for user `c68d0cc8a6464cf189ea482df454b528`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:27.329633 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-93660ce0-18d6-4aa9-8b26-abc5d5fdf659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:27.395953 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1310/2617] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:27 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:27.406981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73438483-6431-4526-8656-09a7af957cf0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:27.408777 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-73438483-6431-4526-8656-09a7af957cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:27.432141 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:27.468056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73438483-6431-4526-8656-09a7af957cf0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:27.471922 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24610d-ebd0-45f3-b8a6-7950ff6d32b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:27.472493 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24610d-ebd0-45f3-b8a6-7950ff6d32b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:27.472780 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24610d-ebd0-45f3-b8a6-7950ff6d32b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:27.473054 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24610d-ebd0-45f3-b8a6-7950ff6d32b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:27.482704 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24610d-ebd0-45f3-b8a6-7950ff6d32b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:27.484115 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24610d-ebd0-45f3-b8a6-7950ff6d32b7 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:27.493442 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1308/2618] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:27 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:27.637951 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93660ce0-18d6-4aa9-8b26-abc5d5fdf659 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:27.701662 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93660ce0-18d6-4aa9-8b26-abc5d5fdf659 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:27.706557 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9046d51-e663-411d-baa8-301eadf6115a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:27.707427 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9046d51-e663-411d-baa8-301eadf6115a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:27.707711 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9046d51-e663-411d-baa8-301eadf6115a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:27.707989 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9046d51-e663-411d-baa8-301eadf6115a admin admin] PATH_INFO: `/v3/users/50354a87e1cf4e1c8844b465e07b94d4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:27.709175 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9046d51-e663-411d-baa8-301eadf6115a admin admin] RBAC: Authorizing `identity:delete_user(user_id=50354a87e1cf4e1c8844b465e07b94d4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:27.711138 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9046d51-e663-411d-baa8-301eadf6115a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:27.757391 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b9046d51-e663-411d-baa8-301eadf6115a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50354a87e1cf4e1c8844b465e07b94d4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:27.764687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b9046d51-e663-411d-baa8-301eadf6115a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50354a87e1cf4e1c8844b465e07b94d4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:27.771368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b9046d51-e663-411d-baa8-301eadf6115a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50354a87e1cf4e1c8844b465e07b94d4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:27.772177 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b9046d51-e663-411d-baa8-301eadf6115a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50354a87e1cf4e1c8844b465e07b94d4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:27.772788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b9046d51-e663-411d-baa8-301eadf6115a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50354a87e1cf4e1c8844b465e07b94d4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:27.781444 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:27.793486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1311/2619] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:27 2022] DELETE /identity/v3/users/50354a87e1cf4e1c8844b465e07b94d4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:27.798031 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bcf34-dff8-474f-bdd3-1f9e4b8aeac3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:27.798533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bcf34-dff8-474f-bdd3-1f9e4b8aeac3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:27.798652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266bcf34-dff8-474f-bdd3-1f9e4b8aeac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:27.815749 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-266bcf34-dff8-474f-bdd3-1f9e4b8aeac3 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:27.816948 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-266bcf34-dff8-474f-bdd3-1f9e4b8aeac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:27.873924 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1309/2620] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:27.884212 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9046d51-e663-411d-baa8-301eadf6115a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:27.886097 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b9046d51-e663-411d-baa8-301eadf6115a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:27.942845 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9046d51-e663-411d-baa8-301eadf6115a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:27.946503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13516abd-6780-40da-91a4-1fad0c7585d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:27.947676 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13516abd-6780-40da-91a4-1fad0c7585d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:27.947959 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13516abd-6780-40da-91a4-1fad0c7585d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:27.948244 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13516abd-6780-40da-91a4-1fad0c7585d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:27.957170 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13516abd-6780-40da-91a4-1fad0c7585d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:27.958628 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13516abd-6780-40da-91a4-1fad0c7585d6 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:27.968759 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1312/2621] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:28.244825 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bcf34-dff8-474f-bdd3-1f9e4b8aeac3 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:28.246249 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-266bcf34-dff8-474f-bdd3-1f9e4b8aeac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:28.258934 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266bcf34-dff8-474f-bdd3-1f9e4b8aeac3 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:28.264349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0789f4-d2c0-4e9f-8f1d-417c6d016443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:28.265293 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0789f4-d2c0-4e9f-8f1d-417c6d016443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:28.265570 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0789f4-d2c0-4e9f-8f1d-417c6d016443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:28.265839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0789f4-d2c0-4e9f-8f1d-417c6d016443 admin admin] PATH_INFO: `/v3/projects/89dfad66026745758a0afba2f924d3de` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:28.267053 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0789f4-d2c0-4e9f-8f1d-417c6d016443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89dfad66026745758a0afba2f924d3de)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:28.268936 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0789f4-d2c0-4e9f-8f1d-417c6d016443 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:28.315806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6d0789f4-d2c0-4e9f-8f1d-417c6d016443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89dfad66026745758a0afba2f924d3de', 'request_id': 'req-6d0789f4-d2c0-4e9f-8f1d-417c6d016443'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.321753 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6d0789f4-d2c0-4e9f-8f1d-417c6d016443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89dfad66026745758a0afba2f924d3de', 'request_id': 'req-6d0789f4-d2c0-4e9f-8f1d-417c6d016443'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.329933 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6d0789f4-d2c0-4e9f-8f1d-417c6d016443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89dfad66026745758a0afba2f924d3de', 'request_id': 'req-6d0789f4-d2c0-4e9f-8f1d-417c6d016443'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.340096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6d0789f4-d2c0-4e9f-8f1d-417c6d016443 admin admin] The token cache is being invalidate because project 89dfad66026745758a0afba2f924d3de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:28.340385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6d0789f4-d2c0-4e9f-8f1d-417c6d016443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.340997 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-6d0789f4-d2c0-4e9f-8f1d-417c6d016443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.342550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1310/2622] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:28 2022] DELETE /identity/v3/projects/89dfad66026745758a0afba2f924d3de => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:28.346517 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13516abd-6780-40da-91a4-1fad0c7585d6 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:28.356254 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13516abd-6780-40da-91a4-1fad0c7585d6 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:28.412797 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86eabf-a077-494f-99d9-3aaedf8d8862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:28.413664 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86eabf-a077-494f-99d9-3aaedf8d8862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:28.413949 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86eabf-a077-494f-99d9-3aaedf8d8862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:28.414228 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86eabf-a077-494f-99d9-3aaedf8d8862 admin admin] PATH_INFO: `/v3/users/c68d0cc8a6464cf189ea482df454b528` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:28.415450 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86eabf-a077-494f-99d9-3aaedf8d8862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c68d0cc8a6464cf189ea482df454b528)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:28.417854 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86eabf-a077-494f-99d9-3aaedf8d8862 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:28.463107 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7d86eabf-a077-494f-99d9-3aaedf8d8862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c68d0cc8a6464cf189ea482df454b528'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.470136 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7d86eabf-a077-494f-99d9-3aaedf8d8862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c68d0cc8a6464cf189ea482df454b528'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.476724 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7d86eabf-a077-494f-99d9-3aaedf8d8862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c68d0cc8a6464cf189ea482df454b528'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.477369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7d86eabf-a077-494f-99d9-3aaedf8d8862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c68d0cc8a6464cf189ea482df454b528'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.477975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-7d86eabf-a077-494f-99d9-3aaedf8d8862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c68d0cc8a6464cf189ea482df454b528'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.496645 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1313/2623] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:28 2022] DELETE /identity/v3/users/c68d0cc8a6464cf189ea482df454b528 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:28.768595 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0789f4-d2c0-4e9f-8f1d-417c6d016443 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:28.770065 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-6d0789f4-d2c0-4e9f-8f1d-417c6d016443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:28.786144 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0789f4-d2c0-4e9f-8f1d-417c6d016443 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:28.830242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:28.843844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ad5ff-3ff8-4177-b59f-d5b3da343713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:28.844615 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ad5ff-3ff8-4177-b59f-d5b3da343713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:28.844891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ad5ff-3ff8-4177-b59f-d5b3da343713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:28.845161 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ad5ff-3ff8-4177-b59f-d5b3da343713 admin admin] PATH_INFO: `/v3/projects/17843c9a0c07464b8eae99200a40ccaf` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:28.846340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ad5ff-3ff8-4177-b59f-d5b3da343713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17843c9a0c07464b8eae99200a40ccaf)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:28.848242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ad5ff-3ff8-4177-b59f-d5b3da343713 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:28.894026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ad0ad5ff-3ff8-4177-b59f-d5b3da343713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17843c9a0c07464b8eae99200a40ccaf', 'request_id': 'req-ad0ad5ff-3ff8-4177-b59f-d5b3da343713'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.899985 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ad0ad5ff-3ff8-4177-b59f-d5b3da343713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17843c9a0c07464b8eae99200a40ccaf', 'request_id': 'req-ad0ad5ff-3ff8-4177-b59f-d5b3da343713'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.908419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ad0ad5ff-3ff8-4177-b59f-d5b3da343713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17843c9a0c07464b8eae99200a40ccaf', 'request_id': 'req-ad0ad5ff-3ff8-4177-b59f-d5b3da343713'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.919183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ad0ad5ff-3ff8-4177-b59f-d5b3da343713 admin admin] The token cache is being invalidate because project 17843c9a0c07464b8eae99200a40ccaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:28.919476 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ad0ad5ff-3ff8-4177-b59f-d5b3da343713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.920103 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-ad0ad5ff-3ff8-4177-b59f-d5b3da343713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:28.921643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1311/2624] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:28 2022] DELETE /identity/v3/projects/17843c9a0c07464b8eae99200a40ccaf => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:36:28.926969 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357809b-b262-4b6e-8e35-b325b02b71ea None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:28.927270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357809b-b262-4b6e-8e35-b325b02b71ea None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:28.927557 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357809b-b262-4b6e-8e35-b325b02b71ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:28.946247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0357809b-b262-4b6e-8e35-b325b02b71ea None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:28.947620 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0357809b-b262-4b6e-8e35-b325b02b71ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:28.956014 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:29.010487 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1314/2625] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:29.019144 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292478d7-d299-4d03-83d5-b977761f2d20 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:29.019435 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292478d7-d299-4d03-83d5-b977761f2d20 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:29.019715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292478d7-d299-4d03-83d5-b977761f2d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:29.038092 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-292478d7-d299-4d03-83d5-b977761f2d20 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:29.039340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-292478d7-d299-4d03-83d5-b977761f2d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:29.047362 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1312/2626] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:29.051569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357809b-b262-4b6e-8e35-b325b02b71ea None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:29.061901 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357809b-b262-4b6e-8e35-b325b02b71ea None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:29.066634 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201c039-84cf-49d1-8fdd-f1b81f3da3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:29.067308 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201c039-84cf-49d1-8fdd-f1b81f3da3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:29.067574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201c039-84cf-49d1-8fdd-f1b81f3da3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:29.067982 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201c039-84cf-49d1-8fdd-f1b81f3da3d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:29.068595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201c039-84cf-49d1-8fdd-f1b81f3da3d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:36:29.068903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201c039-84cf-49d1-8fdd-f1b81f3da3d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:29.070560 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201c039-84cf-49d1-8fdd-f1b81f3da3d7 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:29.082936 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1315/2627] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:36:29.087173 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292478d7-d299-4d03-83d5-b977761f2d20 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:29.096487 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292478d7-d299-4d03-83d5-b977761f2d20 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:29.101111 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac57753-97ff-4c53-be20-832b42e706fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:29.101753 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac57753-97ff-4c53-be20-832b42e706fe admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:29.102040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac57753-97ff-4c53-be20-832b42e706fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:29.102345 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac57753-97ff-4c53-be20-832b42e706fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:29.103055 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac57753-97ff-4c53-be20-832b42e706fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:29.105243 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac57753-97ff-4c53-be20-832b42e706fe admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:29.131241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1313/2628] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:29 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:36:29.136014 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201c039-84cf-49d1-8fdd-f1b81f3da3d7 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:29.145931 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201c039-84cf-49d1-8fdd-f1b81f3da3d7 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:29.201489 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27805c6f-939a-4675-b954-48e7008f9b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:29.202207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27805c6f-939a-4675-b954-48e7008f9b82 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:29.202553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27805c6f-939a-4675-b954-48e7008f9b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:29.202831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27805c6f-939a-4675-b954-48e7008f9b82 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:29.203503 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27805c6f-939a-4675-b954-48e7008f9b82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:29.205393 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27805c6f-939a-4675-b954-48e7008f9b82 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:29.224413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1316/2629] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:29 2022] POST /identity/v3/users => generated 282 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:36:29.229285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac57753-97ff-4c53-be20-832b42e706fe admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:29.239484 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac57753-97ff-4c53-be20-832b42e706fe admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:29.244848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec98482-04ef-4893-9848-e86c7acfc6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:29.245497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec98482-04ef-4893-9848-e86c7acfc6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:29.245776 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec98482-04ef-4893-9848-e86c7acfc6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:29.246049 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec98482-04ef-4893-9848-e86c7acfc6b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:29.246827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec98482-04ef-4893-9848-e86c7acfc6b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:29.248407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec98482-04ef-4893-9848-e86c7acfc6b0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:29.259968 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1314/2630] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:29.263909 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27805c6f-939a-4675-b954-48e7008f9b82 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:29.274488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27805c6f-939a-4675-b954-48e7008f9b82 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:29.279129 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cda417-aad2-4895-a63a-f467557a9906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:29.279809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cda417-aad2-4895-a63a-f467557a9906 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:29.280090 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cda417-aad2-4895-a63a-f467557a9906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:29.280363 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cda417-aad2-4895-a63a-f467557a9906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:29.281076 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cda417-aad2-4895-a63a-f467557a9906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:29.282688 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cda417-aad2-4895-a63a-f467557a9906 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:29.293168 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1317/2631] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:29.297299 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec98482-04ef-4893-9848-e86c7acfc6b0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:29.308398 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec98482-04ef-4893-9848-e86c7acfc6b0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:29.313079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edc154-e977-49a9-ae59-36ff5300ca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:29.313952 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edc154-e977-49a9-ae59-36ff5300ca16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:29.314234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edc154-e977-49a9-ae59-36ff5300ca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:29.314553 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edc154-e977-49a9-ae59-36ff5300ca16 admin admin] PATH_INFO: `/v3/projects/712ad1bdc3874ec1b7eb09e3674a7cef/users/b81c23962ec3468ea918e0a3ee510b0f/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:29.328910 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edc154-e977-49a9-ae59-36ff5300ca16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=712ad1bdc3874ec1b7eb09e3674a7cef, user_id=b81c23962ec3468ea918e0a3ee510b0f, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:29.331834 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edc154-e977-49a9-ae59-36ff5300ca16 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:29.344710 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1315/2632] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:29 2022] PUT /identity/v3/projects/712ad1bdc3874ec1b7eb09e3674a7cef/users/b81c23962ec3468ea918e0a3ee510b0f/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:29.356708 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c383af-b5b1-4dee-9d81-710b3a4186f5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:29.357211 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c383af-b5b1-4dee-9d81-710b3a4186f5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:29.357211 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c383af-b5b1-4dee-9d81-710b3a4186f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:29.384124 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-61c383af-b5b1-4dee-9d81-710b3a4186f5 None None] MFA Rules not processed for user `b81c23962ec3468ea918e0a3ee510b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:29.385350 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-61c383af-b5b1-4dee-9d81-710b3a4186f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:29.449089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1318/2633] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:29 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:29.453693 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edc154-e977-49a9-ae59-36ff5300ca16 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:29.515030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edc154-e977-49a9-ae59-36ff5300ca16 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:29.519895 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504ee72-eab1-4a6a-9a98-32db1ff4359b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:29.520613 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504ee72-eab1-4a6a-9a98-32db1ff4359b admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:29.520899 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504ee72-eab1-4a6a-9a98-32db1ff4359b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:29.521176 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504ee72-eab1-4a6a-9a98-32db1ff4359b admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:29.521869 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504ee72-eab1-4a6a-9a98-32db1ff4359b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:29.523794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504ee72-eab1-4a6a-9a98-32db1ff4359b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:29.543304 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:29.552396 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1316/2634] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:29 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:29.557012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c383af-b5b1-4dee-9d81-710b3a4186f5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:29.567820 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c383af-b5b1-4dee-9d81-710b3a4186f5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:29.572460 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:29.632483 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6362eb-7ffb-496e-b2a3-f302eecc2078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:29.633092 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6362eb-7ffb-496e-b2a3-f302eecc2078 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:29.633376 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6362eb-7ffb-496e-b2a3-f302eecc2078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:29.633650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6362eb-7ffb-496e-b2a3-f302eecc2078 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:29.634385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6362eb-7ffb-496e-b2a3-f302eecc2078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:29.636295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6362eb-7ffb-496e-b2a3-f302eecc2078 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:29.659267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1319/2635] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:29 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:36:29.664035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504ee72-eab1-4a6a-9a98-32db1ff4359b admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:29.675119 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504ee72-eab1-4a6a-9a98-32db1ff4359b admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:29.679726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebee7e2-7b03-4a33-bf96-d3b37da6b655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:29.680420 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebee7e2-7b03-4a33-bf96-d3b37da6b655 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:29.680705 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebee7e2-7b03-4a33-bf96-d3b37da6b655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:29.680985 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebee7e2-7b03-4a33-bf96-d3b37da6b655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:29.681742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebee7e2-7b03-4a33-bf96-d3b37da6b655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:29.683464 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebee7e2-7b03-4a33-bf96-d3b37da6b655 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:29.694111 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1317/2636] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:29.698382 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6362eb-7ffb-496e-b2a3-f302eecc2078 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:29.708668 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6362eb-7ffb-496e-b2a3-f302eecc2078 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:29.713821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c4fb8-3b18-4e8c-91d7-0a043b9cbd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:29.714751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c4fb8-3b18-4e8c-91d7-0a043b9cbd9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:29.715035 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c4fb8-3b18-4e8c-91d7-0a043b9cbd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:29.715310 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c4fb8-3b18-4e8c-91d7-0a043b9cbd9f admin admin] PATH_INFO: `/v3/projects/3f36512d1f3640c1899b9210d8ba2d34/users/bf1d8a15eb924cb6a91b5371b80c078c/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:29.730564 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c4fb8-3b18-4e8c-91d7-0a043b9cbd9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f36512d1f3640c1899b9210d8ba2d34, user_id=bf1d8a15eb924cb6a91b5371b80c078c, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:29.733194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c4fb8-3b18-4e8c-91d7-0a043b9cbd9f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:29.746374 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1320/2637] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:29 2022] PUT /identity/v3/projects/3f36512d1f3640c1899b9210d8ba2d34/users/bf1d8a15eb924cb6a91b5371b80c078c/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:29.750762 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebee7e2-7b03-4a33-bf96-d3b37da6b655 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:29.761518 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebee7e2-7b03-4a33-bf96-d3b37da6b655 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:29.819809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1def5d-3f89-46a5-8588-ff392581283f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:29.820498 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1def5d-3f89-46a5-8588-ff392581283f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:29.820816 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1def5d-3f89-46a5-8588-ff392581283f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:29.821102 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1def5d-3f89-46a5-8588-ff392581283f admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:29.821916 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1def5d-3f89-46a5-8588-ff392581283f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:29.823544 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1def5d-3f89-46a5-8588-ff392581283f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:29.833570 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1318/2638] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:36:29.838348 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c4fb8-3b18-4e8c-91d7-0a043b9cbd9f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:29.848817 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c4fb8-3b18-4e8c-91d7-0a043b9cbd9f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:29.854052 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b70cb-082c-46df-b91d-95da74635907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:29.854963 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b70cb-082c-46df-b91d-95da74635907 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:29.855247 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b70cb-082c-46df-b91d-95da74635907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:29.855524 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b70cb-082c-46df-b91d-95da74635907 admin admin] PATH_INFO: `/v3/projects/3f36512d1f3640c1899b9210d8ba2d34/users/bf1d8a15eb924cb6a91b5371b80c078c/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:29.857527 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b70cb-082c-46df-b91d-95da74635907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f36512d1f3640c1899b9210d8ba2d34, user_id=bf1d8a15eb924cb6a91b5371b80c078c, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:29.860179 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b70cb-082c-46df-b91d-95da74635907 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:29.871937 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1321/2639] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:29 2022] PUT /identity/v3/projects/3f36512d1f3640c1899b9210d8ba2d34/users/bf1d8a15eb924cb6a91b5371b80c078c/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:29.882273 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168018f1-68f6-46c1-8135-ead61c33b1f1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:29.882800 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168018f1-68f6-46c1-8135-ead61c33b1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:29.883031 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168018f1-68f6-46c1-8135-ead61c33b1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:29.909630 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-168018f1-68f6-46c1-8135-ead61c33b1f1 None None] MFA Rules not processed for user `bf1d8a15eb924cb6a91b5371b80c078c`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:29.911144 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-168018f1-68f6-46c1-8135-ead61c33b1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:29.993867 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1319/2640] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:29 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:30.005158 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b70cb-082c-46df-b91d-95da74635907 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:30.007006 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-675b70cb-082c-46df-b91d-95da74635907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:30.067975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b70cb-082c-46df-b91d-95da74635907 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:30.072392 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c5243-b1e3-41fc-8a4b-7f41f3d225b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:30.073053 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c5243-b1e3-41fc-8a4b-7f41f3d225b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:30.073391 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c5243-b1e3-41fc-8a4b-7f41f3d225b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:30.073687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c5243-b1e3-41fc-8a4b-7f41f3d225b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:30.084152 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c5243-b1e3-41fc-8a4b-7f41f3d225b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:30.085593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c5243-b1e3-41fc-8a4b-7f41f3d225b7 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:30.101412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1322/2641] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:30 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:30.185533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168018f1-68f6-46c1-8135-ead61c33b1f1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:30.195694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168018f1-68f6-46c1-8135-ead61c33b1f1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:30.199854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a60b1-04be-4849-b555-a9801ee9a06a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:30.200512 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a60b1-04be-4849-b555-a9801ee9a06a service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:30.200792 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a60b1-04be-4849-b555-a9801ee9a06a service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:30.201072 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a60b1-04be-4849-b555-a9801ee9a06a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:30.260126 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a60b1-04be-4849-b555-a9801ee9a06a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:30.261573 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a60b1-04be-4849-b555-a9801ee9a06a service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:30.271925 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1320/2642] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:30 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:36:32.973770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c5243-b1e3-41fc-8a4b-7f41f3d225b7 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:33.038565 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c5243-b1e3-41fc-8a4b-7f41f3d225b7 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:33.043814 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9906c39-8c74-45cc-aafa-b9f15d80ce88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:33.044683 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9906c39-8c74-45cc-aafa-b9f15d80ce88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:33.044969 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9906c39-8c74-45cc-aafa-b9f15d80ce88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:33.045249 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9906c39-8c74-45cc-aafa-b9f15d80ce88 admin admin] PATH_INFO: `/v3/users/b81c23962ec3468ea918e0a3ee510b0f` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:33.046529 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9906c39-8c74-45cc-aafa-b9f15d80ce88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b81c23962ec3468ea918e0a3ee510b0f)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:33.048458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9906c39-8c74-45cc-aafa-b9f15d80ce88 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:33.053158 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:33.095772 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b9906c39-8c74-45cc-aafa-b9f15d80ce88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b81c23962ec3468ea918e0a3ee510b0f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:33.107440 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b9906c39-8c74-45cc-aafa-b9f15d80ce88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b81c23962ec3468ea918e0a3ee510b0f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:33.114992 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b9906c39-8c74-45cc-aafa-b9f15d80ce88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b81c23962ec3468ea918e0a3ee510b0f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:33.115599 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b9906c39-8c74-45cc-aafa-b9f15d80ce88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b81c23962ec3468ea918e0a3ee510b0f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:33.116200 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b9906c39-8c74-45cc-aafa-b9f15d80ce88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b81c23962ec3468ea918e0a3ee510b0f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:33.134217 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1323/2643] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:32 2022] DELETE /identity/v3/users/b81c23962ec3468ea918e0a3ee510b0f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:33.142313 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7af3e-c851-4f69-8a8d-5b9050babad9 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:33.142853 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7af3e-c851-4f69-8a8d-5b9050babad9 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:33.142853 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7af3e-c851-4f69-8a8d-5b9050babad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:33.154753 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:33.162049 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-4fc7af3e-c851-4f69-8a8d-5b9050babad9 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:33.163316 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4fc7af3e-c851-4f69-8a8d-5b9050babad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:33.222311 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1321/2644] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:33.232569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9906c39-8c74-45cc-aafa-b9f15d80ce88 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:33.233971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b9906c39-8c74-45cc-aafa-b9f15d80ce88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:33.292657 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9906c39-8c74-45cc-aafa-b9f15d80ce88 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:33.296378 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70038d-2e73-44c3-9b25-9df6c1009140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:33.297386 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70038d-2e73-44c3-9b25-9df6c1009140 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:33.297674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70038d-2e73-44c3-9b25-9df6c1009140 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:33.297961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70038d-2e73-44c3-9b25-9df6c1009140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:33.307646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd70038d-2e73-44c3-9b25-9df6c1009140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:33.309083 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd70038d-2e73-44c3-9b25-9df6c1009140 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:33.319103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1324/2645] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:36:33.583978 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7af3e-c851-4f69-8a8d-5b9050babad9 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:33.585489 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4fc7af3e-c851-4f69-8a8d-5b9050babad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:33.600485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7af3e-c851-4f69-8a8d-5b9050babad9 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:33.606422 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1c11a-4110-430b-9ad4-bca66d33ab92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:33.607376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1c11a-4110-430b-9ad4-bca66d33ab92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:33.607663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1c11a-4110-430b-9ad4-bca66d33ab92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:33.607940 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1c11a-4110-430b-9ad4-bca66d33ab92 admin admin] PATH_INFO: `/v3/projects/712ad1bdc3874ec1b7eb09e3674a7cef` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:33.609290 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1c11a-4110-430b-9ad4-bca66d33ab92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=712ad1bdc3874ec1b7eb09e3674a7cef)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:33.612145 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1c11a-4110-430b-9ad4-bca66d33ab92 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:33.664227 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-32e1c11a-4110-430b-9ad4-bca66d33ab92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '712ad1bdc3874ec1b7eb09e3674a7cef', 'request_id': 'req-32e1c11a-4110-430b-9ad4-bca66d33ab92'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:33.671848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-32e1c11a-4110-430b-9ad4-bca66d33ab92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '712ad1bdc3874ec1b7eb09e3674a7cef', 'request_id': 'req-32e1c11a-4110-430b-9ad4-bca66d33ab92'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:33.681517 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-32e1c11a-4110-430b-9ad4-bca66d33ab92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '712ad1bdc3874ec1b7eb09e3674a7cef', 'request_id': 'req-32e1c11a-4110-430b-9ad4-bca66d33ab92'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:33.693217 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-32e1c11a-4110-430b-9ad4-bca66d33ab92 admin admin] The token cache is being invalidate because project 712ad1bdc3874ec1b7eb09e3674a7cef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:33.693505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-32e1c11a-4110-430b-9ad4-bca66d33ab92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:33.694187 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-32e1c11a-4110-430b-9ad4-bca66d33ab92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:33.695792 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1322/2646] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:33 2022] DELETE /identity/v3/projects/712ad1bdc3874ec1b7eb09e3674a7cef => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:36:33.700419 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70038d-2e73-44c3-9b25-9df6c1009140 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:33.710822 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70038d-2e73-44c3-9b25-9df6c1009140 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:33.769187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809d9b2-a0e3-4f20-a6c2-b24a8eddfabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:33.770066 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809d9b2-a0e3-4f20-a6c2-b24a8eddfabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:33.770374 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809d9b2-a0e3-4f20-a6c2-b24a8eddfabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:33.770660 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809d9b2-a0e3-4f20-a6c2-b24a8eddfabe admin admin] PATH_INFO: `/v3/users/bf1d8a15eb924cb6a91b5371b80c078c` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:33.771852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809d9b2-a0e3-4f20-a6c2-b24a8eddfabe admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf1d8a15eb924cb6a91b5371b80c078c)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:33.773755 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809d9b2-a0e3-4f20-a6c2-b24a8eddfabe admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:33.803046 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:33.822777 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e809d9b2-a0e3-4f20-a6c2-b24a8eddfabe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf1d8a15eb924cb6a91b5371b80c078c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:33.829718 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e809d9b2-a0e3-4f20-a6c2-b24a8eddfabe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf1d8a15eb924cb6a91b5371b80c078c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:33.837213 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e809d9b2-a0e3-4f20-a6c2-b24a8eddfabe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf1d8a15eb924cb6a91b5371b80c078c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:33.838445 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e809d9b2-a0e3-4f20-a6c2-b24a8eddfabe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf1d8a15eb924cb6a91b5371b80c078c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:33.839056 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e809d9b2-a0e3-4f20-a6c2-b24a8eddfabe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf1d8a15eb924cb6a91b5371b80c078c'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:33.856030 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1325/2647] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:33 2022] DELETE /identity/v3/users/bf1d8a15eb924cb6a91b5371b80c078c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:34.159878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1c11a-4110-430b-9ad4-bca66d33ab92 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:34.162114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-32e1c11a-4110-430b-9ad4-bca66d33ab92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:34.177067 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1c11a-4110-430b-9ad4-bca66d33ab92 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:34.247682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3992ed-fee9-4fd0-a136-7f7ef3cb30c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:34.248828 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3992ed-fee9-4fd0-a136-7f7ef3cb30c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:34.249112 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3992ed-fee9-4fd0-a136-7f7ef3cb30c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:34.249478 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3992ed-fee9-4fd0-a136-7f7ef3cb30c4 admin admin] PATH_INFO: `/v3/projects/3f36512d1f3640c1899b9210d8ba2d34` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:34.250855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3992ed-fee9-4fd0-a136-7f7ef3cb30c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f36512d1f3640c1899b9210d8ba2d34)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:34.253451 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3992ed-fee9-4fd0-a136-7f7ef3cb30c4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:34.296504 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:34.310479 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5d3992ed-fee9-4fd0-a136-7f7ef3cb30c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f36512d1f3640c1899b9210d8ba2d34', 'request_id': 'req-5d3992ed-fee9-4fd0-a136-7f7ef3cb30c4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:34.317166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5d3992ed-fee9-4fd0-a136-7f7ef3cb30c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f36512d1f3640c1899b9210d8ba2d34', 'request_id': 'req-5d3992ed-fee9-4fd0-a136-7f7ef3cb30c4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:34.326676 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5d3992ed-fee9-4fd0-a136-7f7ef3cb30c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f36512d1f3640c1899b9210d8ba2d34', 'request_id': 'req-5d3992ed-fee9-4fd0-a136-7f7ef3cb30c4'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:34.342834 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5d3992ed-fee9-4fd0-a136-7f7ef3cb30c4 admin admin] The token cache is being invalidate because project 3f36512d1f3640c1899b9210d8ba2d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:34.343301 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5d3992ed-fee9-4fd0-a136-7f7ef3cb30c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:34.344311 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5d3992ed-fee9-4fd0-a136-7f7ef3cb30c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:34.346771 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1323/2648] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:34 2022] DELETE /identity/v3/projects/3f36512d1f3640c1899b9210d8ba2d34 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:34.352646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d922e5-4f8e-4ef4-bb2c-8163c4f758d6 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:34.353738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d922e5-4f8e-4ef4-bb2c-8163c4f758d6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:34.353738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d922e5-4f8e-4ef4-bb2c-8163c4f758d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:34.376401 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-96d922e5-4f8e-4ef4-bb2c-8163c4f758d6 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:34.377662 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-96d922e5-4f8e-4ef4-bb2c-8163c4f758d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:34.439856 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1326/2649] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:34.448659 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fae99c-b85d-4468-a6d7-3e5f951dae33 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:34.448952 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fae99c-b85d-4468-a6d7-3e5f951dae33 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:34.449260 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fae99c-b85d-4468-a6d7-3e5f951dae33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:34.469557 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-11fae99c-b85d-4468-a6d7-3e5f951dae33 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:34.470836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-11fae99c-b85d-4468-a6d7-3e5f951dae33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:34.478837 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1324/2650] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:34.483779 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d922e5-4f8e-4ef4-bb2c-8163c4f758d6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:34.493713 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d922e5-4f8e-4ef4-bb2c-8163c4f758d6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:34.498542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04344dc7-74cb-4df7-9df4-cb7f29b47aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:34.499144 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04344dc7-74cb-4df7-9df4-cb7f29b47aac admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:34.499429 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04344dc7-74cb-4df7-9df4-cb7f29b47aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:34.499707 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04344dc7-74cb-4df7-9df4-cb7f29b47aac admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:34.500438 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04344dc7-74cb-4df7-9df4-cb7f29b47aac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:36:34.500748 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04344dc7-74cb-4df7-9df4-cb7f29b47aac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:34.502385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04344dc7-74cb-4df7-9df4-cb7f29b47aac admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:34.514823 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1327/2651] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:36:34.519862 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fae99c-b85d-4468-a6d7-3e5f951dae33 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:34.529743 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fae99c-b85d-4468-a6d7-3e5f951dae33 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:34.535370 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ff8e0-8eb8-4cb4-bd60-3398afb45672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:34.536282 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ff8e0-8eb8-4cb4-bd60-3398afb45672 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:34.536557 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ff8e0-8eb8-4cb4-bd60-3398afb45672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:34.536826 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ff8e0-8eb8-4cb4-bd60-3398afb45672 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:34.537515 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ff8e0-8eb8-4cb4-bd60-3398afb45672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:34.539420 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ff8e0-8eb8-4cb4-bd60-3398afb45672 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:34.564495 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1325/2652] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:34 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:34.570123 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04344dc7-74cb-4df7-9df4-cb7f29b47aac admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:34.585303 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04344dc7-74cb-4df7-9df4-cb7f29b47aac admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:34.644734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df756983-9b33-47eb-bc13-2181b3c50ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:34.645444 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df756983-9b33-47eb-bc13-2181b3c50ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:34.645732 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df756983-9b33-47eb-bc13-2181b3c50ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:34.646012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df756983-9b33-47eb-bc13-2181b3c50ad8 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:34.646741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df756983-9b33-47eb-bc13-2181b3c50ad8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:34.648676 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df756983-9b33-47eb-bc13-2181b3c50ad8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:34.674919 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1328/2653] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:34 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:34.679220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ff8e0-8eb8-4cb4-bd60-3398afb45672 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:34.690019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ff8e0-8eb8-4cb4-bd60-3398afb45672 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:34.695973 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741fc19-1499-4d0d-903d-48cb6a4c8ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:34.696679 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741fc19-1499-4d0d-903d-48cb6a4c8ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:34.697647 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741fc19-1499-4d0d-903d-48cb6a4c8ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:34.697932 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741fc19-1499-4d0d-903d-48cb6a4c8ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:34.698733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741fc19-1499-4d0d-903d-48cb6a4c8ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:34.700796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741fc19-1499-4d0d-903d-48cb6a4c8ec0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:34.711987 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1326/2654] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:34.717595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df756983-9b33-47eb-bc13-2181b3c50ad8 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:34.728082 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df756983-9b33-47eb-bc13-2181b3c50ad8 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:34.732753 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaa34c-4c0d-48af-81b7-a378f829e325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:34.733446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaa34c-4c0d-48af-81b7-a378f829e325 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:34.733758 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaa34c-4c0d-48af-81b7-a378f829e325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:34.734048 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaa34c-4c0d-48af-81b7-a378f829e325 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:34.734838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eaa34c-4c0d-48af-81b7-a378f829e325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:34.736465 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eaa34c-4c0d-48af-81b7-a378f829e325 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:34.748778 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1329/2655] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:34.753000 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741fc19-1499-4d0d-903d-48cb6a4c8ec0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:34.764321 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741fc19-1499-4d0d-903d-48cb6a4c8ec0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:34.769714 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4fdf0-ff5a-44be-8d26-2e34aae60240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:34.770645 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4fdf0-ff5a-44be-8d26-2e34aae60240 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:34.771003 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4fdf0-ff5a-44be-8d26-2e34aae60240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:34.771278 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4fdf0-ff5a-44be-8d26-2e34aae60240 admin admin] PATH_INFO: `/v3/projects/ef51a0ab954d4bb98934460b8c9dcaea/users/69fb8052a13e421fb59c1931e9da24fb/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:34.790715 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4fdf0-ff5a-44be-8d26-2e34aae60240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef51a0ab954d4bb98934460b8c9dcaea, user_id=69fb8052a13e421fb59c1931e9da24fb, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:34.793370 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da4fdf0-ff5a-44be-8d26-2e34aae60240 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:34.807957 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1327/2656] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:34 2022] PUT /identity/v3/projects/ef51a0ab954d4bb98934460b8c9dcaea/users/69fb8052a13e421fb59c1931e9da24fb/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:34.818479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84460467-7d52-4b6d-be09-cf9fff68debe None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:34.818777 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84460467-7d52-4b6d-be09-cf9fff68debe None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:34.819057 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84460467-7d52-4b6d-be09-cf9fff68debe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:34.839414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:34.849703 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-84460467-7d52-4b6d-be09-cf9fff68debe None None] MFA Rules not processed for user `69fb8052a13e421fb59c1931e9da24fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:34.854198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-84460467-7d52-4b6d-be09-cf9fff68debe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:34.919480 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1330/2657] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:34.924109 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4fdf0-ff5a-44be-8d26-2e34aae60240 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:34.986339 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4fdf0-ff5a-44be-8d26-2e34aae60240 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:34.990989 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16310a92-c856-4cb5-a8dc-1ca4574e4233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:34.991636 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16310a92-c856-4cb5-a8dc-1ca4574e4233 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:34.991921 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16310a92-c856-4cb5-a8dc-1ca4574e4233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:34.992198 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16310a92-c856-4cb5-a8dc-1ca4574e4233 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:34.992890 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16310a92-c856-4cb5-a8dc-1ca4574e4233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:34.995324 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16310a92-c856-4cb5-a8dc-1ca4574e4233 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.020822 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1328/2658] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:34 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:35.024887 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84460467-7d52-4b6d-be09-cf9fff68debe None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.036070 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84460467-7d52-4b6d-be09-cf9fff68debe None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.091840 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75ebef-2d0a-4c22-b991-9e0532c2b3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:35.092511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75ebef-2d0a-4c22-b991-9e0532c2b3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.092798 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75ebef-2d0a-4c22-b991-9e0532c2b3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.093079 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75ebef-2d0a-4c22-b991-9e0532c2b3f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.093778 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75ebef-2d0a-4c22-b991-9e0532c2b3f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:35.095751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75ebef-2d0a-4c22-b991-9e0532c2b3f1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.114749 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1331/2659] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:35 2022] POST /identity/v3/users => generated 303 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:35.119714 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16310a92-c856-4cb5-a8dc-1ca4574e4233 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.129950 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16310a92-c856-4cb5-a8dc-1ca4574e4233 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.137181 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438bd55-1e9b-49f9-a4f3-2697a3f7da5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:35.137829 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438bd55-1e9b-49f9-a4f3-2697a3f7da5f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.138111 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438bd55-1e9b-49f9-a4f3-2697a3f7da5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.138427 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438bd55-1e9b-49f9-a4f3-2697a3f7da5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.139148 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438bd55-1e9b-49f9-a4f3-2697a3f7da5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:35.140723 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438bd55-1e9b-49f9-a4f3-2697a3f7da5f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.151738 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1329/2660] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:35.155968 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75ebef-2d0a-4c22-b991-9e0532c2b3f1 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.167400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75ebef-2d0a-4c22-b991-9e0532c2b3f1 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.172189 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e44ef2-b4e6-4e06-8530-d02fb04bb840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:35.173162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e44ef2-b4e6-4e06-8530-d02fb04bb840 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.173453 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e44ef2-b4e6-4e06-8530-d02fb04bb840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.173735 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e44ef2-b4e6-4e06-8530-d02fb04bb840 admin admin] PATH_INFO: `/v3/projects/48b04e3e120647fd802f2921bace1972/users/e7470f5f88294075a10586e997491bdc/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.190912 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e44ef2-b4e6-4e06-8530-d02fb04bb840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48b04e3e120647fd802f2921bace1972, user_id=e7470f5f88294075a10586e997491bdc, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:35.193534 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e44ef2-b4e6-4e06-8530-d02fb04bb840 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.207108 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1332/2661] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:35 2022] PUT /identity/v3/projects/48b04e3e120647fd802f2921bace1972/users/e7470f5f88294075a10586e997491bdc/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:35.211198 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438bd55-1e9b-49f9-a4f3-2697a3f7da5f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.222983 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438bd55-1e9b-49f9-a4f3-2697a3f7da5f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.254408 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:35.284523 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02040dc9-7bcf-4a3c-8de1-cef9c51be4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:35.285218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02040dc9-7bcf-4a3c-8de1-cef9c51be4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.285759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02040dc9-7bcf-4a3c-8de1-cef9c51be4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.286045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02040dc9-7bcf-4a3c-8de1-cef9c51be4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.286845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02040dc9-7bcf-4a3c-8de1-cef9c51be4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:35.288434 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02040dc9-7bcf-4a3c-8de1-cef9c51be4f0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.299035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1330/2662] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:35.303332 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e44ef2-b4e6-4e06-8530-d02fb04bb840 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.314919 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e44ef2-b4e6-4e06-8530-d02fb04bb840 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.319642 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f244698-a93f-4df2-8883-b5226bafebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:35.320536 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f244698-a93f-4df2-8883-b5226bafebd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.320820 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f244698-a93f-4df2-8883-b5226bafebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.321095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f244698-a93f-4df2-8883-b5226bafebd3 admin admin] PATH_INFO: `/v3/projects/48b04e3e120647fd802f2921bace1972/users/e7470f5f88294075a10586e997491bdc/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.323204 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f244698-a93f-4df2-8883-b5226bafebd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48b04e3e120647fd802f2921bace1972, user_id=e7470f5f88294075a10586e997491bdc, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:35.325832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f244698-a93f-4df2-8883-b5226bafebd3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.336396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1333/2663] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:35 2022] PUT /identity/v3/projects/48b04e3e120647fd802f2921bace1972/users/e7470f5f88294075a10586e997491bdc/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:35.346814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f920461-9773-4937-84fe-c28ae87247f6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.347105 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f920461-9773-4937-84fe-c28ae87247f6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.347382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f920461-9773-4937-84fe-c28ae87247f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.375126 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1f920461-9773-4937-84fe-c28ae87247f6 None None] MFA Rules not processed for user `e7470f5f88294075a10586e997491bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:35.376344 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1f920461-9773-4937-84fe-c28ae87247f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:35.446496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1331/2664] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:35.457837 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f244698-a93f-4df2-8883-b5226bafebd3 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.459622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1f244698-a93f-4df2-8883-b5226bafebd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:35.519359 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f244698-a93f-4df2-8883-b5226bafebd3 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.523150 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54949f11-df95-4856-86f9-be62cca8fef2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:35.523833 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54949f11-df95-4856-86f9-be62cca8fef2 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.524122 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54949f11-df95-4856-86f9-be62cca8fef2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.524403 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54949f11-df95-4856-86f9-be62cca8fef2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.531821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:35.534894 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54949f11-df95-4856-86f9-be62cca8fef2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:35.536740 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54949f11-df95-4856-86f9-be62cca8fef2 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.547984 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1334/2665] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:35.596735 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f920461-9773-4937-84fe-c28ae87247f6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:35.598194 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1f920461-9773-4937-84fe-c28ae87247f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:35.610951 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f920461-9773-4937-84fe-c28ae87247f6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:35.614607 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc57e3-1384-4cd7-ae65-f95fc3e0fee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:35.615247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc57e3-1384-4cd7-ae65-f95fc3e0fee3 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:35.615533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc57e3-1384-4cd7-ae65-f95fc3e0fee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:35.615811 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc57e3-1384-4cd7-ae65-f95fc3e0fee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:35.673976 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc57e3-1384-4cd7-ae65-f95fc3e0fee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:35.675517 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc57e3-1384-4cd7-ae65-f95fc3e0fee3 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:35.684512 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1332/2666] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:38.999530 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54949f11-df95-4856-86f9-be62cca8fef2 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:39.067197 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54949f11-df95-4856-86f9-be62cca8fef2 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:39.072750 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db58a15-1e31-4ea0-bdf6-d778f4828081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:39.073629 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db58a15-1e31-4ea0-bdf6-d778f4828081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:39.073918 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db58a15-1e31-4ea0-bdf6-d778f4828081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:39.074194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db58a15-1e31-4ea0-bdf6-d778f4828081 admin admin] PATH_INFO: `/v3/users/69fb8052a13e421fb59c1931e9da24fb` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:39.075441 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db58a15-1e31-4ea0-bdf6-d778f4828081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69fb8052a13e421fb59c1931e9da24fb)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:39.077357 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db58a15-1e31-4ea0-bdf6-d778f4828081 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:39.126146 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9db58a15-1e31-4ea0-bdf6-d778f4828081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69fb8052a13e421fb59c1931e9da24fb'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:39.133012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9db58a15-1e31-4ea0-bdf6-d778f4828081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69fb8052a13e421fb59c1931e9da24fb'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:39.141159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9db58a15-1e31-4ea0-bdf6-d778f4828081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69fb8052a13e421fb59c1931e9da24fb'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:39.141789 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9db58a15-1e31-4ea0-bdf6-d778f4828081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69fb8052a13e421fb59c1931e9da24fb'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:39.142444 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-9db58a15-1e31-4ea0-bdf6-d778f4828081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69fb8052a13e421fb59c1931e9da24fb'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:39.164567 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1335/2667] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:38 2022] DELETE /identity/v3/users/69fb8052a13e421fb59c1931e9da24fb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:39.170050 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66825588-3cd5-4bfe-a32d-209a29d6a544 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:39.170593 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66825588-3cd5-4bfe-a32d-209a29d6a544 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:39.170879 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66825588-3cd5-4bfe-a32d-209a29d6a544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:39.190334 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-66825588-3cd5-4bfe-a32d-209a29d6a544 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:39.191591 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-66825588-3cd5-4bfe-a32d-209a29d6a544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:39.246389 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:39.262519 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1333/2668] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:39.274091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db58a15-1e31-4ea0-bdf6-d778f4828081 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:39.275904 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9db58a15-1e31-4ea0-bdf6-d778f4828081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:39.342254 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db58a15-1e31-4ea0-bdf6-d778f4828081 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:39.346088 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6524d61-e2ac-4520-bf96-322828fc8431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:39.346780 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6524d61-e2ac-4520-bf96-322828fc8431 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:39.347069 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6524d61-e2ac-4520-bf96-322828fc8431 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:39.347347 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6524d61-e2ac-4520-bf96-322828fc8431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:39.358267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6524d61-e2ac-4520-bf96-322828fc8431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:39.359867 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6524d61-e2ac-4520-bf96-322828fc8431 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:39.371496 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1336/2669] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:39.657617 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66825588-3cd5-4bfe-a32d-209a29d6a544 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:39.659187 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-66825588-3cd5-4bfe-a32d-209a29d6a544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:39.673814 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66825588-3cd5-4bfe-a32d-209a29d6a544 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:39.678927 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a3d4a-8a93-47a5-b568-8e69ef06c1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:39.679827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a3d4a-8a93-47a5-b568-8e69ef06c1de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:39.680114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a3d4a-8a93-47a5-b568-8e69ef06c1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:39.680407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a3d4a-8a93-47a5-b568-8e69ef06c1de admin admin] PATH_INFO: `/v3/projects/ef51a0ab954d4bb98934460b8c9dcaea` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:39.682207 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a3d4a-8a93-47a5-b568-8e69ef06c1de admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef51a0ab954d4bb98934460b8c9dcaea)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:39.686032 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a3d4a-8a93-47a5-b568-8e69ef06c1de admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:39.735635 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-052a3d4a-8a93-47a5-b568-8e69ef06c1de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef51a0ab954d4bb98934460b8c9dcaea', 'request_id': 'req-052a3d4a-8a93-47a5-b568-8e69ef06c1de'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:39.741861 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-052a3d4a-8a93-47a5-b568-8e69ef06c1de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef51a0ab954d4bb98934460b8c9dcaea', 'request_id': 'req-052a3d4a-8a93-47a5-b568-8e69ef06c1de'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:39.750425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-052a3d4a-8a93-47a5-b568-8e69ef06c1de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef51a0ab954d4bb98934460b8c9dcaea', 'request_id': 'req-052a3d4a-8a93-47a5-b568-8e69ef06c1de'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:39.760794 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-052a3d4a-8a93-47a5-b568-8e69ef06c1de admin admin] The token cache is being invalidate because project ef51a0ab954d4bb98934460b8c9dcaea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:39.761080 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-052a3d4a-8a93-47a5-b568-8e69ef06c1de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:39.761775 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-052a3d4a-8a93-47a5-b568-8e69ef06c1de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:39.763461 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1334/2670] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:39 2022] DELETE /identity/v3/projects/ef51a0ab954d4bb98934460b8c9dcaea => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:39.767470 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6524d61-e2ac-4520-bf96-322828fc8431 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:39.777231 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6524d61-e2ac-4520-bf96-322828fc8431 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:39.789931 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:39.841385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd82e651-52ee-4c59-af39-7c05dc88ff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:39.843130 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82e651-52ee-4c59-af39-7c05dc88ff32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:39.843130 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82e651-52ee-4c59-af39-7c05dc88ff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:39.843130 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd82e651-52ee-4c59-af39-7c05dc88ff32 admin admin] PATH_INFO: `/v3/users/e7470f5f88294075a10586e997491bdc` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:39.844218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82e651-52ee-4c59-af39-7c05dc88ff32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7470f5f88294075a10586e997491bdc)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:39.846202 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd82e651-52ee-4c59-af39-7c05dc88ff32 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:39.893512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-cd82e651-52ee-4c59-af39-7c05dc88ff32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7470f5f88294075a10586e997491bdc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:39.901129 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-cd82e651-52ee-4c59-af39-7c05dc88ff32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7470f5f88294075a10586e997491bdc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:39.909168 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-cd82e651-52ee-4c59-af39-7c05dc88ff32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7470f5f88294075a10586e997491bdc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:39.909789 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-cd82e651-52ee-4c59-af39-7c05dc88ff32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7470f5f88294075a10586e997491bdc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:39.910424 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-cd82e651-52ee-4c59-af39-7c05dc88ff32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7470f5f88294075a10586e997491bdc'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:39.928772 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1337/2671] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:39 2022] DELETE /identity/v3/users/e7470f5f88294075a10586e997491bdc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:40.217707 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a3d4a-8a93-47a5-b568-8e69ef06c1de admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:40.219323 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-052a3d4a-8a93-47a5-b568-8e69ef06c1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:40.233801 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a3d4a-8a93-47a5-b568-8e69ef06c1de admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:40.300384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33d27e-d540-4965-8f45-e85e60860d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:40.301254 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33d27e-d540-4965-8f45-e85e60860d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:40.301613 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33d27e-d540-4965-8f45-e85e60860d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:40.302076 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33d27e-d540-4965-8f45-e85e60860d36 admin admin] PATH_INFO: `/v3/projects/48b04e3e120647fd802f2921bace1972` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:40.304210 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33d27e-d540-4965-8f45-e85e60860d36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48b04e3e120647fd802f2921bace1972)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:40.306158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e33d27e-d540-4965-8f45-e85e60860d36 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:40.352071 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5e33d27e-d540-4965-8f45-e85e60860d36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48b04e3e120647fd802f2921bace1972', 'request_id': 'req-5e33d27e-d540-4965-8f45-e85e60860d36'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:40.358933 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5e33d27e-d540-4965-8f45-e85e60860d36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48b04e3e120647fd802f2921bace1972', 'request_id': 'req-5e33d27e-d540-4965-8f45-e85e60860d36'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:40.366677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5e33d27e-d540-4965-8f45-e85e60860d36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48b04e3e120647fd802f2921bace1972', 'request_id': 'req-5e33d27e-d540-4965-8f45-e85e60860d36'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:40.377042 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5e33d27e-d540-4965-8f45-e85e60860d36 admin admin] The token cache is being invalidate because project 48b04e3e120647fd802f2921bace1972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:40.377330 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5e33d27e-d540-4965-8f45-e85e60860d36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:40.377959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-5e33d27e-d540-4965-8f45-e85e60860d36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:40.379540 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1335/2672] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:40 2022] DELETE /identity/v3/projects/48b04e3e120647fd802f2921bace1972 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:40.384456 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190acfdc-62d6-4684-b0ac-c6966d4aa32f None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:40.384939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190acfdc-62d6-4684-b0ac-c6966d4aa32f None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:40.385061 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190acfdc-62d6-4684-b0ac-c6966d4aa32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:40.403497 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-190acfdc-62d6-4684-b0ac-c6966d4aa32f None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:40.404717 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-190acfdc-62d6-4684-b0ac-c6966d4aa32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:40.467070 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1338/2673] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:40.475928 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86368053-62b3-4098-96c7-40eb728e621c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:40.476348 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86368053-62b3-4098-96c7-40eb728e621c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:40.476544 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86368053-62b3-4098-96c7-40eb728e621c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:40.483887 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:40.496350 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-86368053-62b3-4098-96c7-40eb728e621c None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:40.498206 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-86368053-62b3-4098-96c7-40eb728e621c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:40.506478 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1336/2674] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:40.511334 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190acfdc-62d6-4684-b0ac-c6966d4aa32f None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:40.521527 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190acfdc-62d6-4684-b0ac-c6966d4aa32f None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:40.526824 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53ee65-7a20-4afd-af55-376b053d9d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:40.527484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53ee65-7a20-4afd-af55-376b053d9d11 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:40.527770 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53ee65-7a20-4afd-af55-376b053d9d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:40.528053 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53ee65-7a20-4afd-af55-376b053d9d11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:40.528783 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53ee65-7a20-4afd-af55-376b053d9d11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:36:40.529092 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53ee65-7a20-4afd-af55-376b053d9d11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:40.530782 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53ee65-7a20-4afd-af55-376b053d9d11 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:40.542816 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1339/2675] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:36:40.547079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86368053-62b3-4098-96c7-40eb728e621c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:40.556443 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86368053-62b3-4098-96c7-40eb728e621c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:40.561093 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe00a67-2a88-485e-be8e-b55ed9ea8621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:40.562714 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe00a67-2a88-485e-be8e-b55ed9ea8621 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:40.562714 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe00a67-2a88-485e-be8e-b55ed9ea8621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:40.562714 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe00a67-2a88-485e-be8e-b55ed9ea8621 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:40.563019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe00a67-2a88-485e-be8e-b55ed9ea8621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:40.564870 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe00a67-2a88-485e-be8e-b55ed9ea8621 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:40.591893 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1337/2676] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:40 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:40.595952 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53ee65-7a20-4afd-af55-376b053d9d11 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:40.606134 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53ee65-7a20-4afd-af55-376b053d9d11 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:40.626286 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:40.665810 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99304a4-12e8-41c8-a397-4fc563df8cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:40.666520 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99304a4-12e8-41c8-a397-4fc563df8cec admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:40.666809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99304a4-12e8-41c8-a397-4fc563df8cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:40.667091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99304a4-12e8-41c8-a397-4fc563df8cec admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:40.667785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99304a4-12e8-41c8-a397-4fc563df8cec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:40.669741 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99304a4-12e8-41c8-a397-4fc563df8cec admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:40.689851 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1340/2677] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:40 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:40.693909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe00a67-2a88-485e-be8e-b55ed9ea8621 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:40.705055 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe00a67-2a88-485e-be8e-b55ed9ea8621 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:40.709772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf520a-398f-43c3-b4dc-4e9307a2839c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:40.710469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf520a-398f-43c3-b4dc-4e9307a2839c admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:40.710760 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf520a-398f-43c3-b4dc-4e9307a2839c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:40.711041 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf520a-398f-43c3-b4dc-4e9307a2839c admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:40.711773 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf520a-398f-43c3-b4dc-4e9307a2839c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:40.714670 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf520a-398f-43c3-b4dc-4e9307a2839c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:40.725588 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1338/2678] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:40.729893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99304a4-12e8-41c8-a397-4fc563df8cec admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:40.739970 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99304a4-12e8-41c8-a397-4fc563df8cec admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:40.744597 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55654f9-a6ec-4013-88df-6579f0a18b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:40.745243 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55654f9-a6ec-4013-88df-6579f0a18b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:40.745527 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55654f9-a6ec-4013-88df-6579f0a18b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:40.745805 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55654f9-a6ec-4013-88df-6579f0a18b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:40.746555 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55654f9-a6ec-4013-88df-6579f0a18b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:40.748177 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55654f9-a6ec-4013-88df-6579f0a18b3e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:40.757911 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1341/2679] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:40.762575 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf520a-398f-43c3-b4dc-4e9307a2839c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:40.772522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf520a-398f-43c3-b4dc-4e9307a2839c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:40.777890 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a4e09-4b6f-4dda-bfe9-43bf692f1e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:40.778801 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a4e09-4b6f-4dda-bfe9-43bf692f1e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:40.779090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a4e09-4b6f-4dda-bfe9-43bf692f1e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:40.779368 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a4e09-4b6f-4dda-bfe9-43bf692f1e47 admin admin] PATH_INFO: `/v3/projects/48a87eaf6cf74cd6ac5764020cb61b90/users/268b3b0c1d6a40e3829a7bab0f1f9cd4/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:40.793992 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a4e09-4b6f-4dda-bfe9-43bf692f1e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a87eaf6cf74cd6ac5764020cb61b90, user_id=268b3b0c1d6a40e3829a7bab0f1f9cd4, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:40.796707 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a4e09-4b6f-4dda-bfe9-43bf692f1e47 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:40.810254 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1339/2680] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:40 2022] PUT /identity/v3/projects/48a87eaf6cf74cd6ac5764020cb61b90/users/268b3b0c1d6a40e3829a7bab0f1f9cd4/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:36:40.822737 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67028d29-643e-4a0d-b912-8a2b59873d3e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:40.823029 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67028d29-643e-4a0d-b912-8a2b59873d3e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:40.823317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67028d29-643e-4a0d-b912-8a2b59873d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:40.849079 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-67028d29-643e-4a0d-b912-8a2b59873d3e None None] MFA Rules not processed for user `268b3b0c1d6a40e3829a7bab0f1f9cd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:40.850385 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-67028d29-643e-4a0d-b912-8a2b59873d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:40.913059 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1342/2681] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:40.917595 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a4e09-4b6f-4dda-bfe9-43bf692f1e47 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:40.979612 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a4e09-4b6f-4dda-bfe9-43bf692f1e47 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:40.984166 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fd4f2-dcbe-42ca-98fe-d9d177801550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:40.984816 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fd4f2-dcbe-42ca-98fe-d9d177801550 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:40.985106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fd4f2-dcbe-42ca-98fe-d9d177801550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:40.985384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fd4f2-dcbe-42ca-98fe-d9d177801550 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:40.986079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63fd4f2-dcbe-42ca-98fe-d9d177801550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:40.988006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63fd4f2-dcbe-42ca-98fe-d9d177801550 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:41.013323 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1340/2682] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:40 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:41.017409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67028d29-643e-4a0d-b912-8a2b59873d3e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:41.028064 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67028d29-643e-4a0d-b912-8a2b59873d3e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:41.085189 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111b5d3-9e0d-4112-aff6-5f23e6d0f1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:41.085860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111b5d3-9e0d-4112-aff6-5f23e6d0f1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:41.086147 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111b5d3-9e0d-4112-aff6-5f23e6d0f1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:41.086460 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111b5d3-9e0d-4112-aff6-5f23e6d0f1c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:41.087159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111b5d3-9e0d-4112-aff6-5f23e6d0f1c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:41.089112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111b5d3-9e0d-4112-aff6-5f23e6d0f1c7 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:41.108594 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1343/2683] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:41 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:41.112618 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fd4f2-dcbe-42ca-98fe-d9d177801550 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:41.123987 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fd4f2-dcbe-42ca-98fe-d9d177801550 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:41.129163 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfe61d-c24a-49bc-a692-e525bcc3a736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:41.129827 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfe61d-c24a-49bc-a692-e525bcc3a736 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:41.130112 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfe61d-c24a-49bc-a692-e525bcc3a736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:41.130433 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfe61d-c24a-49bc-a692-e525bcc3a736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:41.131171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbfe61d-c24a-49bc-a692-e525bcc3a736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:41.132765 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbfe61d-c24a-49bc-a692-e525bcc3a736 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:41.144469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1341/2684] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:41.148511 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111b5d3-9e0d-4112-aff6-5f23e6d0f1c7 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:41.158510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111b5d3-9e0d-4112-aff6-5f23e6d0f1c7 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:41.163357 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4af94-cc14-4bf9-9097-c8de7c162d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:41.164011 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4af94-cc14-4bf9-9097-c8de7c162d06 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:41.164292 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4af94-cc14-4bf9-9097-c8de7c162d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:41.164566 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4af94-cc14-4bf9-9097-c8de7c162d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:41.165276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4af94-cc14-4bf9-9097-c8de7c162d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:41.167368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4af94-cc14-4bf9-9097-c8de7c162d06 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:41.177009 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1344/2685] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:41.181728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfe61d-c24a-49bc-a692-e525bcc3a736 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:41.191979 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfe61d-c24a-49bc-a692-e525bcc3a736 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:41.197045 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d163ca-572a-40e4-87ed-1907d1331f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:41.197918 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d163ca-572a-40e4-87ed-1907d1331f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:41.198203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d163ca-572a-40e4-87ed-1907d1331f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:41.198497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d163ca-572a-40e4-87ed-1907d1331f0a admin admin] PATH_INFO: `/v3/projects/0786bc9cc20344eab85f3f51fa7dd02e/users/6b1167fd9fd24c9f9f9adb8c22a6e5b8/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:41.213364 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d163ca-572a-40e4-87ed-1907d1331f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0786bc9cc20344eab85f3f51fa7dd02e, user_id=6b1167fd9fd24c9f9f9adb8c22a6e5b8, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:41.216031 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d163ca-572a-40e4-87ed-1907d1331f0a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:41.229142 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1342/2686] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:41 2022] PUT /identity/v3/projects/0786bc9cc20344eab85f3f51fa7dd02e/users/6b1167fd9fd24c9f9f9adb8c22a6e5b8/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:41.239593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af134e3-f2b6-4d03-b84c-92f6460c57bd None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:41.239830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af134e3-f2b6-4d03-b84c-92f6460c57bd None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:41.240112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af134e3-f2b6-4d03-b84c-92f6460c57bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:41.260082 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:41.269050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4af134e3-f2b6-4d03-b84c-92f6460c57bd None None] MFA Rules not processed for user `6b1167fd9fd24c9f9f9adb8c22a6e5b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:41.270609 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4af134e3-f2b6-4d03-b84c-92f6460c57bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:41.338880 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1345/2687] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:41.343435 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d163ca-572a-40e4-87ed-1907d1331f0a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:41.393518 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:41.406049 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d163ca-572a-40e4-87ed-1907d1331f0a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:41.411081 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90f3de-f60b-4c22-ab9e-918dbc095fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:41.411730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90f3de-f60b-4c22-ab9e-918dbc095fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:41.412017 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90f3de-f60b-4c22-ab9e-918dbc095fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:41.412304 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90f3de-f60b-4c22-ab9e-918dbc095fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:41.413007 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90f3de-f60b-4c22-ab9e-918dbc095fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:41.414926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90f3de-f60b-4c22-ab9e-918dbc095fe4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:41.440529 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1343/2688] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:41 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:41.444681 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af134e3-f2b6-4d03-b84c-92f6460c57bd None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:41.455462 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af134e3-f2b6-4d03-b84c-92f6460c57bd None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:41.514747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00427b3-77e9-4fc7-b5de-dfaad71fff59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:41.515369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00427b3-77e9-4fc7-b5de-dfaad71fff59 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:41.515661 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00427b3-77e9-4fc7-b5de-dfaad71fff59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:41.515967 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00427b3-77e9-4fc7-b5de-dfaad71fff59 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:41.516709 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00427b3-77e9-4fc7-b5de-dfaad71fff59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:41.518755 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00427b3-77e9-4fc7-b5de-dfaad71fff59 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:41.539314 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1346/2689] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:41 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:36:41.543830 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90f3de-f60b-4c22-ab9e-918dbc095fe4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:41.554247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90f3de-f60b-4c22-ab9e-918dbc095fe4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:41.559729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80726b81-0bed-429b-950a-87f04799c3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:41.560411 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80726b81-0bed-429b-950a-87f04799c3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:41.560701 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80726b81-0bed-429b-950a-87f04799c3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:41.560983 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80726b81-0bed-429b-950a-87f04799c3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:41.561717 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80726b81-0bed-429b-950a-87f04799c3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:41.563337 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80726b81-0bed-429b-950a-87f04799c3e9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:41.574502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1344/2690] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:41.578855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00427b3-77e9-4fc7-b5de-dfaad71fff59 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:41.589390 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00427b3-77e9-4fc7-b5de-dfaad71fff59 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:41.594015 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4e0f7-e73e-4b3d-a378-4ddf494e6477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:41.594932 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4e0f7-e73e-4b3d-a378-4ddf494e6477 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:41.595214 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4e0f7-e73e-4b3d-a378-4ddf494e6477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:41.595491 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4e0f7-e73e-4b3d-a378-4ddf494e6477 admin admin] PATH_INFO: `/v3/projects/76ccf13f0fe449ffaace93fd22fcaac6/users/09f23adcaabd4bc69699fab614f06bb2/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:41.610766 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a4e0f7-e73e-4b3d-a378-4ddf494e6477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ccf13f0fe449ffaace93fd22fcaac6, user_id=09f23adcaabd4bc69699fab614f06bb2, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:41.613391 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a4e0f7-e73e-4b3d-a378-4ddf494e6477 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:41.627165 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1347/2691] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:41 2022] PUT /identity/v3/projects/76ccf13f0fe449ffaace93fd22fcaac6/users/09f23adcaabd4bc69699fab614f06bb2/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:41.631141 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80726b81-0bed-429b-950a-87f04799c3e9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:41.641169 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80726b81-0bed-429b-950a-87f04799c3e9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:41.696203 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c50dc-ee61-4e0e-bc59-4113897a4b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:41.696888 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c50dc-ee61-4e0e-bc59-4113897a4b35 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:41.697186 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c50dc-ee61-4e0e-bc59-4113897a4b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:41.697495 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c50dc-ee61-4e0e-bc59-4113897a4b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:41.698151 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c50dc-ee61-4e0e-bc59-4113897a4b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:41.699758 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c50dc-ee61-4e0e-bc59-4113897a4b35 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:41.709337 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1345/2692] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:41.714260 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4e0f7-e73e-4b3d-a378-4ddf494e6477 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:41.724647 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4e0f7-e73e-4b3d-a378-4ddf494e6477 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:41.730014 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae75c8-ccfb-4603-970d-f3fa969b5042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:41.730938 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae75c8-ccfb-4603-970d-f3fa969b5042 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:41.731221 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae75c8-ccfb-4603-970d-f3fa969b5042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:41.731498 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae75c8-ccfb-4603-970d-f3fa969b5042 admin admin] PATH_INFO: `/v3/projects/76ccf13f0fe449ffaace93fd22fcaac6/users/09f23adcaabd4bc69699fab614f06bb2/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:41.733484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae75c8-ccfb-4603-970d-f3fa969b5042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ccf13f0fe449ffaace93fd22fcaac6, user_id=09f23adcaabd4bc69699fab614f06bb2, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:41.736130 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae75c8-ccfb-4603-970d-f3fa969b5042 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:41.746317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1348/2693] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:41 2022] PUT /identity/v3/projects/76ccf13f0fe449ffaace93fd22fcaac6/users/09f23adcaabd4bc69699fab614f06bb2/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:36:41.757631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be696cd3-1cbf-4866-aeef-44837fca7a2f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:41.757945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be696cd3-1cbf-4866-aeef-44837fca7a2f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:41.758233 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be696cd3-1cbf-4866-aeef-44837fca7a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:41.786498 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-be696cd3-1cbf-4866-aeef-44837fca7a2f None None] MFA Rules not processed for user `09f23adcaabd4bc69699fab614f06bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:41.787634 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-be696cd3-1cbf-4866-aeef-44837fca7a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:41.855809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1346/2694] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:41.867024 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae75c8-ccfb-4603-970d-f3fa969b5042 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:41.868734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-00ae75c8-ccfb-4603-970d-f3fa969b5042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:41.925600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae75c8-ccfb-4603-970d-f3fa969b5042 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:41.929268 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ae245-adb8-48c6-8ac9-d3a1c4a34f81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:41.929908 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ae245-adb8-48c6-8ac9-d3a1c4a34f81 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:41.930193 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ae245-adb8-48c6-8ac9-d3a1c4a34f81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:41.930497 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ae245-adb8-48c6-8ac9-d3a1c4a34f81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:41.935727 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:41.988831 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ae245-adb8-48c6-8ac9-d3a1c4a34f81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:41.990274 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ae245-adb8-48c6-8ac9-d3a1c4a34f81 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:41.999415 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1349/2695] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:43.486104 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be696cd3-1cbf-4866-aeef-44837fca7a2f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:43.487568 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-be696cd3-1cbf-4866-aeef-44837fca7a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:43.500271 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be696cd3-1cbf-4866-aeef-44837fca7a2f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:43.503837 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35149e3-df3e-4a61-a160-ddca4f73b0b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:43.504469 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35149e3-df3e-4a61-a160-ddca4f73b0b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:43.504749 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35149e3-df3e-4a61-a160-ddca4f73b0b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:43.505025 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35149e3-df3e-4a61-a160-ddca4f73b0b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:43.551945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:43.566051 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35149e3-df3e-4a61-a160-ddca4f73b0b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:43.567533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35149e3-df3e-4a61-a160-ddca4f73b0b6 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:43.576501 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1347/2696] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:44.111444 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ae245-adb8-48c6-8ac9-d3a1c4a34f81 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:44.120990 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ae245-adb8-48c6-8ac9-d3a1c4a34f81 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:44.125720 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a61f7-860e-4620-ac38-109421a760ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:44.126398 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a61f7-860e-4620-ac38-109421a760ae service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:44.126684 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a61f7-860e-4620-ac38-109421a760ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:44.126962 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a61f7-860e-4620-ac38-109421a760ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:44.136415 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a61f7-860e-4620-ac38-109421a760ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:44.137837 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a61f7-860e-4620-ac38-109421a760ae service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:44.147427 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1350/2697] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:47.039314 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35149e3-df3e-4a61-a160-ddca4f73b0b6 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:47.041629 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d35149e3-df3e-4a61-a160-ddca4f73b0b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:47.123330 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35149e3-df3e-4a61-a160-ddca4f73b0b6 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:47.128770 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f28c7-5e34-4512-bebb-68feb75507da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:47.129421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f28c7-5e34-4512-bebb-68feb75507da service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:47.129716 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f28c7-5e34-4512-bebb-68feb75507da service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:47.129992 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f28c7-5e34-4512-bebb-68feb75507da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:47.131812 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e16f28c7-5e34-4512-bebb-68feb75507da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:47.224709 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f28c7-5e34-4512-bebb-68feb75507da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:47.227760 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f28c7-5e34-4512-bebb-68feb75507da service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:47.260099 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1348/2698] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:47.992303 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a61f7-860e-4620-ac38-109421a760ae service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:48.054531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a61f7-860e-4620-ac38-109421a760ae service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:48.060040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef9332-a007-4695-98fe-8ac9bcca323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:48.060910 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef9332-a007-4695-98fe-8ac9bcca323d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:48.061196 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef9332-a007-4695-98fe-8ac9bcca323d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:48.061474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef9332-a007-4695-98fe-8ac9bcca323d admin admin] PATH_INFO: `/v3/users/268b3b0c1d6a40e3829a7bab0f1f9cd4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:48.062697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef9332-a007-4695-98fe-8ac9bcca323d admin admin] RBAC: Authorizing `identity:delete_user(user_id=268b3b0c1d6a40e3829a7bab0f1f9cd4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:48.064626 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef9332-a007-4695-98fe-8ac9bcca323d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:48.110797 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e5ef9332-a007-4695-98fe-8ac9bcca323d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '268b3b0c1d6a40e3829a7bab0f1f9cd4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.117980 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e5ef9332-a007-4695-98fe-8ac9bcca323d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '268b3b0c1d6a40e3829a7bab0f1f9cd4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.126159 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e5ef9332-a007-4695-98fe-8ac9bcca323d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '268b3b0c1d6a40e3829a7bab0f1f9cd4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.126884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e5ef9332-a007-4695-98fe-8ac9bcca323d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '268b3b0c1d6a40e3829a7bab0f1f9cd4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.127492 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e5ef9332-a007-4695-98fe-8ac9bcca323d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '268b3b0c1d6a40e3829a7bab0f1f9cd4'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.144345 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1351/2699] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:47 2022] DELETE /identity/v3/users/268b3b0c1d6a40e3829a7bab0f1f9cd4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:48.149275 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8831352-c880-427c-ae1e-7adfd08d232e None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:48.149796 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8831352-c880-427c-ae1e-7adfd08d232e None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:48.149911 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8831352-c880-427c-ae1e-7adfd08d232e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:48.168511 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c8831352-c880-427c-ae1e-7adfd08d232e None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:48.169739 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c8831352-c880-427c-ae1e-7adfd08d232e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:48.217121 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:48.230744 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1349/2700] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:48.240505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef9332-a007-4695-98fe-8ac9bcca323d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:48.241997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e5ef9332-a007-4695-98fe-8ac9bcca323d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:48.257461 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:48.304574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef9332-a007-4695-98fe-8ac9bcca323d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:48.308900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f02830-0357-4596-a6fb-b9a5fef66316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:48.309658 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f02830-0357-4596-a6fb-b9a5fef66316 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:48.309983 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f02830-0357-4596-a6fb-b9a5fef66316 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:48.310264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f02830-0357-4596-a6fb-b9a5fef66316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:48.320117 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f02830-0357-4596-a6fb-b9a5fef66316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:48.321586 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f02830-0357-4596-a6fb-b9a5fef66316 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:48.331295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1352/2701] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:36:48.617186 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8831352-c880-427c-ae1e-7adfd08d232e None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:48.618934 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c8831352-c880-427c-ae1e-7adfd08d232e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:48.638355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8831352-c880-427c-ae1e-7adfd08d232e None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:48.644695 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f427be-e169-443c-bf33-ccae58f7a8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:48.645681 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f427be-e169-443c-bf33-ccae58f7a8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:48.645842 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f427be-e169-443c-bf33-ccae58f7a8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:48.646118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f427be-e169-443c-bf33-ccae58f7a8a7 admin admin] PATH_INFO: `/v3/projects/48a87eaf6cf74cd6ac5764020cb61b90` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:48.647623 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f427be-e169-443c-bf33-ccae58f7a8a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48a87eaf6cf74cd6ac5764020cb61b90)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:48.650560 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f427be-e169-443c-bf33-ccae58f7a8a7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:48.703480 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-40f427be-e169-443c-bf33-ccae58f7a8a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a87eaf6cf74cd6ac5764020cb61b90', 'request_id': 'req-40f427be-e169-443c-bf33-ccae58f7a8a7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.710106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-40f427be-e169-443c-bf33-ccae58f7a8a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a87eaf6cf74cd6ac5764020cb61b90', 'request_id': 'req-40f427be-e169-443c-bf33-ccae58f7a8a7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.719532 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-40f427be-e169-443c-bf33-ccae58f7a8a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a87eaf6cf74cd6ac5764020cb61b90', 'request_id': 'req-40f427be-e169-443c-bf33-ccae58f7a8a7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.732341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-40f427be-e169-443c-bf33-ccae58f7a8a7 admin admin] The token cache is being invalidate because project 48a87eaf6cf74cd6ac5764020cb61b90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:48.732632 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-40f427be-e169-443c-bf33-ccae58f7a8a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.733403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-40f427be-e169-443c-bf33-ccae58f7a8a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.735356 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1350/2702] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:48 2022] DELETE /identity/v3/projects/48a87eaf6cf74cd6ac5764020cb61b90 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:48.739532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f02830-0357-4596-a6fb-b9a5fef66316 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:48.749486 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f02830-0357-4596-a6fb-b9a5fef66316 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:48.821224 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fead779-57c7-4dda-b32f-421dc9b30b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:48.822857 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fead779-57c7-4dda-b32f-421dc9b30b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:48.823148 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fead779-57c7-4dda-b32f-421dc9b30b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:48.823556 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fead779-57c7-4dda-b32f-421dc9b30b93 admin admin] PATH_INFO: `/v3/users/6b1167fd9fd24c9f9f9adb8c22a6e5b8` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:48.824869 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fead779-57c7-4dda-b32f-421dc9b30b93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b1167fd9fd24c9f9f9adb8c22a6e5b8)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:48.827052 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fead779-57c7-4dda-b32f-421dc9b30b93 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:48.903294 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4fead779-57c7-4dda-b32f-421dc9b30b93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b1167fd9fd24c9f9f9adb8c22a6e5b8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.922030 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4fead779-57c7-4dda-b32f-421dc9b30b93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b1167fd9fd24c9f9f9adb8c22a6e5b8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.933194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4fead779-57c7-4dda-b32f-421dc9b30b93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b1167fd9fd24c9f9f9adb8c22a6e5b8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.934569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4fead779-57c7-4dda-b32f-421dc9b30b93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b1167fd9fd24c9f9f9adb8c22a6e5b8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.935485 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-4fead779-57c7-4dda-b32f-421dc9b30b93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b1167fd9fd24c9f9f9adb8c22a6e5b8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:48.958353 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1353/2703] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:48 2022] DELETE /identity/v3/users/6b1167fd9fd24c9f9f9adb8c22a6e5b8 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:49.274982 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f427be-e169-443c-bf33-ccae58f7a8a7 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:49.276799 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-40f427be-e169-443c-bf33-ccae58f7a8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:49.291461 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f427be-e169-443c-bf33-ccae58f7a8a7 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:49.356176 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4df60-1251-442e-b3ba-4006dada3227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:49.356959 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4df60-1251-442e-b3ba-4006dada3227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:49.357247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4df60-1251-442e-b3ba-4006dada3227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:49.357527 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4df60-1251-442e-b3ba-4006dada3227 admin admin] PATH_INFO: `/v3/projects/0786bc9cc20344eab85f3f51fa7dd02e` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:49.358755 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4df60-1251-442e-b3ba-4006dada3227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0786bc9cc20344eab85f3f51fa7dd02e)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:49.360656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4df60-1251-442e-b3ba-4006dada3227 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:49.407981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-09d4df60-1251-442e-b3ba-4006dada3227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0786bc9cc20344eab85f3f51fa7dd02e', 'request_id': 'req-09d4df60-1251-442e-b3ba-4006dada3227'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:49.414350 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-09d4df60-1251-442e-b3ba-4006dada3227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0786bc9cc20344eab85f3f51fa7dd02e', 'request_id': 'req-09d4df60-1251-442e-b3ba-4006dada3227'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:49.422220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-09d4df60-1251-442e-b3ba-4006dada3227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0786bc9cc20344eab85f3f51fa7dd02e', 'request_id': 'req-09d4df60-1251-442e-b3ba-4006dada3227'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:49.432916 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-09d4df60-1251-442e-b3ba-4006dada3227 admin admin] The token cache is being invalidate because project 0786bc9cc20344eab85f3f51fa7dd02e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:49.433201 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-09d4df60-1251-442e-b3ba-4006dada3227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:49.433818 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-09d4df60-1251-442e-b3ba-4006dada3227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:49.435397 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1351/2704] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:49 2022] DELETE /identity/v3/projects/0786bc9cc20344eab85f3f51fa7dd02e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:49.439725 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fead779-57c7-4dda-b32f-421dc9b30b93 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:49.441163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4fead779-57c7-4dda-b32f-421dc9b30b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:49.454326 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fead779-57c7-4dda-b32f-421dc9b30b93 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:49.488208 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:49.517587 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afa5ec-96f7-4649-bdb2-0fb408efbd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:49.518437 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afa5ec-96f7-4649-bdb2-0fb408efbd40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:49.518728 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afa5ec-96f7-4649-bdb2-0fb408efbd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:49.519012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afa5ec-96f7-4649-bdb2-0fb408efbd40 admin admin] PATH_INFO: `/v3/users/09f23adcaabd4bc69699fab614f06bb2` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:49.520258 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6afa5ec-96f7-4649-bdb2-0fb408efbd40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09f23adcaabd4bc69699fab614f06bb2)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:49.522204 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6afa5ec-96f7-4649-bdb2-0fb408efbd40 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:49.584256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e6afa5ec-96f7-4649-bdb2-0fb408efbd40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09f23adcaabd4bc69699fab614f06bb2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:49.591923 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e6afa5ec-96f7-4649-bdb2-0fb408efbd40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09f23adcaabd4bc69699fab614f06bb2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:49.603399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e6afa5ec-96f7-4649-bdb2-0fb408efbd40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09f23adcaabd4bc69699fab614f06bb2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:49.604396 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e6afa5ec-96f7-4649-bdb2-0fb408efbd40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09f23adcaabd4bc69699fab614f06bb2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:49.605386 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e6afa5ec-96f7-4649-bdb2-0fb408efbd40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09f23adcaabd4bc69699fab614f06bb2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:49.629194 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1354/2705] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:36:49 2022] DELETE /identity/v3/users/09f23adcaabd4bc69699fab614f06bb2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:49.917396 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4df60-1251-442e-b3ba-4006dada3227 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:49.919483 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-09d4df60-1251-442e-b3ba-4006dada3227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:49.932873 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4df60-1251-442e-b3ba-4006dada3227 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:49.936789 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:49.999947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6615d00-221f-4c78-84c8-281a1ef58318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:50.000783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6615d00-221f-4c78-84c8-281a1ef58318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:50.001063 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6615d00-221f-4c78-84c8-281a1ef58318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:50.001338 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6615d00-221f-4c78-84c8-281a1ef58318 admin admin] PATH_INFO: `/v3/projects/76ccf13f0fe449ffaace93fd22fcaac6` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:50.002594 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6615d00-221f-4c78-84c8-281a1ef58318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76ccf13f0fe449ffaace93fd22fcaac6)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:50.004474 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6615d00-221f-4c78-84c8-281a1ef58318 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:50.055882 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e6615d00-221f-4c78-84c8-281a1ef58318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76ccf13f0fe449ffaace93fd22fcaac6', 'request_id': 'req-e6615d00-221f-4c78-84c8-281a1ef58318'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:50.066038 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e6615d00-221f-4c78-84c8-281a1ef58318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76ccf13f0fe449ffaace93fd22fcaac6', 'request_id': 'req-e6615d00-221f-4c78-84c8-281a1ef58318'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:50.074708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e6615d00-221f-4c78-84c8-281a1ef58318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76ccf13f0fe449ffaace93fd22fcaac6', 'request_id': 'req-e6615d00-221f-4c78-84c8-281a1ef58318'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:50.092093 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e6615d00-221f-4c78-84c8-281a1ef58318 admin admin] The token cache is being invalidate because project 76ccf13f0fe449ffaace93fd22fcaac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:36:50.092389 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e6615d00-221f-4c78-84c8-281a1ef58318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:50.093032 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-e6615d00-221f-4c78-84c8-281a1ef58318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:36:50.094655 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1352/2706] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:36:49 2022] DELETE /identity/v3/projects/76ccf13f0fe449ffaace93fd22fcaac6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:50.100254 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c50bf5-36f7-4eaa-a00a-a37e282db106 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:50.100542 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c50bf5-36f7-4eaa-a00a-a37e282db106 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:50.100823 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c50bf5-36f7-4eaa-a00a-a37e282db106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:50.119903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-f8c50bf5-36f7-4eaa-a00a-a37e282db106 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:50.121114 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f8c50bf5-36f7-4eaa-a00a-a37e282db106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:50.180447 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1355/2707] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:50.188313 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27984e22-6a08-4df6-a248-c3a0ea90d356 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:50.188619 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27984e22-6a08-4df6-a248-c3a0ea90d356 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:50.188878 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27984e22-6a08-4df6-a248-c3a0ea90d356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:50.207954 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-27984e22-6a08-4df6-a248-c3a0ea90d356 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:50.209182 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-27984e22-6a08-4df6-a248-c3a0ea90d356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:50.217910 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1353/2708] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:50.222497 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c50bf5-36f7-4eaa-a00a-a37e282db106 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:50.232412 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c50bf5-36f7-4eaa-a00a-a37e282db106 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:50.237587 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6bb09-f361-48b7-92f7-fe7e18591df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:50.238252 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6bb09-f361-48b7-92f7-fe7e18591df5 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:50.238593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6bb09-f361-48b7-92f7-fe7e18591df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:50.238868 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6bb09-f361-48b7-92f7-fe7e18591df5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:50.239602 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6bb09-f361-48b7-92f7-fe7e18591df5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:36:50.239905 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6bb09-f361-48b7-92f7-fe7e18591df5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:50.241496 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6bb09-f361-48b7-92f7-fe7e18591df5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:50.253543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1356/2709] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:36:50.258207 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27984e22-6a08-4df6-a248-c3a0ea90d356 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:50.273822 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27984e22-6a08-4df6-a248-c3a0ea90d356 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:50.280321 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e7f7d-d3e8-457f-92ab-a009ac957038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:50.281127 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e7f7d-d3e8-457f-92ab-a009ac957038 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:50.281441 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e7f7d-d3e8-457f-92ab-a009ac957038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:50.281842 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e7f7d-d3e8-457f-92ab-a009ac957038 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:50.282807 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e7f7d-d3e8-457f-92ab-a009ac957038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:50.285336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e7f7d-d3e8-457f-92ab-a009ac957038 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:50.319883 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1354/2710] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:36:50 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:36:50.322011 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6bb09-f361-48b7-92f7-fe7e18591df5 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:50.333661 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6bb09-f361-48b7-92f7-fe7e18591df5 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:50.381730 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:50.402165 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e9447-f256-4c26-89bd-c0cbc582f307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:50.402880 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e9447-f256-4c26-89bd-c0cbc582f307 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:50.403235 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e9447-f256-4c26-89bd-c0cbc582f307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:50.403514 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e9447-f256-4c26-89bd-c0cbc582f307 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:50.404244 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e9447-f256-4c26-89bd-c0cbc582f307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:50.406316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e9447-f256-4c26-89bd-c0cbc582f307 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:50.426611 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1357/2711] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:36:50 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:36:50.430975 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e7f7d-d3e8-457f-92ab-a009ac957038 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:50.441403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e7f7d-d3e8-457f-92ab-a009ac957038 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:50.446055 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d6998-60bf-46ce-ba45-fa88fa30dec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:50.447259 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d6998-60bf-46ce-ba45-fa88fa30dec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:50.447537 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d6998-60bf-46ce-ba45-fa88fa30dec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:50.447807 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d6998-60bf-46ce-ba45-fa88fa30dec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:50.448533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d6998-60bf-46ce-ba45-fa88fa30dec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:50.450107 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d6998-60bf-46ce-ba45-fa88fa30dec1 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:50.460653 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1355/2712] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:50.465465 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e9447-f256-4c26-89bd-c0cbc582f307 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:50.476386 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e9447-f256-4c26-89bd-c0cbc582f307 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:50.481242 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1d882-39d1-4250-98f2-9668ea6c2800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:50.481924 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1d882-39d1-4250-98f2-9668ea6c2800 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:50.482217 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1d882-39d1-4250-98f2-9668ea6c2800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:50.482530 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1d882-39d1-4250-98f2-9668ea6c2800 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:50.483279 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1d882-39d1-4250-98f2-9668ea6c2800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:50.484935 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1d882-39d1-4250-98f2-9668ea6c2800 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:50.495381 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1358/2713] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:36:50.499525 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d6998-60bf-46ce-ba45-fa88fa30dec1 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:50.510632 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d6998-60bf-46ce-ba45-fa88fa30dec1 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:50.515863 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fce90-5d4f-4b8f-957e-1e5b710752ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:50.516822 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fce90-5d4f-4b8f-957e-1e5b710752ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:50.517089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fce90-5d4f-4b8f-957e-1e5b710752ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:50.517393 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fce90-5d4f-4b8f-957e-1e5b710752ba admin admin] PATH_INFO: `/v3/projects/3f60f2bbe75446379a77148133d3d53b/users/0507129e889c4de6b1bdfca5a19a8727/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:50.532720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fce90-5d4f-4b8f-957e-1e5b710752ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f60f2bbe75446379a77148133d3d53b, user_id=0507129e889c4de6b1bdfca5a19a8727, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:50.535413 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fce90-5d4f-4b8f-957e-1e5b710752ba admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:50.548531 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1356/2714] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:36:50 2022] PUT /identity/v3/projects/3f60f2bbe75446379a77148133d3d53b/users/0507129e889c4de6b1bdfca5a19a8727/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:36:50.614560 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedadace-fb3f-488d-b93f-69c7520ff88b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:50.614916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedadace-fb3f-488d-b93f-69c7520ff88b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:50.615286 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedadace-fb3f-488d-b93f-69c7520ff88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:50.650458 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-dedadace-fb3f-488d-b93f-69c7520ff88b None None] MFA Rules not processed for user `0507129e889c4de6b1bdfca5a19a8727`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:36:50.651721 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-dedadace-fb3f-488d-b93f-69c7520ff88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:50.718653 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1359/2715] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:36:50.730969 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fce90-5d4f-4b8f-957e-1e5b710752ba admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:36:50.732905 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-713fce90-5d4f-4b8f-957e-1e5b710752ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:36:50.774019 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:36:50.825247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fce90-5d4f-4b8f-957e-1e5b710752ba admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:36:50.830870 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ceeb15-c8f3-4e27-ad51-69ca04188a7f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '36f646c526a044e8b5b6e74aa64cf6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:36:50.831583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ceeb15-c8f3-4e27-ad51-69ca04188a7f service glance] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:36:50.831862 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ceeb15-c8f3-4e27-ad51-69ca04188a7f service glance] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:36:50.832140 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ceeb15-c8f3-4e27-ad51-69ca04188a7f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:36:50.841847 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ceeb15-c8f3-4e27-ad51-69ca04188a7f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:36:50.843225 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ceeb15-c8f3-4e27-ad51-69ca04188a7f service glance] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:36:50.852882 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1357/2716] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:36:50 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:00.715731 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=47,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:00.848425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=20 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:02.143308 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedadace-fb3f-488d-b93f-69c7520ff88b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:02.144777 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-dedadace-fb3f-488d-b93f-69c7520ff88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:02.211283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedadace-fb3f-488d-b93f-69c7520ff88b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:02.215414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07484c9-040c-4d74-9567-75e59c51354d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:02.216063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07484c9-040c-4d74-9567-75e59c51354d service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:02.216344 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07484c9-040c-4d74-9567-75e59c51354d service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:02.216621 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07484c9-040c-4d74-9567-75e59c51354d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:02.218826 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-c07484c9-040c-4d74-9567-75e59c51354d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:02.284198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07484c9-040c-4d74-9567-75e59c51354d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:02.285241 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07484c9-040c-4d74-9567-75e59c51354d service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:02.296002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1360/2717] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:05.642938 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ceeb15-c8f3-4e27-ad51-69ca04188a7f service glance] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:05.645050 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-62ceeb15-c8f3-4e27-ad51-69ca04188a7f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:05.661798 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ceeb15-c8f3-4e27-ad51-69ca04188a7f service glance] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:05.668110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209abf2-0657-42ed-9acb-33c589171246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:05.669143 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209abf2-0657-42ed-9acb-33c589171246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:05.669473 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209abf2-0657-42ed-9acb-33c589171246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:05.669846 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209abf2-0657-42ed-9acb-33c589171246 admin admin] PATH_INFO: `/v3/users/1198a00eb02c41bc9f3b511f14e4503b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:05.671480 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209abf2-0657-42ed-9acb-33c589171246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1198a00eb02c41bc9f3b511f14e4503b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:05.674577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209abf2-0657-42ed-9acb-33c589171246 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:05.735462 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0209abf2-0657-42ed-9acb-33c589171246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1198a00eb02c41bc9f3b511f14e4503b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:05.742570 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0209abf2-0657-42ed-9acb-33c589171246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1198a00eb02c41bc9f3b511f14e4503b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:05.763250 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0209abf2-0657-42ed-9acb-33c589171246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1198a00eb02c41bc9f3b511f14e4503b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:05.772900 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0209abf2-0657-42ed-9acb-33c589171246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1198a00eb02c41bc9f3b511f14e4503b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:05.773432 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-0209abf2-0657-42ed-9acb-33c589171246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1198a00eb02c41bc9f3b511f14e4503b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:05.780830 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1358/2718] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:05 2022] DELETE /identity/v3/users/1198a00eb02c41bc9f3b511f14e4503b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:05.970615 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07484c9-040c-4d74-9567-75e59c51354d service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:05.983226 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07484c9-040c-4d74-9567-75e59c51354d service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:06.060387 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbeadcd-6ce4-4a65-9c0e-14086ab1e2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:06.061256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbeadcd-6ce4-4a65-9c0e-14086ab1e2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.061541 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbeadcd-6ce4-4a65-9c0e-14086ab1e2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.061822 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbeadcd-6ce4-4a65-9c0e-14086ab1e2f8 admin admin] PATH_INFO: `/v3/projects/d0f50812c08741a9be23b584fe708821` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.063033 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbeadcd-6ce4-4a65-9c0e-14086ab1e2f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0f50812c08741a9be23b584fe708821)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:06.064940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbeadcd-6ce4-4a65-9c0e-14086ab1e2f8 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:06.128192 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bdbeadcd-6ce4-4a65-9c0e-14086ab1e2f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0f50812c08741a9be23b584fe708821', 'request_id': 'req-bdbeadcd-6ce4-4a65-9c0e-14086ab1e2f8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:06.129165 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:06.134890 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bdbeadcd-6ce4-4a65-9c0e-14086ab1e2f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0f50812c08741a9be23b584fe708821', 'request_id': 'req-bdbeadcd-6ce4-4a65-9c0e-14086ab1e2f8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:06.142505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bdbeadcd-6ce4-4a65-9c0e-14086ab1e2f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0f50812c08741a9be23b584fe708821', 'request_id': 'req-bdbeadcd-6ce4-4a65-9c0e-14086ab1e2f8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:06.158604 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bdbeadcd-6ce4-4a65-9c0e-14086ab1e2f8 admin admin] The token cache is being invalidate because project d0f50812c08741a9be23b584fe708821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:06.158931 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bdbeadcd-6ce4-4a65-9c0e-14086ab1e2f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:06.159537 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-bdbeadcd-6ce4-4a65-9c0e-14086ab1e2f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:06.169625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1361/2719] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:05 2022] DELETE /identity/v3/projects/d0f50812c08741a9be23b584fe708821 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:06.169751 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c5c9f-7e8d-4e8d-ac92-f78a38e23589 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.169751 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c5c9f-7e8d-4e8d-ac92-f78a38e23589 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.169751 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c5c9f-7e8d-4e8d-ac92-f78a38e23589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.188947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-b40c5c9f-7e8d-4e8d-ac92-f78a38e23589 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:06.190176 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b40c5c9f-7e8d-4e8d-ac92-f78a38e23589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:06.252688 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1359/2720] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:06.260961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09bb7-0f80-424a-b3c7-2db8c4394dfc None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.261257 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09bb7-0f80-424a-b3c7-2db8c4394dfc None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.261543 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c09bb7-0f80-424a-b3c7-2db8c4394dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.282968 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-12c09bb7-0f80-424a-b3c7-2db8c4394dfc None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:06.284185 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-12c09bb7-0f80-424a-b3c7-2db8c4394dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:06.293116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1362/2721] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:06.297391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c5c9f-7e8d-4e8d-ac92-f78a38e23589 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:06.307187 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c5c9f-7e8d-4e8d-ac92-f78a38e23589 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:06.312886 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ae7bb-288d-477c-bb5a-5457c6193a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:06.313976 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ae7bb-288d-477c-bb5a-5457c6193a3f admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.314272 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ae7bb-288d-477c-bb5a-5457c6193a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.314578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ae7bb-288d-477c-bb5a-5457c6193a3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.315312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ae7bb-288d-477c-bb5a-5457c6193a3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:37:06.315623 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ae7bb-288d-477c-bb5a-5457c6193a3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:06.317212 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ae7bb-288d-477c-bb5a-5457c6193a3f admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:06.329479 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1360/2722] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:37:06.334605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c09bb7-0f80-424a-b3c7-2db8c4394dfc None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:06.345056 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c09bb7-0f80-424a-b3c7-2db8c4394dfc None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:06.350674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0ab69-7bc2-43cd-b6ea-fefba9639ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:06.352474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0ab69-7bc2-43cd-b6ea-fefba9639ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.352474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0ab69-7bc2-43cd-b6ea-fefba9639ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.352474 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0ab69-7bc2-43cd-b6ea-fefba9639ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.352795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0ab69-7bc2-43cd-b6ea-fefba9639ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:06.355044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0ab69-7bc2-43cd-b6ea-fefba9639ec5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:06.383473 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1363/2723] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:06 2022] POST /identity/v3/projects => generated 355 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:06.388307 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ae7bb-288d-477c-bb5a-5457c6193a3f admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:06.398928 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ae7bb-288d-477c-bb5a-5457c6193a3f admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:06.458734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682072e-3d50-484f-99cd-cda7975aba07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:06.459407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682072e-3d50-484f-99cd-cda7975aba07 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.459692 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682072e-3d50-484f-99cd-cda7975aba07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.459970 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682072e-3d50-484f-99cd-cda7975aba07 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.460686 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682072e-3d50-484f-99cd-cda7975aba07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:06.463352 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682072e-3d50-484f-99cd-cda7975aba07 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:06.471639 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:06.490739 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1361/2724] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:06 2022] POST /identity/v3/users => generated 278 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:37:06.495440 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0ab69-7bc2-43cd-b6ea-fefba9639ec5 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:06.506555 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0ab69-7bc2-43cd-b6ea-fefba9639ec5 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:06.513114 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472e106-67eb-4c16-90bb-32adbfbd339f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:06.514223 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472e106-67eb-4c16-90bb-32adbfbd339f admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.514858 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472e106-67eb-4c16-90bb-32adbfbd339f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.515246 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472e106-67eb-4c16-90bb-32adbfbd339f admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.516454 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472e106-67eb-4c16-90bb-32adbfbd339f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:06.518366 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472e106-67eb-4c16-90bb-32adbfbd339f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:06.534680 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1364/2725] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:37:06.539594 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682072e-3d50-484f-99cd-cda7975aba07 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:06.550238 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682072e-3d50-484f-99cd-cda7975aba07 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:06.555248 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f005e7-51d3-45fa-aedb-189528bf4133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:06.555924 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f005e7-51d3-45fa-aedb-189528bf4133 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.556216 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f005e7-51d3-45fa-aedb-189528bf4133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.556528 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f005e7-51d3-45fa-aedb-189528bf4133 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.557292 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f005e7-51d3-45fa-aedb-189528bf4133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:06.558926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f005e7-51d3-45fa-aedb-189528bf4133 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:06.569815 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1362/2726] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:06.574665 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472e106-67eb-4c16-90bb-32adbfbd339f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:06.590030 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472e106-67eb-4c16-90bb-32adbfbd339f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:06.595113 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65446c2b-5c2d-4ba3-810a-350dad235342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:06.596004 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65446c2b-5c2d-4ba3-810a-350dad235342 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.596289 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65446c2b-5c2d-4ba3-810a-350dad235342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.596569 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65446c2b-5c2d-4ba3-810a-350dad235342 admin admin] PATH_INFO: `/v3/projects/0d91df6527574289a696cab2c4bac01d/users/7638cb721270458fb73a3229ea66f632/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.611130 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65446c2b-5c2d-4ba3-810a-350dad235342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d91df6527574289a696cab2c4bac01d, user_id=7638cb721270458fb73a3229ea66f632, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:06.613784 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65446c2b-5c2d-4ba3-810a-350dad235342 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:06.628851 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1365/2727] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:06 2022] PUT /identity/v3/projects/0d91df6527574289a696cab2c4bac01d/users/7638cb721270458fb73a3229ea66f632/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:06.639368 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9a2a2-4ac5-43a0-beda-8e6b1d1ce8df None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.639659 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9a2a2-4ac5-43a0-beda-8e6b1d1ce8df None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.639938 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9a2a2-4ac5-43a0-beda-8e6b1d1ce8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.668335 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e3f9a2a2-4ac5-43a0-beda-8e6b1d1ce8df None None] MFA Rules not processed for user `7638cb721270458fb73a3229ea66f632`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:06.669637 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e3f9a2a2-4ac5-43a0-beda-8e6b1d1ce8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:06.752520 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1363/2728] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:06 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:06.756998 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65446c2b-5c2d-4ba3-810a-350dad235342 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:06.829787 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65446c2b-5c2d-4ba3-810a-350dad235342 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:06.834782 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ff1f2-3d18-41f3-97a8-9895370b92a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:06.835446 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ff1f2-3d18-41f3-97a8-9895370b92a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.835737 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ff1f2-3d18-41f3-97a8-9895370b92a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.836051 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ff1f2-3d18-41f3-97a8-9895370b92a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.837275 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ff1f2-3d18-41f3-97a8-9895370b92a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:06.839202 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ff1f2-3d18-41f3-97a8-9895370b92a4 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:06.865789 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1366/2729] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:06 2022] POST /identity/v3/projects => generated 357 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:06.870371 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9a2a2-4ac5-43a0-beda-8e6b1d1ce8df None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:06.881302 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9a2a2-4ac5-43a0-beda-8e6b1d1ce8df None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:06.942437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34211d22-5bae-44e8-8756-dc822ff15681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:06.943102 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34211d22-5bae-44e8-8756-dc822ff15681 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.943386 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34211d22-5bae-44e8-8756-dc822ff15681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.943688 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34211d22-5bae-44e8-8756-dc822ff15681 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.944444 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34211d22-5bae-44e8-8756-dc822ff15681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:06.946580 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34211d22-5bae-44e8-8756-dc822ff15681 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:06.974107 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1364/2730] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:06 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:06.979672 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ff1f2-3d18-41f3-97a8-9895370b92a4 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:06.990791 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ff1f2-3d18-41f3-97a8-9895370b92a4 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:06.995979 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082c0eb-ae6f-4608-9cc4-9b8e8f564648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:06.996641 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082c0eb-ae6f-4608-9cc4-9b8e8f564648 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:06.996931 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082c0eb-ae6f-4608-9cc4-9b8e8f564648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:06.997212 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082c0eb-ae6f-4608-9cc4-9b8e8f564648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:06.997944 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082c0eb-ae6f-4608-9cc4-9b8e8f564648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:06.999582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082c0eb-ae6f-4608-9cc4-9b8e8f564648 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:07.011099 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1367/2731] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:07.016179 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34211d22-5bae-44e8-8756-dc822ff15681 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:07.026849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34211d22-5bae-44e8-8756-dc822ff15681 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:07.032581 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7af7ef-06ef-42cd-8f37-195f6452b954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:07.033457 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7af7ef-06ef-42cd-8f37-195f6452b954 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:07.033737 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7af7ef-06ef-42cd-8f37-195f6452b954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:07.034013 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7af7ef-06ef-42cd-8f37-195f6452b954 admin admin] PATH_INFO: `/v3/projects/b257ebcc0c114204a01580a18c1958b6/users/33fc26ed988c44eba74c3c12ecdd71a8/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:07.049881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7af7ef-06ef-42cd-8f37-195f6452b954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b257ebcc0c114204a01580a18c1958b6, user_id=33fc26ed988c44eba74c3c12ecdd71a8, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:07.052561 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7af7ef-06ef-42cd-8f37-195f6452b954 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:07.066623 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1365/2732] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:07 2022] PUT /identity/v3/projects/b257ebcc0c114204a01580a18c1958b6/users/33fc26ed988c44eba74c3c12ecdd71a8/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:07.070989 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082c0eb-ae6f-4608-9cc4-9b8e8f564648 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:07.081665 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082c0eb-ae6f-4608-9cc4-9b8e8f564648 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:07.132534 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:07.147076 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09382b76-17a9-4b6d-b816-625fa1aa7df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:07.147746 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09382b76-17a9-4b6d-b816-625fa1aa7df7 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:07.148029 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09382b76-17a9-4b6d-b816-625fa1aa7df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:07.148303 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09382b76-17a9-4b6d-b816-625fa1aa7df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:07.149037 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09382b76-17a9-4b6d-b816-625fa1aa7df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:07.150899 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09382b76-17a9-4b6d-b816-625fa1aa7df7 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:07.161965 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1368/2733] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:07.168208 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7af7ef-06ef-42cd-8f37-195f6452b954 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:07.184677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7af7ef-06ef-42cd-8f37-195f6452b954 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:07.189682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259b35c-0088-495d-8b73-09892aab4f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:07.190604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259b35c-0088-495d-8b73-09892aab4f9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:07.190889 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259b35c-0088-495d-8b73-09892aab4f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:07.191165 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259b35c-0088-495d-8b73-09892aab4f9d admin admin] PATH_INFO: `/v3/projects/b257ebcc0c114204a01580a18c1958b6/users/33fc26ed988c44eba74c3c12ecdd71a8/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:07.193283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259b35c-0088-495d-8b73-09892aab4f9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b257ebcc0c114204a01580a18c1958b6, user_id=33fc26ed988c44eba74c3c12ecdd71a8, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:07.195895 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259b35c-0088-495d-8b73-09892aab4f9d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:07.208245 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1366/2734] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:07 2022] PUT /identity/v3/projects/b257ebcc0c114204a01580a18c1958b6/users/33fc26ed988c44eba74c3c12ecdd71a8/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:07.220534 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c28e7-e187-4dde-82c6-03a4f76ed5a2 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:07.220833 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c28e7-e187-4dde-82c6-03a4f76ed5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:07.221121 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c28e7-e187-4dde-82c6-03a4f76ed5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:07.249900 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-ff4c28e7-e187-4dde-82c6-03a4f76ed5a2 None None] MFA Rules not processed for user `33fc26ed988c44eba74c3c12ecdd71a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:07.251187 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-ff4c28e7-e187-4dde-82c6-03a4f76ed5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:07.325751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1369/2735] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:07 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:07.337975 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259b35c-0088-495d-8b73-09892aab4f9d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:07.339694 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0259b35c-0088-495d-8b73-09892aab4f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:07.362082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:07.399960 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259b35c-0088-495d-8b73-09892aab4f9d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:07.403702 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b053a2-48f5-417f-b2dd-f9e17d8d74e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:07.404285 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b053a2-48f5-417f-b2dd-f9e17d8d74e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:07.404578 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b053a2-48f5-417f-b2dd-f9e17d8d74e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:07.404853 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b053a2-48f5-417f-b2dd-f9e17d8d74e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:07.414328 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b053a2-48f5-417f-b2dd-f9e17d8d74e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:07.415776 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b053a2-48f5-417f-b2dd-f9e17d8d74e9 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:07.425188 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1367/2736] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:07 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:37:07.498448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c28e7-e187-4dde-82c6-03a4f76ed5a2 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:07.508447 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c28e7-e187-4dde-82c6-03a4f76ed5a2 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:07.512625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022f383-10db-4f25-8632-0e270c7b6839 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:07.513293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022f383-10db-4f25-8632-0e270c7b6839 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:07.513583 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022f383-10db-4f25-8632-0e270c7b6839 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:07.513857 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022f383-10db-4f25-8632-0e270c7b6839 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:07.591752 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022f383-10db-4f25-8632-0e270c7b6839 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:07.593213 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1022f383-10db-4f25-8632-0e270c7b6839 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:07.602947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1370/2737] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:07 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:17.420958 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=17 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:17.598484 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=68 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:22.622789 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b053a2-48f5-417f-b2dd-f9e17d8d74e9 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:22.702937 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b053a2-48f5-417f-b2dd-f9e17d8d74e9 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:22.708561 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2459c9-4823-4720-a1c9-f8a18cf874cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:22.709516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2459c9-4823-4720-a1c9-f8a18cf874cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:22.709889 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2459c9-4823-4720-a1c9-f8a18cf874cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:22.710193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2459c9-4823-4720-a1c9-f8a18cf874cb admin admin] PATH_INFO: `/v3/users/7638cb721270458fb73a3229ea66f632` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:22.712586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2459c9-4823-4720-a1c9-f8a18cf874cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7638cb721270458fb73a3229ea66f632)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:22.714765 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2459c9-4823-4720-a1c9-f8a18cf874cb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:22.776400 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc2459c9-4823-4720-a1c9-f8a18cf874cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7638cb721270458fb73a3229ea66f632'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:22.791505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc2459c9-4823-4720-a1c9-f8a18cf874cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7638cb721270458fb73a3229ea66f632'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:22.807455 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc2459c9-4823-4720-a1c9-f8a18cf874cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7638cb721270458fb73a3229ea66f632'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:22.815466 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc2459c9-4823-4720-a1c9-f8a18cf874cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7638cb721270458fb73a3229ea66f632'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:22.816200 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-bc2459c9-4823-4720-a1c9-f8a18cf874cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7638cb721270458fb73a3229ea66f632'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:22.824353 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1368/2738] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:22 2022] DELETE /identity/v3/users/7638cb721270458fb73a3229ea66f632 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:22.829406 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433e9ba-ddeb-4acd-a5f8-2f6fc86cffd5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:22.829929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433e9ba-ddeb-4acd-a5f8-2f6fc86cffd5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:22.829929 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433e9ba-ddeb-4acd-a5f8-2f6fc86cffd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:22.848850 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-3433e9ba-ddeb-4acd-a5f8-2f6fc86cffd5 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:22.850206 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3433e9ba-ddeb-4acd-a5f8-2f6fc86cffd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:22.922288 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1371/2739] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:22.933136 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2459c9-4823-4720-a1c9-f8a18cf874cb admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:22.934804 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-bc2459c9-4823-4720-a1c9-f8a18cf874cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:23.021563 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2459c9-4823-4720-a1c9-f8a18cf874cb admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:23.026887 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafc359-db02-4386-9abc-564926b6bb45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:23.027620 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafc359-db02-4386-9abc-564926b6bb45 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:23.027971 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafc359-db02-4386-9abc-564926b6bb45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:23.028316 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafc359-db02-4386-9abc-564926b6bb45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:23.033972 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433e9ba-ddeb-4acd-a5f8-2f6fc86cffd5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:23.035962 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3433e9ba-ddeb-4acd-a5f8-2f6fc86cffd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:23.042576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eafc359-db02-4386-9abc-564926b6bb45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:23.044720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eafc359-db02-4386-9abc-564926b6bb45 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:23.062381 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1369/2740] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:37:23.220088 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433e9ba-ddeb-4acd-a5f8-2f6fc86cffd5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:23.235181 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eba7e-01c4-4bf6-a871-ac9df359e3e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:23.235914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eba7e-01c4-4bf6-a871-ac9df359e3e8 service nova] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:23.236296 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eba7e-01c4-4bf6-a871-ac9df359e3e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:23.237303 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eba7e-01c4-4bf6-a871-ac9df359e3e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:23.239479 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-185eba7e-01c4-4bf6-a871-ac9df359e3e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:23.267480 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eba7e-01c4-4bf6-a871-ac9df359e3e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:23.279757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eba7e-01c4-4bf6-a871-ac9df359e3e8 service nova] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:23.321975 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1372/2741] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:23.557349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafc359-db02-4386-9abc-564926b6bb45 service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:23.558954 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-4eafc359-db02-4386-9abc-564926b6bb45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:23.573327 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafc359-db02-4386-9abc-564926b6bb45 service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:23.579140 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929aa7f-9053-4274-98a5-2cd0d00ffed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:23.581094 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929aa7f-9053-4274-98a5-2cd0d00ffed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:23.581472 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929aa7f-9053-4274-98a5-2cd0d00ffed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:23.581903 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929aa7f-9053-4274-98a5-2cd0d00ffed6 admin admin] PATH_INFO: `/v3/projects/0d91df6527574289a696cab2c4bac01d` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:23.583677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929aa7f-9053-4274-98a5-2cd0d00ffed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d91df6527574289a696cab2c4bac01d)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:23.587699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b929aa7f-9053-4274-98a5-2cd0d00ffed6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:23.609926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:23.643403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b929aa7f-9053-4274-98a5-2cd0d00ffed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d91df6527574289a696cab2c4bac01d', 'request_id': 'req-b929aa7f-9053-4274-98a5-2cd0d00ffed6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:23.650524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b929aa7f-9053-4274-98a5-2cd0d00ffed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d91df6527574289a696cab2c4bac01d', 'request_id': 'req-b929aa7f-9053-4274-98a5-2cd0d00ffed6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:23.659300 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b929aa7f-9053-4274-98a5-2cd0d00ffed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d91df6527574289a696cab2c4bac01d', 'request_id': 'req-b929aa7f-9053-4274-98a5-2cd0d00ffed6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:23.670597 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b929aa7f-9053-4274-98a5-2cd0d00ffed6 admin admin] The token cache is being invalidate because project 0d91df6527574289a696cab2c4bac01d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:23.670885 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b929aa7f-9053-4274-98a5-2cd0d00ffed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:23.671535 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-b929aa7f-9053-4274-98a5-2cd0d00ffed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:23.673228 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1370/2742] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:23 2022] DELETE /identity/v3/projects/0d91df6527574289a696cab2c4bac01d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:23.677200 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eba7e-01c4-4bf6-a871-ac9df359e3e8 service nova] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:23.688296 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eba7e-01c4-4bf6-a871-ac9df359e3e8 service nova] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:23.754027 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15edbc3-759e-468e-9994-a6128ee8f8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:23.755591 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15edbc3-759e-468e-9994-a6128ee8f8d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:23.755877 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15edbc3-759e-468e-9994-a6128ee8f8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:23.756154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15edbc3-759e-468e-9994-a6128ee8f8d6 admin admin] PATH_INFO: `/v3/users/33fc26ed988c44eba74c3c12ecdd71a8` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:23.757525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15edbc3-759e-468e-9994-a6128ee8f8d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33fc26ed988c44eba74c3c12ecdd71a8)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:23.759974 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15edbc3-759e-468e-9994-a6128ee8f8d6 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:23.791137 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:23.810550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e15edbc3-759e-468e-9994-a6128ee8f8d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33fc26ed988c44eba74c3c12ecdd71a8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:23.820519 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e15edbc3-759e-468e-9994-a6128ee8f8d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33fc26ed988c44eba74c3c12ecdd71a8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:23.831527 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e15edbc3-759e-468e-9994-a6128ee8f8d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33fc26ed988c44eba74c3c12ecdd71a8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:23.832399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e15edbc3-759e-468e-9994-a6128ee8f8d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33fc26ed988c44eba74c3c12ecdd71a8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:23.833009 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e15edbc3-759e-468e-9994-a6128ee8f8d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33fc26ed988c44eba74c3c12ecdd71a8'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:23.852625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1373/2743] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:23 2022] DELETE /identity/v3/users/33fc26ed988c44eba74c3c12ecdd71a8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:24.377450 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929aa7f-9053-4274-98a5-2cd0d00ffed6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:24.378999 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-b929aa7f-9053-4274-98a5-2cd0d00ffed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:24.392752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929aa7f-9053-4274-98a5-2cd0d00ffed6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:24.479797 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15393230-2412-4a69-af02-7f43a9626255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:24.480806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15393230-2412-4a69-af02-7f43a9626255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:24.481091 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15393230-2412-4a69-af02-7f43a9626255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:24.481367 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15393230-2412-4a69-af02-7f43a9626255 admin admin] PATH_INFO: `/v3/projects/b257ebcc0c114204a01580a18c1958b6` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:24.482711 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15393230-2412-4a69-af02-7f43a9626255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b257ebcc0c114204a01580a18c1958b6)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:24.484966 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15393230-2412-4a69-af02-7f43a9626255 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:24.545642 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-15393230-2412-4a69-af02-7f43a9626255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b257ebcc0c114204a01580a18c1958b6', 'request_id': 'req-15393230-2412-4a69-af02-7f43a9626255'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:24.558396 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-15393230-2412-4a69-af02-7f43a9626255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b257ebcc0c114204a01580a18c1958b6', 'request_id': 'req-15393230-2412-4a69-af02-7f43a9626255'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:24.568748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-15393230-2412-4a69-af02-7f43a9626255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b257ebcc0c114204a01580a18c1958b6', 'request_id': 'req-15393230-2412-4a69-af02-7f43a9626255'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:24.587256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-15393230-2412-4a69-af02-7f43a9626255 admin admin] The token cache is being invalidate because project b257ebcc0c114204a01580a18c1958b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:24.587547 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-15393230-2412-4a69-af02-7f43a9626255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:24.588214 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-15393230-2412-4a69-af02-7f43a9626255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:24.590652 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1371/2744] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:24 2022] DELETE /identity/v3/projects/b257ebcc0c114204a01580a18c1958b6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:24.595024 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94e4c1-c136-4453-9ba8-2cbf27965ffa None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:24.595317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94e4c1-c136-4453-9ba8-2cbf27965ffa None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:24.595596 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94e4c1-c136-4453-9ba8-2cbf27965ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:24.626678 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-0c94e4c1-c136-4453-9ba8-2cbf27965ffa None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:24.627860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-0c94e4c1-c136-4453-9ba8-2cbf27965ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:24.734271 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1374/2745] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:24.742158 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371c5bb-175f-4459-9bd4-e097affb1253 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:24.742770 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371c5bb-175f-4459-9bd4-e097affb1253 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:24.742892 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371c5bb-175f-4459-9bd4-e097affb1253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:24.761662 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3371c5bb-175f-4459-9bd4-e097affb1253 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:24.763082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3371c5bb-175f-4459-9bd4-e097affb1253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:24.772601 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1372/2746] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:24.777646 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94e4c1-c136-4453-9ba8-2cbf27965ffa None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:24.787850 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94e4c1-c136-4453-9ba8-2cbf27965ffa None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:24.793455 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dab99-f5b7-4639-a0f1-374eb820505e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:24.794111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dab99-f5b7-4639-a0f1-374eb820505e admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:24.794439 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dab99-f5b7-4639-a0f1-374eb820505e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:24.794709 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dab99-f5b7-4639-a0f1-374eb820505e admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:24.795435 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dab99-f5b7-4639-a0f1-374eb820505e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:37:24.795740 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dab99-f5b7-4639-a0f1-374eb820505e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:24.797337 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dab99-f5b7-4639-a0f1-374eb820505e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:24.809762 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1375/2747] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:37:24.814389 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371c5bb-175f-4459-9bd4-e097affb1253 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:24.824579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371c5bb-175f-4459-9bd4-e097affb1253 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:24.829522 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac5bb1-7106-4353-bcca-9d0a237af6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:24.830192 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac5bb1-7106-4353-bcca-9d0a237af6e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:24.830514 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac5bb1-7106-4353-bcca-9d0a237af6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:24.830837 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac5bb1-7106-4353-bcca-9d0a237af6e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:24.831547 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac5bb1-7106-4353-bcca-9d0a237af6e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:24.833475 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac5bb1-7106-4353-bcca-9d0a237af6e4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:24.863819 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1373/2748] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:24 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:24.865830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dab99-f5b7-4639-a0f1-374eb820505e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:24.876656 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dab99-f5b7-4639-a0f1-374eb820505e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:24.935129 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c282d-3de1-4349-9625-76f054670256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:24.935863 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c282d-3de1-4349-9625-76f054670256 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:24.936147 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c282d-3de1-4349-9625-76f054670256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:24.936424 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c282d-3de1-4349-9625-76f054670256 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:24.937111 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c282d-3de1-4349-9625-76f054670256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:24.939076 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c282d-3de1-4349-9625-76f054670256 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:24.959189 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1376/2749] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:24 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:24.964209 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac5bb1-7106-4353-bcca-9d0a237af6e4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:24.974754 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac5bb1-7106-4353-bcca-9d0a237af6e4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:24.979448 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1577bc-2f6f-4daf-84ff-15e8394ac0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:24.980096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1577bc-2f6f-4daf-84ff-15e8394ac0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:24.980377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1577bc-2f6f-4daf-84ff-15e8394ac0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:24.980651 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1577bc-2f6f-4daf-84ff-15e8394ac0d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:24.981426 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1577bc-2f6f-4daf-84ff-15e8394ac0d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:24.983176 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1577bc-2f6f-4daf-84ff-15e8394ac0d0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:24.984663 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:24.995382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1374/2750] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:25.000266 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c282d-3de1-4349-9625-76f054670256 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:25.013734 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c282d-3de1-4349-9625-76f054670256 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:25.018416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c6202-0c45-4175-93e8-afc28b2d0c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:25.019109 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c6202-0c45-4175-93e8-afc28b2d0c02 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:25.019395 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c6202-0c45-4175-93e8-afc28b2d0c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:25.019697 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c6202-0c45-4175-93e8-afc28b2d0c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:25.020531 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c6202-0c45-4175-93e8-afc28b2d0c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:25.022114 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c6202-0c45-4175-93e8-afc28b2d0c02 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:25.033668 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1377/2751] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:37:25.038475 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1577bc-2f6f-4daf-84ff-15e8394ac0d0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:25.048724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1577bc-2f6f-4daf-84ff-15e8394ac0d0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:25.053941 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea83b1-5fbc-4cea-b7af-8a9bfc2dc30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:25.054871 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea83b1-5fbc-4cea-b7af-8a9bfc2dc30c admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:25.055288 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea83b1-5fbc-4cea-b7af-8a9bfc2dc30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:25.055771 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea83b1-5fbc-4cea-b7af-8a9bfc2dc30c admin admin] PATH_INFO: `/v3/projects/b1670bb1972b4c479027e0fb7ae6bd48/users/195aa86599f04adf9cdd9df2e24cf6b6/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:25.075041 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea83b1-5fbc-4cea-b7af-8a9bfc2dc30c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1670bb1972b4c479027e0fb7ae6bd48, user_id=195aa86599f04adf9cdd9df2e24cf6b6, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:25.077906 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ea83b1-5fbc-4cea-b7af-8a9bfc2dc30c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:25.091536 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1375/2752] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:25 2022] PUT /identity/v3/projects/b1670bb1972b4c479027e0fb7ae6bd48/users/195aa86599f04adf9cdd9df2e24cf6b6/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:25.102604 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6307b3-7c09-45ba-a15c-a164f642b182 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:25.102898 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6307b3-7c09-45ba-a15c-a164f642b182 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:25.103183 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6307b3-7c09-45ba-a15c-a164f642b182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:25.122521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:25.131777 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-bb6307b3-7c09-45ba-a15c-a164f642b182 None None] MFA Rules not processed for user `195aa86599f04adf9cdd9df2e24cf6b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:25.134223 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-bb6307b3-7c09-45ba-a15c-a164f642b182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:25.205710 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1378/2753] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:37:25.210424 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea83b1-5fbc-4cea-b7af-8a9bfc2dc30c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:25.277829 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea83b1-5fbc-4cea-b7af-8a9bfc2dc30c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:25.282699 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82d669-5108-4091-8ab4-34fcbd9235f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:25.283382 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82d669-5108-4091-8ab4-34fcbd9235f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:25.283662 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82d669-5108-4091-8ab4-34fcbd9235f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:25.283937 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82d669-5108-4091-8ab4-34fcbd9235f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:25.284613 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82d669-5108-4091-8ab4-34fcbd9235f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:25.286768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82d669-5108-4091-8ab4-34fcbd9235f2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:25.313859 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1376/2754] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:25 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:25.317923 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6307b3-7c09-45ba-a15c-a164f642b182 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:25.330038 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6307b3-7c09-45ba-a15c-a164f642b182 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:25.396311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9194a83-2fea-4de8-aa25-af403660e22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:25.397023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9194a83-2fea-4de8-aa25-af403660e22e admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:25.397430 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9194a83-2fea-4de8-aa25-af403660e22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:25.397715 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9194a83-2fea-4de8-aa25-af403660e22e admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:25.398469 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9194a83-2fea-4de8-aa25-af403660e22e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:25.400475 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9194a83-2fea-4de8-aa25-af403660e22e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:25.424319 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1379/2755] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:25 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:25.428559 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82d669-5108-4091-8ab4-34fcbd9235f2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:25.439620 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82d669-5108-4091-8ab4-34fcbd9235f2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:25.444339 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b0e79-27be-49cc-9374-44a0aa0fd54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:25.445001 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b0e79-27be-49cc-9374-44a0aa0fd54a admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:25.445298 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b0e79-27be-49cc-9374-44a0aa0fd54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:25.445572 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b0e79-27be-49cc-9374-44a0aa0fd54a admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:25.446887 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b0e79-27be-49cc-9374-44a0aa0fd54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:25.448482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b0e79-27be-49cc-9374-44a0aa0fd54a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:25.461075 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1377/2756] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:25.465941 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9194a83-2fea-4de8-aa25-af403660e22e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:25.478519 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9194a83-2fea-4de8-aa25-af403660e22e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:25.483634 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f6f81-691f-4725-9c44-b2deade090c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:25.484725 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f6f81-691f-4725-9c44-b2deade090c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:25.485057 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f6f81-691f-4725-9c44-b2deade090c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:25.485388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f6f81-691f-4725-9c44-b2deade090c3 admin admin] PATH_INFO: `/v3/projects/8499fb5f310d4637b2e38a864bdffa58/users/23ec5be3478b45898797697c9a60fdf0/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:25.501874 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f6f81-691f-4725-9c44-b2deade090c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8499fb5f310d4637b2e38a864bdffa58, user_id=23ec5be3478b45898797697c9a60fdf0, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:25.504562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f6f81-691f-4725-9c44-b2deade090c3 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:25.519998 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1380/2757] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:25 2022] PUT /identity/v3/projects/8499fb5f310d4637b2e38a864bdffa58/users/23ec5be3478b45898797697c9a60fdf0/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:25.524012 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b0e79-27be-49cc-9374-44a0aa0fd54a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:25.534323 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b0e79-27be-49cc-9374-44a0aa0fd54a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:25.593306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5639534-afa5-4de8-9b8e-f80082241f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:25.594006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5639534-afa5-4de8-9b8e-f80082241f85 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:25.594417 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5639534-afa5-4de8-9b8e-f80082241f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:25.594787 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5639534-afa5-4de8-9b8e-f80082241f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:25.595539 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5639534-afa5-4de8-9b8e-f80082241f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:25.597161 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5639534-afa5-4de8-9b8e-f80082241f85 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:25.608328 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1378/2758] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:25.613817 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f6f81-691f-4725-9c44-b2deade090c3 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:25.627289 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f6f81-691f-4725-9c44-b2deade090c3 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:25.631944 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019bce6-cc62-4081-bf39-559fca06909e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:25.632821 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019bce6-cc62-4081-bf39-559fca06909e admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:25.633108 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019bce6-cc62-4081-bf39-559fca06909e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:25.633386 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019bce6-cc62-4081-bf39-559fca06909e admin admin] PATH_INFO: `/v3/projects/8499fb5f310d4637b2e38a864bdffa58/users/23ec5be3478b45898797697c9a60fdf0/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:25.635414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019bce6-cc62-4081-bf39-559fca06909e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8499fb5f310d4637b2e38a864bdffa58, user_id=23ec5be3478b45898797697c9a60fdf0, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:25.638044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019bce6-cc62-4081-bf39-559fca06909e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:25.648493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1381/2759] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:25 2022] PUT /identity/v3/projects/8499fb5f310d4637b2e38a864bdffa58/users/23ec5be3478b45898797697c9a60fdf0/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:25.659888 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9163590-2149-48d8-8f3c-7b9eb37ab0b6 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:25.660178 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9163590-2149-48d8-8f3c-7b9eb37ab0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:25.660461 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9163590-2149-48d8-8f3c-7b9eb37ab0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:25.689391 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-f9163590-2149-48d8-8f3c-7b9eb37ab0b6 None None] MFA Rules not processed for user `23ec5be3478b45898797697c9a60fdf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:25.690726 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f9163590-2149-48d8-8f3c-7b9eb37ab0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:25.721587 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:25.751000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019bce6-cc62-4081-bf39-559fca06909e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:25.752049 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2019bce6-cc62-4081-bf39-559fca06909e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:25.766365 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1379/2760] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:25.777962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9163590-2149-48d8-8f3c-7b9eb37ab0b6 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:25.779776 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-f9163590-2149-48d8-8f3c-7b9eb37ab0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:25.831925 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:25.846580 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9163590-2149-48d8-8f3c-7b9eb37ab0b6 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:25.848143 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019bce6-cc62-4081-bf39-559fca06909e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:25.850425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb40ae-6f6b-40a1-9388-e55079f74d4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:25.851089 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb40ae-6f6b-40a1-9388-e55079f74d4a service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:25.851376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb40ae-6f6b-40a1-9388-e55079f74d4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:25.851685 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb40ae-6f6b-40a1-9388-e55079f74d4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:25.854795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750736f5-0a1d-4d46-978a-764348b07b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:25.855763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750736f5-0a1d-4d46-978a-764348b07b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:25.856847 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750736f5-0a1d-4d46-978a-764348b07b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:25.857217 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750736f5-0a1d-4d46-978a-764348b07b5d admin admin] PATH_INFO: `/v3/users/0507129e889c4de6b1bdfca5a19a8727` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:25.858809 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750736f5-0a1d-4d46-978a-764348b07b5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0507129e889c4de6b1bdfca5a19a8727)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:25.860820 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750736f5-0a1d-4d46-978a-764348b07b5d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:25.863640 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb40ae-6f6b-40a1-9388-e55079f74d4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:25.865119 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb40ae-6f6b-40a1-9388-e55079f74d4a service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:25.877527 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1380/2761] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:37:25.926842 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-750736f5-0a1d-4d46-978a-764348b07b5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0507129e889c4de6b1bdfca5a19a8727'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:25.936070 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-750736f5-0a1d-4d46-978a-764348b07b5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0507129e889c4de6b1bdfca5a19a8727'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:25.948416 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-750736f5-0a1d-4d46-978a-764348b07b5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0507129e889c4de6b1bdfca5a19a8727'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:25.955921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-750736f5-0a1d-4d46-978a-764348b07b5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0507129e889c4de6b1bdfca5a19a8727'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:25.956805 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-750736f5-0a1d-4d46-978a-764348b07b5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0507129e889c4de6b1bdfca5a19a8727'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:25.957546 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb40ae-6f6b-40a1-9388-e55079f74d4a service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:25.971108 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb40ae-6f6b-40a1-9388-e55079f74d4a service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:25.977739 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06ff62-1d33-443f-9643-012548c9d766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:25.978653 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ff62-1d33-443f-9643-012548c9d766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:25.978987 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ff62-1d33-443f-9643-012548c9d766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:25.979242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ff62-1d33-443f-9643-012548c9d766 admin admin] PATH_INFO: `/v3/users/195aa86599f04adf9cdd9df2e24cf6b6` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:25.980499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06ff62-1d33-443f-9643-012548c9d766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=195aa86599f04adf9cdd9df2e24cf6b6)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:25.981048 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1382/2762] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:25 2022] DELETE /identity/v3/users/0507129e889c4de6b1bdfca5a19a8727 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:25.985222 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445de44d-374e-4686-bd5d-ce827407194a None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:25.985549 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445de44d-374e-4686-bd5d-ce827407194a None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:25.985748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06ff62-1d33-443f-9643-012548c9d766 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:25.985939 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445de44d-374e-4686-bd5d-ce827407194a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:26.009682 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-445de44d-374e-4686-bd5d-ce827407194a None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:26.011146 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-445de44d-374e-4686-bd5d-ce827407194a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:26.058643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4e06ff62-1d33-443f-9643-012548c9d766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '195aa86599f04adf9cdd9df2e24cf6b6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.066489 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4e06ff62-1d33-443f-9643-012548c9d766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '195aa86599f04adf9cdd9df2e24cf6b6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.080133 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4e06ff62-1d33-443f-9643-012548c9d766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '195aa86599f04adf9cdd9df2e24cf6b6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.090833 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4e06ff62-1d33-443f-9643-012548c9d766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '195aa86599f04adf9cdd9df2e24cf6b6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.092161 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-4e06ff62-1d33-443f-9643-012548c9d766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '195aa86599f04adf9cdd9df2e24cf6b6'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.102628 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1381/2764] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:25 2022] DELETE /identity/v3/users/195aa86599f04adf9cdd9df2e24cf6b6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:26.104215 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1383/2763] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:37:26.105297 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8bf96-7564-4cfc-8b5a-6106f773eee1 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:26.105709 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8bf96-7564-4cfc-8b5a-6106f773eee1 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:26.106062 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8bf96-7564-4cfc-8b5a-6106f773eee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:26.110271 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445de44d-374e-4686-bd5d-ce827407194a None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:26.112478 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-445de44d-374e-4686-bd5d-ce827407194a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:26.125706 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-45b8bf96-7564-4cfc-8b5a-6106f773eee1 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:26.126976 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-45b8bf96-7564-4cfc-8b5a-6106f773eee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:26.173040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:26.180117 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445de44d-374e-4686-bd5d-ce827407194a None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:26.196518 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1382/2765] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:37:26.206940 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8bf96-7564-4cfc-8b5a-6106f773eee1 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:26.208336 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-45b8bf96-7564-4cfc-8b5a-6106f773eee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:26.209322 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:26.236749 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572409ac-73f0-49c2-8eee-03111a53a64e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:26.237406 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572409ac-73f0-49c2-8eee-03111a53a64e service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:26.237686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572409ac-73f0-49c2-8eee-03111a53a64e service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:26.237960 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572409ac-73f0-49c2-8eee-03111a53a64e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:26.239819 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-572409ac-73f0-49c2-8eee-03111a53a64e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:26.251923 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572409ac-73f0-49c2-8eee-03111a53a64e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:26.253370 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572409ac-73f0-49c2-8eee-03111a53a64e service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:26.263358 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1384/2766] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:26.269722 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8bf96-7564-4cfc-8b5a-6106f773eee1 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:26.274641 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fec1a1-73b7-4af2-a1af-d2d2faeea92d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:26.275416 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fec1a1-73b7-4af2-a1af-d2d2faeea92d service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:26.275768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fec1a1-73b7-4af2-a1af-d2d2faeea92d service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:26.276171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fec1a1-73b7-4af2-a1af-d2d2faeea92d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:26.287129 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fec1a1-73b7-4af2-a1af-d2d2faeea92d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:26.288604 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fec1a1-73b7-4af2-a1af-d2d2faeea92d service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:26.302021 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1383/2767] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:37:26.570286 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572409ac-73f0-49c2-8eee-03111a53a64e service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:26.572860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-572409ac-73f0-49c2-8eee-03111a53a64e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:26.589754 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572409ac-73f0-49c2-8eee-03111a53a64e service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:26.595927 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e73d0-0c0d-49ff-8945-9cbf912d1b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:26.596999 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e73d0-0c0d-49ff-8945-9cbf912d1b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:26.597346 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e73d0-0c0d-49ff-8945-9cbf912d1b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:26.597667 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e73d0-0c0d-49ff-8945-9cbf912d1b8a admin admin] PATH_INFO: `/v3/projects/3f60f2bbe75446379a77148133d3d53b` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:26.599277 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e73d0-0c0d-49ff-8945-9cbf912d1b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f60f2bbe75446379a77148133d3d53b)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:26.601675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e73d0-0c0d-49ff-8945-9cbf912d1b8a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:26.608253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fec1a1-73b7-4af2-a1af-d2d2faeea92d service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:26.609920 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-02fec1a1-73b7-4af2-a1af-d2d2faeea92d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:26.624541 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fec1a1-73b7-4af2-a1af-d2d2faeea92d service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:26.630922 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619f595-a7ff-4598-b313-e783a83338e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:26.632135 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619f595-a7ff-4598-b313-e783a83338e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:26.632533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619f595-a7ff-4598-b313-e783a83338e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:26.632980 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619f595-a7ff-4598-b313-e783a83338e0 admin admin] PATH_INFO: `/v3/projects/b1670bb1972b4c479027e0fb7ae6bd48` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:26.634913 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619f595-a7ff-4598-b313-e783a83338e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1670bb1972b4c479027e0fb7ae6bd48)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:26.636938 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619f595-a7ff-4598-b313-e783a83338e0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:26.659708 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-987e73d0-0c0d-49ff-8945-9cbf912d1b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f60f2bbe75446379a77148133d3d53b', 'request_id': 'req-987e73d0-0c0d-49ff-8945-9cbf912d1b8a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.667177 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-987e73d0-0c0d-49ff-8945-9cbf912d1b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f60f2bbe75446379a77148133d3d53b', 'request_id': 'req-987e73d0-0c0d-49ff-8945-9cbf912d1b8a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.673573 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-987e73d0-0c0d-49ff-8945-9cbf912d1b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f60f2bbe75446379a77148133d3d53b', 'request_id': 'req-987e73d0-0c0d-49ff-8945-9cbf912d1b8a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.687356 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-987e73d0-0c0d-49ff-8945-9cbf912d1b8a admin admin] The token cache is being invalidate because project 3f60f2bbe75446379a77148133d3d53b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:26.687652 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-987e73d0-0c0d-49ff-8945-9cbf912d1b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.688285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-987e73d0-0c0d-49ff-8945-9cbf912d1b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.689840 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1385/2768] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:26 2022] DELETE /identity/v3/projects/3f60f2bbe75446379a77148133d3d53b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:26.692853 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3619f595-a7ff-4598-b313-e783a83338e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1670bb1972b4c479027e0fb7ae6bd48', 'request_id': 'req-3619f595-a7ff-4598-b313-e783a83338e0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.694595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bcd97-d8cd-4d22-a45d-0cdb5de51ba4 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:26.694883 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bcd97-d8cd-4d22-a45d-0cdb5de51ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:26.695162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bcd97-d8cd-4d22-a45d-0cdb5de51ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:26.701074 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3619f595-a7ff-4598-b313-e783a83338e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1670bb1972b4c479027e0fb7ae6bd48', 'request_id': 'req-3619f595-a7ff-4598-b313-e783a83338e0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.709421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3619f595-a7ff-4598-b313-e783a83338e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1670bb1972b4c479027e0fb7ae6bd48', 'request_id': 'req-3619f595-a7ff-4598-b313-e783a83338e0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.714529 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-fd7bcd97-d8cd-4d22-a45d-0cdb5de51ba4 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:26.715763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-fd7bcd97-d8cd-4d22-a45d-0cdb5de51ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:26.720989 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3619f595-a7ff-4598-b313-e783a83338e0 admin admin] The token cache is being invalidate because project b1670bb1972b4c479027e0fb7ae6bd48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:26.721354 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3619f595-a7ff-4598-b313-e783a83338e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.722086 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3619f595-a7ff-4598-b313-e783a83338e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.723753 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1384/2769] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:26 2022] DELETE /identity/v3/projects/b1670bb1972b4c479027e0fb7ae6bd48 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:26.727795 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619f595-a7ff-4598-b313-e783a83338e0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:26.730041 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3619f595-a7ff-4598-b313-e783a83338e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:26.783763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1386/2770] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:37:26.792282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ddd2b-fc50-4289-b7d9-dae1c33b6634 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:26.792540 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ddd2b-fc50-4289-b7d9-dae1c33b6634 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:26.792845 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ddd2b-fc50-4289-b7d9-dae1c33b6634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:26.806046 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619f595-a7ff-4598-b313-e783a83338e0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:26.810861 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd4ff3-9210-4bf5-976b-60bb30605a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:26.811374 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-174ddd2b-fc50-4289-b7d9-dae1c33b6634 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:26.811740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd4ff3-9210-4bf5-976b-60bb30605a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:26.812026 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd4ff3-9210-4bf5-976b-60bb30605a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:26.812306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd4ff3-9210-4bf5-976b-60bb30605a28 admin admin] PATH_INFO: `/v3/users/23ec5be3478b45898797697c9a60fdf0` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:26.812599 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-174ddd2b-fc50-4289-b7d9-dae1c33b6634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:26.813535 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd4ff3-9210-4bf5-976b-60bb30605a28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ec5be3478b45898797697c9a60fdf0)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:26.815550 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd4ff3-9210-4bf5-976b-60bb30605a28 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:26.821292 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1387/2771] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:37:26.826273 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ddd2b-fc50-4289-b7d9-dae1c33b6634 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:26.827745 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:26.836105 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ddd2b-fc50-4289-b7d9-dae1c33b6634 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:26.841309 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb84e38-334c-445d-ab68-4c32248e707e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:26.842031 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb84e38-334c-445d-ab68-4c32248e707e admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:26.842371 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb84e38-334c-445d-ab68-4c32248e707e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:26.842735 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb84e38-334c-445d-ab68-4c32248e707e admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:26.843702 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb84e38-334c-445d-ab68-4c32248e707e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:37:26.844023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb84e38-334c-445d-ab68-4c32248e707e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:26.845911 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb84e38-334c-445d-ab68-4c32248e707e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:26.863802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1388/2772] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:37:26.864884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb84e38-334c-445d-ab68-4c32248e707e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:26.871041 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eadd4ff3-9210-4bf5-976b-60bb30605a28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ec5be3478b45898797697c9a60fdf0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.875837 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb84e38-334c-445d-ab68-4c32248e707e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:26.878801 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eadd4ff3-9210-4bf5-976b-60bb30605a28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ec5be3478b45898797697c9a60fdf0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.880727 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c227e81-ac43-41ad-87cd-ec9cd8dae9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:26.881388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c227e81-ac43-41ad-87cd-ec9cd8dae9fe admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:26.881674 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c227e81-ac43-41ad-87cd-ec9cd8dae9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:26.881957 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c227e81-ac43-41ad-87cd-ec9cd8dae9fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:26.882683 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c227e81-ac43-41ad-87cd-ec9cd8dae9fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:26.885177 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c227e81-ac43-41ad-87cd-ec9cd8dae9fe admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:26.893277 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eadd4ff3-9210-4bf5-976b-60bb30605a28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ec5be3478b45898797697c9a60fdf0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.901848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eadd4ff3-9210-4bf5-976b-60bb30605a28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ec5be3478b45898797697c9a60fdf0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.902579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-eadd4ff3-9210-4bf5-976b-60bb30605a28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ec5be3478b45898797697c9a60fdf0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:26.909351 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1385/2773] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:26 2022] DELETE /identity/v3/users/23ec5be3478b45898797697c9a60fdf0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:26.918835 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1389/2774] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:26 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:26.919982 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd4ff3-9210-4bf5-976b-60bb30605a28 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:26.921366 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-eadd4ff3-9210-4bf5-976b-60bb30605a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:26.995415 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd4ff3-9210-4bf5-976b-60bb30605a28 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:27.059588 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114ea70-befe-4b48-a9f5-2d81317c40e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:27.060344 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114ea70-befe-4b48-a9f5-2d81317c40e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:27.060622 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114ea70-befe-4b48-a9f5-2d81317c40e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:27.060895 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114ea70-befe-4b48-a9f5-2d81317c40e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:27.061588 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114ea70-befe-4b48-a9f5-2d81317c40e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:27.063587 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114ea70-befe-4b48-a9f5-2d81317c40e2 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:27.098341 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1386/2775] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:26 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:27.100921 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c227e81-ac43-41ad-87cd-ec9cd8dae9fe admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:27.112186 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c227e81-ac43-41ad-87cd-ec9cd8dae9fe admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:27.117034 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f66198-766a-49fe-b60a-ef9939db7fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:27.118336 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f66198-766a-49fe-b60a-ef9939db7fcb admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:27.118638 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f66198-766a-49fe-b60a-ef9939db7fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:27.119001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f66198-766a-49fe-b60a-ef9939db7fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:27.119825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f66198-766a-49fe-b60a-ef9939db7fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:27.121339 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f66198-766a-49fe-b60a-ef9939db7fcb admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:27.137287 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1390/2776] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:27.138099 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114ea70-befe-4b48-a9f5-2d81317c40e2 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:27.150385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114ea70-befe-4b48-a9f5-2d81317c40e2 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:27.155517 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d0f5f-552e-415c-95af-3cdb8f330f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:27.156349 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d0f5f-552e-415c-95af-3cdb8f330f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:27.156633 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d0f5f-552e-415c-95af-3cdb8f330f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:27.156909 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d0f5f-552e-415c-95af-3cdb8f330f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:27.157643 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d0f5f-552e-415c-95af-3cdb8f330f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:27.159454 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d0f5f-552e-415c-95af-3cdb8f330f6b admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:27.172098 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1387/2777] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:37:27.176334 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f66198-766a-49fe-b60a-ef9939db7fcb admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:27.182140 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:27.191760 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f66198-766a-49fe-b60a-ef9939db7fcb admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:27.197383 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a49ac-fdf3-492e-9d3c-f78e97ee5d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:27.198287 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a49ac-fdf3-492e-9d3c-f78e97ee5d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:27.198607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a49ac-fdf3-492e-9d3c-f78e97ee5d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:27.198906 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a49ac-fdf3-492e-9d3c-f78e97ee5d4e admin admin] PATH_INFO: `/v3/projects/1cda1ded77cd43558d51132c33b12ec1/users/bab2f5e4809241d1af7ab9e2c76050eb/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:27.215010 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a49ac-fdf3-492e-9d3c-f78e97ee5d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cda1ded77cd43558d51132c33b12ec1, user_id=bab2f5e4809241d1af7ab9e2c76050eb, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:27.217742 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a49ac-fdf3-492e-9d3c-f78e97ee5d4e admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:27.235726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1391/2778] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:27 2022] PUT /identity/v3/projects/1cda1ded77cd43558d51132c33b12ec1/users/bab2f5e4809241d1af7ab9e2c76050eb/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:27.248105 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b6463-fbb4-4c6d-8306-6210b60b75e0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:27.248430 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b6463-fbb4-4c6d-8306-6210b60b75e0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:27.248728 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b6463-fbb4-4c6d-8306-6210b60b75e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:27.272032 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a49ac-fdf3-492e-9d3c-f78e97ee5d4e admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:27.276970 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-354a49ac-fdf3-492e-9d3c-f78e97ee5d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:27.281758 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:27.285783 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-264b6463-fbb4-4c6d-8306-6210b60b75e0 None None] MFA Rules not processed for user `bab2f5e4809241d1af7ab9e2c76050eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:27.287931 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-264b6463-fbb4-4c6d-8306-6210b60b75e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:27.368242 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a49ac-fdf3-492e-9d3c-f78e97ee5d4e admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:27.373215 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc4fe2-6817-44b2-9763-b435e0bfa959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:27.374031 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc4fe2-6817-44b2-9763-b435e0bfa959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:27.374334 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc4fe2-6817-44b2-9763-b435e0bfa959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:27.374621 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc4fe2-6817-44b2-9763-b435e0bfa959 admin admin] PATH_INFO: `/v3/projects/8499fb5f310d4637b2e38a864bdffa58` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:27.375823 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc4fe2-6817-44b2-9763-b435e0bfa959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8499fb5f310d4637b2e38a864bdffa58)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:27.377725 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc4fe2-6817-44b2-9763-b435e0bfa959 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:27.377849 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1388/2779] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:27.389317 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b6463-fbb4-4c6d-8306-6210b60b75e0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:27.390730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-264b6463-fbb4-4c6d-8306-6210b60b75e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:27.446259 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e7fc4fe2-6817-44b2-9763-b435e0bfa959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8499fb5f310d4637b2e38a864bdffa58', 'request_id': 'req-e7fc4fe2-6817-44b2-9763-b435e0bfa959'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:27.453056 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e7fc4fe2-6817-44b2-9763-b435e0bfa959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8499fb5f310d4637b2e38a864bdffa58', 'request_id': 'req-e7fc4fe2-6817-44b2-9763-b435e0bfa959'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:27.456351 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b6463-fbb4-4c6d-8306-6210b60b75e0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:27.459040 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e7fc4fe2-6817-44b2-9763-b435e0bfa959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8499fb5f310d4637b2e38a864bdffa58', 'request_id': 'req-e7fc4fe2-6817-44b2-9763-b435e0bfa959'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:27.474116 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e7fc4fe2-6817-44b2-9763-b435e0bfa959 admin admin] The token cache is being invalidate because project 8499fb5f310d4637b2e38a864bdffa58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:27.474639 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e7fc4fe2-6817-44b2-9763-b435e0bfa959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:27.476293 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-e7fc4fe2-6817-44b2-9763-b435e0bfa959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:27.477227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1392/2780] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:27 2022] DELETE /identity/v3/projects/8499fb5f310d4637b2e38a864bdffa58 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:27.482270 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b871922-2fd4-423b-b7cd-bacee12562b0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:27.482595 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b871922-2fd4-423b-b7cd-bacee12562b0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:27.482914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b871922-2fd4-423b-b7cd-bacee12562b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:27.503253 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2b871922-2fd4-423b-b7cd-bacee12562b0 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:27.504813 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2b871922-2fd4-423b-b7cd-bacee12562b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:27.523370 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c50229-0876-4f43-a360-0b44c03f8dd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:27.524465 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c50229-0876-4f43-a360-0b44c03f8dd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:27.524915 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c50229-0876-4f43-a360-0b44c03f8dd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:27.525366 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c50229-0876-4f43-a360-0b44c03f8dd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:27.528165 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-36c50229-0876-4f43-a360-0b44c03f8dd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:27.568638 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1393/2781] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:37:27.577532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393358f4-5fc3-445f-af1b-1cbb683518a5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:27.577849 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393358f4-5fc3-445f-af1b-1cbb683518a5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:27.578167 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393358f4-5fc3-445f-af1b-1cbb683518a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:27.596708 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-393358f4-5fc3-445f-af1b-1cbb683518a5 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:27.597958 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-393358f4-5fc3-445f-af1b-1cbb683518a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:27.598074 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c50229-0876-4f43-a360-0b44c03f8dd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:27.599470 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c50229-0876-4f43-a360-0b44c03f8dd7 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:27.606038 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1394/2782] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:37:27.608501 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1389/2783] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:37:27.610185 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393358f4-5fc3-445f-af1b-1cbb683518a5 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:27.614763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:27.621009 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393358f4-5fc3-445f-af1b-1cbb683518a5 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:27.627188 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68e728-456f-4584-b3b6-550da4e50685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:27.627833 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68e728-456f-4584-b3b6-550da4e50685 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:27.628021 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68e728-456f-4584-b3b6-550da4e50685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:27.628382 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a68e728-456f-4584-b3b6-550da4e50685 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:27.630424 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68e728-456f-4584-b3b6-550da4e50685 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:37:27.630424 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68e728-456f-4584-b3b6-550da4e50685 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:27.632015 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a68e728-456f-4584-b3b6-550da4e50685 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:27.635697 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c50229-0876-4f43-a360-0b44c03f8dd7 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:27.637091 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-36c50229-0876-4f43-a360-0b44c03f8dd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:27.645113 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1395/2784] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:37:27.649001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68e728-456f-4584-b3b6-550da4e50685 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:27.651101 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c50229-0876-4f43-a360-0b44c03f8dd7 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:27.656876 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06241a1-f51b-4266-bd62-ae73fb1e51ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:27.657762 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06241a1-f51b-4266-bd62-ae73fb1e51ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:27.658040 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06241a1-f51b-4266-bd62-ae73fb1e51ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:27.658342 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06241a1-f51b-4266-bd62-ae73fb1e51ef admin admin] PATH_INFO: `/v3/users/bab2f5e4809241d1af7ab9e2c76050eb` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:27.658880 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a68e728-456f-4584-b3b6-550da4e50685 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:27.659597 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06241a1-f51b-4266-bd62-ae73fb1e51ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=bab2f5e4809241d1af7ab9e2c76050eb)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:27.661779 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06241a1-f51b-4266-bd62-ae73fb1e51ef admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:27.663889 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37ae7e-1e35-4064-983d-42ce0c88c5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:27.664573 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37ae7e-1e35-4064-983d-42ce0c88c5c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:27.664860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37ae7e-1e35-4064-983d-42ce0c88c5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:27.665143 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37ae7e-1e35-4064-983d-42ce0c88c5c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:27.665865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37ae7e-1e35-4064-983d-42ce0c88c5c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:27.667565 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:27.667834 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37ae7e-1e35-4064-983d-42ce0c88c5c0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:27.704997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1396/2785] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:27 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:37:27.710103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37ae7e-1e35-4064-983d-42ce0c88c5c0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:27.719107 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f06241a1-f51b-4266-bd62-ae73fb1e51ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bab2f5e4809241d1af7ab9e2c76050eb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:27.728086 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f06241a1-f51b-4266-bd62-ae73fb1e51ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bab2f5e4809241d1af7ab9e2c76050eb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:27.741862 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f06241a1-f51b-4266-bd62-ae73fb1e51ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bab2f5e4809241d1af7ab9e2c76050eb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:27.752247 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f06241a1-f51b-4266-bd62-ae73fb1e51ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bab2f5e4809241d1af7ab9e2c76050eb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:27.752950 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-f06241a1-f51b-4266-bd62-ae73fb1e51ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bab2f5e4809241d1af7ab9e2c76050eb'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:27.761449 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1390/2786] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:27 2022] DELETE /identity/v3/users/bab2f5e4809241d1af7ab9e2c76050eb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:27.766740 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efd945-ca30-4726-b690-68c989300563 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:27.767204 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efd945-ca30-4726-b690-68c989300563 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:27.767514 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efd945-ca30-4726-b690-68c989300563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:27.782379 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37ae7e-1e35-4064-983d-42ce0c88c5c0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:27.790742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-36efd945-ca30-4726-b690-68c989300563 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:27.792171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-36efd945-ca30-4726-b690-68c989300563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:27.849358 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92642476-df57-4ebd-b770-b38369dc7f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:27.850044 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92642476-df57-4ebd-b770-b38369dc7f06 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:27.850366 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92642476-df57-4ebd-b770-b38369dc7f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:27.850654 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92642476-df57-4ebd-b770-b38369dc7f06 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:27.851504 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92642476-df57-4ebd-b770-b38369dc7f06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:27.854025 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92642476-df57-4ebd-b770-b38369dc7f06 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:27.857142 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1391/2787] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:27.870837 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efd945-ca30-4726-b690-68c989300563 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:27.872260 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-36efd945-ca30-4726-b690-68c989300563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:27.875091 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1397/2788] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:27 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:37:27.879613 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92642476-df57-4ebd-b770-b38369dc7f06 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:27.881243 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-92642476-df57-4ebd-b770-b38369dc7f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:27.893695 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92642476-df57-4ebd-b770-b38369dc7f06 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:27.898688 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40535f0f-a781-4889-9252-9256eb29a25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:27.899365 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40535f0f-a781-4889-9252-9256eb29a25d admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:27.899722 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40535f0f-a781-4889-9252-9256eb29a25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:27.900003 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40535f0f-a781-4889-9252-9256eb29a25d admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:27.900738 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40535f0f-a781-4889-9252-9256eb29a25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:27.902447 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40535f0f-a781-4889-9252-9256eb29a25d admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:27.913449 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1398/2789] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:37:27.919294 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40535f0f-a781-4889-9252-9256eb29a25d admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:27.929598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40535f0f-a781-4889-9252-9256eb29a25d admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:27.935313 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efd945-ca30-4726-b690-68c989300563 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:27.936496 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e8cb3-4272-4d12-8a68-df0109d12215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:27.937249 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e8cb3-4272-4d12-8a68-df0109d12215 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:27.937642 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e8cb3-4272-4d12-8a68-df0109d12215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:27.937955 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e8cb3-4272-4d12-8a68-df0109d12215 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:27.938795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e8cb3-4272-4d12-8a68-df0109d12215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:27.939063 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451dfd3-8116-43f7-a9f6-209a37398dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:27.939733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451dfd3-8116-43f7-a9f6-209a37398dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:27.940017 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451dfd3-8116-43f7-a9f6-209a37398dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:27.940296 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451dfd3-8116-43f7-a9f6-209a37398dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:27.940492 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e8cb3-4272-4d12-8a68-df0109d12215 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:27.950062 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451dfd3-8116-43f7-a9f6-209a37398dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:27.951523 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451dfd3-8116-43f7-a9f6-209a37398dc3 service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:27.952275 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1399/2790] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:27.956710 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e8cb3-4272-4d12-8a68-df0109d12215 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:27.966430 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1392/2791] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:37:27.967878 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e8cb3-4272-4d12-8a68-df0109d12215 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:27.972896 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515dff87-56c5-4ccd-bb2a-332d40ca5499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:27.973851 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dff87-56c5-4ccd-bb2a-332d40ca5499 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:27.974166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dff87-56c5-4ccd-bb2a-332d40ca5499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:27.974510 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dff87-56c5-4ccd-bb2a-332d40ca5499 admin admin] PATH_INFO: `/v3/projects/8d7fb9a96bd542f2978a82cf3960c2f4/users/94ae5b12b88b48eb940083646ceb36ef/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:27.991095 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515dff87-56c5-4ccd-bb2a-332d40ca5499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7fb9a96bd542f2978a82cf3960c2f4, user_id=94ae5b12b88b48eb940083646ceb36ef, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:27.994550 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515dff87-56c5-4ccd-bb2a-332d40ca5499 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:28.011985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1400/2792] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:27 2022] PUT /identity/v3/projects/8d7fb9a96bd542f2978a82cf3960c2f4/users/94ae5b12b88b48eb940083646ceb36ef/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:28.025768 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b3ec2-e437-4b1b-9c11-7019adc25798 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:28.026061 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b3ec2-e437-4b1b-9c11-7019adc25798 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:28.026403 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b3ec2-e437-4b1b-9c11-7019adc25798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:28.056053 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-3c1b3ec2-e437-4b1b-9c11-7019adc25798 None None] MFA Rules not processed for user `94ae5b12b88b48eb940083646ceb36ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:28.057277 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3c1b3ec2-e437-4b1b-9c11-7019adc25798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:28.075835 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:28.134496 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1393/2793] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:28.139532 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515dff87-56c5-4ccd-bb2a-332d40ca5499 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:28.168870 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:28.229029 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515dff87-56c5-4ccd-bb2a-332d40ca5499 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:28.236983 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8d61f-2b1d-47cf-8997-d10e802cb700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:28.237726 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8d61f-2b1d-47cf-8997-d10e802cb700 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:28.238053 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8d61f-2b1d-47cf-8997-d10e802cb700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:28.238468 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8d61f-2b1d-47cf-8997-d10e802cb700 admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:28.239399 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8d61f-2b1d-47cf-8997-d10e802cb700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:28.242069 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8d61f-2b1d-47cf-8997-d10e802cb700 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:28.275199 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1401/2794] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:28 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:28.279926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b3ec2-e437-4b1b-9c11-7019adc25798 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:28.293807 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b3ec2-e437-4b1b-9c11-7019adc25798 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:28.361492 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51a9f9-1301-48a7-97a1-bc753c1a0b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:28.362459 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51a9f9-1301-48a7-97a1-bc753c1a0b71 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:28.362840 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51a9f9-1301-48a7-97a1-bc753c1a0b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:28.363435 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51a9f9-1301-48a7-97a1-bc753c1a0b71 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:28.364345 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51a9f9-1301-48a7-97a1-bc753c1a0b71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:28.366853 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51a9f9-1301-48a7-97a1-bc753c1a0b71 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:28.391721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1394/2795] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:28 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:28.397282 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8d61f-2b1d-47cf-8997-d10e802cb700 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:28.412861 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8d61f-2b1d-47cf-8997-d10e802cb700 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:28.418525 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062d273-c1aa-48ea-8c3c-159b2961010a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:28.419209 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062d273-c1aa-48ea-8c3c-159b2961010a admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:28.419501 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062d273-c1aa-48ea-8c3c-159b2961010a admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:28.419768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062d273-c1aa-48ea-8c3c-159b2961010a admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:28.420573 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062d273-c1aa-48ea-8c3c-159b2961010a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:28.422570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062d273-c1aa-48ea-8c3c-159b2961010a admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:28.434410 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1402/2796] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:28.439473 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51a9f9-1301-48a7-97a1-bc753c1a0b71 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:28.452201 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51a9f9-1301-48a7-97a1-bc753c1a0b71 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:28.458763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd7d74-07a9-4bb8-b1ec-8e81725bed81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:28.459444 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd7d74-07a9-4bb8-b1ec-8e81725bed81 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:28.459719 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd7d74-07a9-4bb8-b1ec-8e81725bed81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:28.460000 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd7d74-07a9-4bb8-b1ec-8e81725bed81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:28.460844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd7d74-07a9-4bb8-b1ec-8e81725bed81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:28.463289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd7d74-07a9-4bb8-b1ec-8e81725bed81 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:28.479456 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1395/2797] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:28.484275 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062d273-c1aa-48ea-8c3c-159b2961010a admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:28.495561 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062d273-c1aa-48ea-8c3c-159b2961010a admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:28.503998 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8c7d6-f607-468b-b2d3-5428b7d6ed98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:28.504941 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8c7d6-f607-468b-b2d3-5428b7d6ed98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:28.505227 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8c7d6-f607-468b-b2d3-5428b7d6ed98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:28.505512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8c7d6-f607-468b-b2d3-5428b7d6ed98 admin admin] PATH_INFO: `/v3/projects/7baa4b0d6972464ab8a3488be1e00262/users/7ba6c02d8d554900bb6e10b40f52a979/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:28.506122 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd7d74-07a9-4bb8-b1ec-8e81725bed81 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:28.508091 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-48dd7d74-07a9-4bb8-b1ec-8e81725bed81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:28.522675 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd7d74-07a9-4bb8-b1ec-8e81725bed81 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:28.528266 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b159b-46ad-4f3e-ac0f-873bbab57dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:28.529141 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b159b-46ad-4f3e-ac0f-873bbab57dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:28.529423 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b159b-46ad-4f3e-ac0f-873bbab57dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:28.529829 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b159b-46ad-4f3e-ac0f-873bbab57dcf admin admin] PATH_INFO: `/v3/projects/1cda1ded77cd43558d51132c33b12ec1` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:28.529951 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8c7d6-f607-468b-b2d3-5428b7d6ed98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7baa4b0d6972464ab8a3488be1e00262, user_id=7ba6c02d8d554900bb6e10b40f52a979, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:28.531319 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b159b-46ad-4f3e-ac0f-873bbab57dcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cda1ded77cd43558d51132c33b12ec1)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:28.532836 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b159b-46ad-4f3e-ac0f-873bbab57dcf admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:28.534668 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8c7d6-f607-468b-b2d3-5428b7d6ed98 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:28.566747 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1403/2798] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:28 2022] PUT /identity/v3/projects/7baa4b0d6972464ab8a3488be1e00262/users/7ba6c02d8d554900bb6e10b40f52a979/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:28.590675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28791eff-75f9-4916-bde5-6d3b89c64e0d None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:28.590970 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28791eff-75f9-4916-bde5-6d3b89c64e0d None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:28.593037 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28791eff-75f9-4916-bde5-6d3b89c64e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:28.617181 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-344b159b-46ad-4f3e-ac0f-873bbab57dcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cda1ded77cd43558d51132c33b12ec1', 'request_id': 'req-344b159b-46ad-4f3e-ac0f-873bbab57dcf'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:28.625238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-28791eff-75f9-4916-bde5-6d3b89c64e0d None None] MFA Rules not processed for user `7ba6c02d8d554900bb6e10b40f52a979`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:28.626528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-28791eff-75f9-4916-bde5-6d3b89c64e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:28.626940 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-344b159b-46ad-4f3e-ac0f-873bbab57dcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cda1ded77cd43558d51132c33b12ec1', 'request_id': 'req-344b159b-46ad-4f3e-ac0f-873bbab57dcf'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:28.637132 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-344b159b-46ad-4f3e-ac0f-873bbab57dcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cda1ded77cd43558d51132c33b12ec1', 'request_id': 'req-344b159b-46ad-4f3e-ac0f-873bbab57dcf'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:28.651945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-344b159b-46ad-4f3e-ac0f-873bbab57dcf admin admin] The token cache is being invalidate because project 1cda1ded77cd43558d51132c33b12ec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:28.652625 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-344b159b-46ad-4f3e-ac0f-873bbab57dcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:28.653686 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-344b159b-46ad-4f3e-ac0f-873bbab57dcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:28.656742 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1396/2799] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:28 2022] DELETE /identity/v3/projects/1cda1ded77cd43558d51132c33b12ec1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:28.661979 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61487d5e-a779-4a97-a91d-354912d47cf3 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:28.662412 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61487d5e-a779-4a97-a91d-354912d47cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:28.662790 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61487d5e-a779-4a97-a91d-354912d47cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:28.682037 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-61487d5e-a779-4a97-a91d-354912d47cf3 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:28.683451 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-61487d5e-a779-4a97-a91d-354912d47cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:28.701669 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:28.715413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1404/2800] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:28.716675 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28791eff-75f9-4916-bde5-6d3b89c64e0d None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:28.719623 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-28791eff-75f9-4916-bde5-6d3b89c64e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:28.767499 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1397/2801] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:28.775845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f782f7-590e-4288-9b7c-9ad2886ba29a None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:28.776287 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f782f7-590e-4288-9b7c-9ad2886ba29a None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:28.776829 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f782f7-590e-4288-9b7c-9ad2886ba29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:28.797685 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-78f782f7-590e-4288-9b7c-9ad2886ba29a None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:28.799347 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:28.807668 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28791eff-75f9-4916-bde5-6d3b89c64e0d None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:28.807847 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-78f782f7-590e-4288-9b7c-9ad2886ba29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:28.815579 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d57163-da60-4eae-97c9-afe355de8cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:28.816566 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d57163-da60-4eae-97c9-afe355de8cbc admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:28.817032 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d57163-da60-4eae-97c9-afe355de8cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:28.817471 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d57163-da60-4eae-97c9-afe355de8cbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:28.818593 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d57163-da60-4eae-97c9-afe355de8cbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:28.821519 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d57163-da60-4eae-97c9-afe355de8cbc admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:28.828385 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1398/2802] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:28.830447 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f782f7-590e-4288-9b7c-9ad2886ba29a None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:28.842930 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f782f7-590e-4288-9b7c-9ad2886ba29a None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:28.848559 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b53f31-e44a-45b2-a3c5-70f6884a6b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:28.849361 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b53f31-e44a-45b2-a3c5-70f6884a6b44 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:28.849804 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b53f31-e44a-45b2-a3c5-70f6884a6b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:28.850366 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b53f31-e44a-45b2-a3c5-70f6884a6b44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:28.851523 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b53f31-e44a-45b2-a3c5-70f6884a6b44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:37:28.851970 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b53f31-e44a-45b2-a3c5-70f6884a6b44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:28.853744 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b53f31-e44a-45b2-a3c5-70f6884a6b44 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:28.857449 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1405/2803] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:28 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:37:28.867884 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d57163-da60-4eae-97c9-afe355de8cbc admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:28.875801 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1399/2804] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:37:28.880609 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b53f31-e44a-45b2-a3c5-70f6884a6b44 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:28.893109 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b53f31-e44a-45b2-a3c5-70f6884a6b44 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:28.955696 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d57163-da60-4eae-97c9-afe355de8cbc admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:28.960784 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31071c4d-2a90-476e-8a42-127b4ee28c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:28.961517 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31071c4d-2a90-476e-8a42-127b4ee28c03 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:28.961879 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31071c4d-2a90-476e-8a42-127b4ee28c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:28.962161 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31071c4d-2a90-476e-8a42-127b4ee28c03 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:28.962894 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31071c4d-2a90-476e-8a42-127b4ee28c03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:28.964944 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce94a90-f5d8-48bb-bd40-b6b4e78b4be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:28.965106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31071c4d-2a90-476e-8a42-127b4ee28c03 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:28.965810 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce94a90-f5d8-48bb-bd40-b6b4e78b4be4 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:28.966220 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce94a90-f5d8-48bb-bd40-b6b4e78b4be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:28.966621 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce94a90-f5d8-48bb-bd40-b6b4e78b4be4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:28.967720 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce94a90-f5d8-48bb-bd40-b6b4e78b4be4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:28.969730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce94a90-f5d8-48bb-bd40-b6b4e78b4be4 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:28.988940 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1406/2805] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:28 2022] POST /identity/v3/users => generated 300 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:28.990103 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31071c4d-2a90-476e-8a42-127b4ee28c03 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:29.000979 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31071c4d-2a90-476e-8a42-127b4ee28c03 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:29.006079 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71843d96-0b46-4fd2-a889-d1069216fb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:29.006785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71843d96-0b46-4fd2-a889-d1069216fb44 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:29.007072 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71843d96-0b46-4fd2-a889-d1069216fb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:29.007718 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71843d96-0b46-4fd2-a889-d1069216fb44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:29.008909 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71843d96-0b46-4fd2-a889-d1069216fb44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:29.009299 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1400/2806] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:28 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:29.010079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce94a90-f5d8-48bb-bd40-b6b4e78b4be4 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:29.010533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71843d96-0b46-4fd2-a889-d1069216fb44 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:29.021914 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1407/2807] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:37:29.026255 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71843d96-0b46-4fd2-a889-d1069216fb44 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:29.037392 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71843d96-0b46-4fd2-a889-d1069216fb44 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:29.080050 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce94a90-f5d8-48bb-bd40-b6b4e78b4be4 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:29.084891 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cce3ea-f3a6-42e1-8069-e36949a8349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:29.085591 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cce3ea-f3a6-42e1-8069-e36949a8349d admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:29.085877 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cce3ea-f3a6-42e1-8069-e36949a8349d admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:29.086183 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cce3ea-f3a6-42e1-8069-e36949a8349d admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:29.086951 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cce3ea-f3a6-42e1-8069-e36949a8349d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:29.088919 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cce3ea-f3a6-42e1-8069-e36949a8349d admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:29.101086 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f123527-35b8-4f88-97e8-a73f299d68e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:29.102155 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f123527-35b8-4f88-97e8-a73f299d68e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:29.102477 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f123527-35b8-4f88-97e8-a73f299d68e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:29.102772 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f123527-35b8-4f88-97e8-a73f299d68e1 admin admin] PATH_INFO: `/v3/projects/b5f8c68e80244185ace5961fb373cc7a/users/eab99f4ab91f46879dec7da5ba01ec0b/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:29.112910 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1401/2808] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:29 2022] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:29.114134 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cce3ea-f3a6-42e1-8069-e36949a8349d admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:29.119317 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f123527-35b8-4f88-97e8-a73f299d68e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f8c68e80244185ace5961fb373cc7a, user_id=eab99f4ab91f46879dec7da5ba01ec0b, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:29.122154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f123527-35b8-4f88-97e8-a73f299d68e1 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:29.124850 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cce3ea-f3a6-42e1-8069-e36949a8349d admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:29.130188 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e8915-de0a-4689-bc65-9e32a081e6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:29.131053 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e8915-de0a-4689-bc65-9e32a081e6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:29.131657 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e8915-de0a-4689-bc65-9e32a081e6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:29.131943 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e8915-de0a-4689-bc65-9e32a081e6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:29.132683 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e8915-de0a-4689-bc65-9e32a081e6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:29.135218 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e8915-de0a-4689-bc65-9e32a081e6b6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:29.136944 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1408/2809] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:29 2022] PUT /identity/v3/projects/b5f8c68e80244185ace5961fb373cc7a/users/eab99f4ab91f46879dec7da5ba01ec0b/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:29.140730 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f123527-35b8-4f88-97e8-a73f299d68e1 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:29.150239 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1402/2810] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:37:29.155533 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e8915-de0a-4689-bc65-9e32a081e6b6 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:29.162969 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:29.168881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e8915-de0a-4689-bc65-9e32a081e6b6 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:29.197827 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:29.220118 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f123527-35b8-4f88-97e8-a73f299d68e1 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:29.224986 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5022e-4fe4-4eb4-a3d5-022562735188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:29.225682 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5022e-4fe4-4eb4-a3d5-022562735188 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:29.225971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5022e-4fe4-4eb4-a3d5-022562735188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:29.226250 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5022e-4fe4-4eb4-a3d5-022562735188 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:29.227074 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5022e-4fe4-4eb4-a3d5-022562735188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:29.228719 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5022e-4fe4-4eb4-a3d5-022562735188 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:29.243867 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1409/2811] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:37:29.244788 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5022e-4fe4-4eb4-a3d5-022562735188 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:29.245505 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f777e-65f1-45f3-a4a5-e0319a27abbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:29.246544 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f777e-65f1-45f3-a4a5-e0319a27abbc admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:29.246919 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f777e-65f1-45f3-a4a5-e0319a27abbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:29.247289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f777e-65f1-45f3-a4a5-e0319a27abbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:29.248677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f777e-65f1-45f3-a4a5-e0319a27abbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:29.250008 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f777e-65f1-45f3-a4a5-e0319a27abbc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:29.261892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5022e-4fe4-4eb4-a3d5-022562735188 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:29.263338 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1403/2812] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:29.267200 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c48124-327a-46d6-8a5b-e1ee2bc8e578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:29.268110 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c48124-327a-46d6-8a5b-e1ee2bc8e578 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:29.268402 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c48124-327a-46d6-8a5b-e1ee2bc8e578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:29.268571 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f777e-65f1-45f3-a4a5-e0319a27abbc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:29.268684 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c48124-327a-46d6-8a5b-e1ee2bc8e578 admin admin] PATH_INFO: `/v3/projects/b5f8c68e80244185ace5961fb373cc7a/users/eab99f4ab91f46879dec7da5ba01ec0b/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:29.270820 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c48124-327a-46d6-8a5b-e1ee2bc8e578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f8c68e80244185ace5961fb373cc7a, user_id=eab99f4ab91f46879dec7da5ba01ec0b, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:29.273668 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c48124-327a-46d6-8a5b-e1ee2bc8e578 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:29.281627 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f777e-65f1-45f3-a4a5-e0319a27abbc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:29.285871 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1410/2813] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:29 2022] PUT /identity/v3/projects/b5f8c68e80244185ace5961fb373cc7a/users/eab99f4ab91f46879dec7da5ba01ec0b/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:29.298916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06035e9-bdb9-4ef6-a254-251e6afb6995 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:29.299218 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06035e9-bdb9-4ef6-a254-251e6afb6995 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:29.299505 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06035e9-bdb9-4ef6-a254-251e6afb6995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:29.329395 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-a06035e9-bdb9-4ef6-a254-251e6afb6995 None None] MFA Rules not processed for user `eab99f4ab91f46879dec7da5ba01ec0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:29.330813 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a06035e9-bdb9-4ef6-a254-251e6afb6995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:29.373096 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dea647-c99e-4eb5-9982-a01144d5791e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:29.375155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dea647-c99e-4eb5-9982-a01144d5791e admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:29.375530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dea647-c99e-4eb5-9982-a01144d5791e admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:29.375881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dea647-c99e-4eb5-9982-a01144d5791e admin admin] PATH_INFO: `/v3/projects/278a1fcb95c946ac91de7115474ff4c3/users/259c06e0c6d14e44b9fff5254087e2b5/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:29.397963 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dea647-c99e-4eb5-9982-a01144d5791e admin admin] RBAC: Authorizing `identity:create_grant(project_id=278a1fcb95c946ac91de7115474ff4c3, user_id=259c06e0c6d14e44b9fff5254087e2b5, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:29.400803 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dea647-c99e-4eb5-9982-a01144d5791e admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:29.418150 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1411/2814] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:37:29.426497 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1404/2815] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:29 2022] PUT /identity/v3/projects/278a1fcb95c946ac91de7115474ff4c3/users/259c06e0c6d14e44b9fff5254087e2b5/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:29.428664 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06035e9-bdb9-4ef6-a254-251e6afb6995 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:29.430802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a06035e9-bdb9-4ef6-a254-251e6afb6995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:29.432593 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7d9c7-c217-4ae2-bce6-b390c152f78c None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:29.432927 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7d9c7-c217-4ae2-bce6-b390c152f78c None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:29.433223 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7d9c7-c217-4ae2-bce6-b390c152f78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:29.462094 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-33e7d9c7-c217-4ae2-bce6-b390c152f78c None None] MFA Rules not processed for user `259c06e0c6d14e44b9fff5254087e2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:29.463394 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-33e7d9c7-c217-4ae2-bce6-b390c152f78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:29.493818 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06035e9-bdb9-4ef6-a254-251e6afb6995 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:29.538529 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1405/2816] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:37:29.549172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded4be3-373e-45eb-acf5-b96a372a6103 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:29.549834 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded4be3-373e-45eb-acf5-b96a372a6103 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:29.550117 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded4be3-373e-45eb-acf5-b96a372a6103 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:29.550424 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded4be3-373e-45eb-acf5-b96a372a6103 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:29.552753 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7d9c7-c217-4ae2-bce6-b390c152f78c None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:29.554198 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-33e7d9c7-c217-4ae2-bce6-b390c152f78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:29.566872 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7d9c7-c217-4ae2-bce6-b390c152f78c None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:29.570631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2f06d-e824-4b36-9ff9-081af60f82eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:29.571312 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2f06d-e824-4b36-9ff9-081af60f82eb service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:29.571613 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2f06d-e824-4b36-9ff9-081af60f82eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:29.571897 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2f06d-e824-4b36-9ff9-081af60f82eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:29.573682 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:29.585082 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2f06d-e824-4b36-9ff9-081af60f82eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:29.586776 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2f06d-e824-4b36-9ff9-081af60f82eb service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:29.592254 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:29.598739 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1406/2817] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:37:29.624391 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded4be3-373e-45eb-acf5-b96a372a6103 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:29.625856 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded4be3-373e-45eb-acf5-b96a372a6103 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:29.636377 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1412/2818] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:37:29.754448 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d1d06-6c74-485a-99d1-c7260b8facd2 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:29.754920 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d1d06-6c74-485a-99d1-c7260b8facd2 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:29.755030 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d1d06-6c74-485a-99d1-c7260b8facd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:29.777146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-820d1d06-6c74-485a-99d1-c7260b8facd2 None None] MFA Rules not processed for user `e78792e617d84a7cbb384ed764c391fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:29.778424 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-820d1d06-6c74-485a-99d1-c7260b8facd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:29.851124 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1407/2819] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jul 20 19:37:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:29.907357 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded4be3-373e-45eb-acf5-b96a372a6103 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:29.908969 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-9ded4be3-373e-45eb-acf5-b96a372a6103 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:30.002904 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded4be3-373e-45eb-acf5-b96a372a6103 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:30.010039 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad23254-895c-407c-a2d7-34ffcb4037f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebd7c59f0014a3886fa75fb35a40e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:30.010802 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad23254-895c-407c-a2d7-34ffcb4037f8 service swift] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:30.011162 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad23254-895c-407c-a2d7-34ffcb4037f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:30.011518 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad23254-895c-407c-a2d7-34ffcb4037f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:30.022565 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad23254-895c-407c-a2d7-34ffcb4037f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:30.025063 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad23254-895c-407c-a2d7-34ffcb4037f8 service swift] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:30.035563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1413/2820] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 20 19:37:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:37:30.246377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d1d06-6c74-485a-99d1-c7260b8facd2 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:30.256443 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d1d06-6c74-485a-99d1-c7260b8facd2 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:30.260215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e1e49-c05c-452f-a3e5-bc7d6f91c9cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:30.260864 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e1e49-c05c-452f-a3e5-bc7d6f91c9cc service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:30.261129 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e1e49-c05c-452f-a3e5-bc7d6f91c9cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:30.261479 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e1e49-c05c-452f-a3e5-bc7d6f91c9cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:30.263598 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e95e1e49-c05c-452f-a3e5-bc7d6f91c9cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:30.328423 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e1e49-c05c-452f-a3e5-bc7d6f91c9cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:30.329861 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e1e49-c05c-452f-a3e5-bc7d6f91c9cc service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:30.339367 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1408/2821] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:33.900344 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad23254-895c-407c-a2d7-34ffcb4037f8 service swift] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:33.902331 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-aad23254-895c-407c-a2d7-34ffcb4037f8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:34.019030 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad23254-895c-407c-a2d7-34ffcb4037f8 service swift] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:34.025695 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a8121-7f14-4711-beb5-4cffb6244e0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd310799ac43e42bc9c7810e1296ddb9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:34.026997 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a8121-7f14-4711-beb5-4cffb6244e0c service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:34.027703 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a8121-7f14-4711-beb5-4cffb6244e0c service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:34.028375 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a8121-7f14-4711-beb5-4cffb6244e0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:34.031630 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b65a8121-7f14-4711-beb5-4cffb6244e0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:34.054588 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a8121-7f14-4711-beb5-4cffb6244e0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:34.054588 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a8121-7f14-4711-beb5-4cffb6244e0c service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:34.058699 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1414/2822] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:34.563387 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e1e49-c05c-452f-a3e5-bc7d6f91c9cc service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:34.573610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e1e49-c05c-452f-a3e5-bc7d6f91c9cc service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:34.583182 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5333bf-f525-48b0-88ce-b71e549aab79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:34.584091 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5333bf-f525-48b0-88ce-b71e549aab79 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:34.584482 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5333bf-f525-48b0-88ce-b71e549aab79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:34.584875 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5333bf-f525-48b0-88ce-b71e549aab79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:34.659546 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5333bf-f525-48b0-88ce-b71e549aab79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:34.661022 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5333bf-f525-48b0-88ce-b71e549aab79 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:34.672423 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1409/2823] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:37.126775 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a8121-7f14-4711-beb5-4cffb6244e0c service placement] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:37.227846 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:37.261591 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a8121-7f14-4711-beb5-4cffb6244e0c service placement] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:37.272538 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b8a95-de02-46b1-b487-d49ee98a5081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:37.272759 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b8a95-de02-46b1-b487-d49ee98a5081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:37.273029 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b8a95-de02-46b1-b487-d49ee98a5081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:37.273311 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b8a95-de02-46b1-b487-d49ee98a5081 admin admin] PATH_INFO: `/v3/users/94ae5b12b88b48eb940083646ceb36ef` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:37.275129 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b8a95-de02-46b1-b487-d49ee98a5081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94ae5b12b88b48eb940083646ceb36ef)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:37.278736 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b8a95-de02-46b1-b487-d49ee98a5081 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:37.351414 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b57b8a95-de02-46b1-b487-d49ee98a5081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94ae5b12b88b48eb940083646ceb36ef'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:37.360322 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b57b8a95-de02-46b1-b487-d49ee98a5081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94ae5b12b88b48eb940083646ceb36ef'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:37.371660 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b57b8a95-de02-46b1-b487-d49ee98a5081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94ae5b12b88b48eb940083646ceb36ef'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:37.372563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b57b8a95-de02-46b1-b487-d49ee98a5081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94ae5b12b88b48eb940083646ceb36ef'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:37.373590 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-b57b8a95-de02-46b1-b487-d49ee98a5081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94ae5b12b88b48eb940083646ceb36ef'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:37.400409 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1415/2824] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:37 2022] DELETE /identity/v3/users/94ae5b12b88b48eb940083646ceb36ef => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:37.402207 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17171509-fc9d-4729-8597-5aa504bfb340 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:37.402721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17171509-fc9d-4729-8597-5aa504bfb340 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:37.402809 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17171509-fc9d-4729-8597-5aa504bfb340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:37.423153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-17171509-fc9d-4729-8597-5aa504bfb340 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:37.424535 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-17171509-fc9d-4729-8597-5aa504bfb340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:37.469011 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=100 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:37.498789 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1410/2825] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:37:37.511308 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b8a95-de02-46b1-b487-d49ee98a5081 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:37.514132 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-b57b8a95-de02-46b1-b487-d49ee98a5081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:37.609896 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b8a95-de02-46b1-b487-d49ee98a5081 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:37.613513 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9663b0-0e3d-4609-80d8-9cba80734db3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:37.614165 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9663b0-0e3d-4609-80d8-9cba80734db3 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:37.614493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9663b0-0e3d-4609-80d8-9cba80734db3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:37.614779 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9663b0-0e3d-4609-80d8-9cba80734db3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:37.625342 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9663b0-0e3d-4609-80d8-9cba80734db3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:37.626608 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9663b0-0e3d-4609-80d8-9cba80734db3 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:37.636700 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1416/2826] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:37.773769 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17171509-fc9d-4729-8597-5aa504bfb340 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:37.775255 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-17171509-fc9d-4729-8597-5aa504bfb340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:37.788181 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17171509-fc9d-4729-8597-5aa504bfb340 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:37.795056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fbcdf-f6df-4f01-bdff-123d4d9c6931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:37.795935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fbcdf-f6df-4f01-bdff-123d4d9c6931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:37.796215 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fbcdf-f6df-4f01-bdff-123d4d9c6931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:37.796490 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fbcdf-f6df-4f01-bdff-123d4d9c6931 admin admin] PATH_INFO: `/v3/users/fd7465e584324715a826e3255ff6f9d0` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:37.797730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fbcdf-f6df-4f01-bdff-123d4d9c6931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd7465e584324715a826e3255ff6f9d0)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:37.799673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fbcdf-f6df-4f01-bdff-123d4d9c6931 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:37.859587 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2a7fbcdf-f6df-4f01-bdff-123d4d9c6931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd7465e584324715a826e3255ff6f9d0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:37.870537 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2a7fbcdf-f6df-4f01-bdff-123d4d9c6931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd7465e584324715a826e3255ff6f9d0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:37.894570 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2a7fbcdf-f6df-4f01-bdff-123d4d9c6931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd7465e584324715a826e3255ff6f9d0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:37.906989 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2a7fbcdf-f6df-4f01-bdff-123d4d9c6931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd7465e584324715a826e3255ff6f9d0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:37.908048 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-2a7fbcdf-f6df-4f01-bdff-123d4d9c6931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd7465e584324715a826e3255ff6f9d0'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:37.918343 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1411/2827] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:37 2022] DELETE /identity/v3/users/fd7465e584324715a826e3255ff6f9d0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:38.024014 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9663b0-0e3d-4609-80d8-9cba80734db3 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:38.026991 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5c9663b0-0e3d-4609-80d8-9cba80734db3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:38.044449 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9663b0-0e3d-4609-80d8-9cba80734db3 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:38.138346 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fbcdf-f6df-4f01-bdff-123d4d9c6931 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:38.140696 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-2a7fbcdf-f6df-4f01-bdff-123d4d9c6931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:38.144448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def84dd4-511f-4738-af4c-244720e6aa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:38.146368 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def84dd4-511f-4738-af4c-244720e6aa6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:38.146558 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def84dd4-511f-4738-af4c-244720e6aa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:38.146748 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def84dd4-511f-4738-af4c-244720e6aa6f admin admin] PATH_INFO: `/v3/projects/8d7fb9a96bd542f2978a82cf3960c2f4` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:38.149214 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def84dd4-511f-4738-af4c-244720e6aa6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d7fb9a96bd542f2978a82cf3960c2f4)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:38.152472 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def84dd4-511f-4738-af4c-244720e6aa6f admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:38.155177 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:38.183579 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fbcdf-f6df-4f01-bdff-123d4d9c6931 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:38.189452 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d75c7-ecfa-475f-8f0a-5db6ebef8689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:38.190507 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d75c7-ecfa-475f-8f0a-5db6ebef8689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:38.190918 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d75c7-ecfa-475f-8f0a-5db6ebef8689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:38.191330 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d75c7-ecfa-475f-8f0a-5db6ebef8689 admin admin] PATH_INFO: `/v3/projects/2e5221f807a54b3b83990a79b8b8520b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:38.192925 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d75c7-ecfa-475f-8f0a-5db6ebef8689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e5221f807a54b3b83990a79b8b8520b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:38.196813 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d75c7-ecfa-475f-8f0a-5db6ebef8689 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:38.228928 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-def84dd4-511f-4738-af4c-244720e6aa6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d7fb9a96bd542f2978a82cf3960c2f4', 'request_id': 'req-def84dd4-511f-4738-af4c-244720e6aa6f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:38.236785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-def84dd4-511f-4738-af4c-244720e6aa6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d7fb9a96bd542f2978a82cf3960c2f4', 'request_id': 'req-def84dd4-511f-4738-af4c-244720e6aa6f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:38.245276 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-def84dd4-511f-4738-af4c-244720e6aa6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d7fb9a96bd542f2978a82cf3960c2f4', 'request_id': 'req-def84dd4-511f-4738-af4c-244720e6aa6f'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:38.262718 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-def84dd4-511f-4738-af4c-244720e6aa6f admin admin] The token cache is being invalidate because project 8d7fb9a96bd542f2978a82cf3960c2f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:38.263012 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-def84dd4-511f-4738-af4c-244720e6aa6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:38.263688 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-def84dd4-511f-4738-af4c-244720e6aa6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:38.265492 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-269d75c7-ecfa-475f-8f0a-5db6ebef8689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e5221f807a54b3b83990a79b8b8520b', 'request_id': 'req-269d75c7-ecfa-475f-8f0a-5db6ebef8689'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:38.266398 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1417/2828] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:38 2022] DELETE /identity/v3/projects/8d7fb9a96bd542f2978a82cf3960c2f4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:38.269613 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def84dd4-511f-4738-af4c-244720e6aa6f admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:38.271014 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-def84dd4-511f-4738-af4c-244720e6aa6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:38.274193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-269d75c7-ecfa-475f-8f0a-5db6ebef8689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e5221f807a54b3b83990a79b8b8520b', 'request_id': 'req-269d75c7-ecfa-475f-8f0a-5db6ebef8689'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:38.283537 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-269d75c7-ecfa-475f-8f0a-5db6ebef8689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e5221f807a54b3b83990a79b8b8520b', 'request_id': 'req-269d75c7-ecfa-475f-8f0a-5db6ebef8689'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:38.295819 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-269d75c7-ecfa-475f-8f0a-5db6ebef8689 admin admin] The token cache is being invalidate because project 2e5221f807a54b3b83990a79b8b8520b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:38.296111 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-269d75c7-ecfa-475f-8f0a-5db6ebef8689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:38.296852 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-269d75c7-ecfa-475f-8f0a-5db6ebef8689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:38.301376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1412/2829] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:38 2022] DELETE /identity/v3/projects/2e5221f807a54b3b83990a79b8b8520b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:38.302407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d75c7-ecfa-475f-8f0a-5db6ebef8689 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:38.303788 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-269d75c7-ecfa-475f-8f0a-5db6ebef8689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:38.344186 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def84dd4-511f-4738-af4c-244720e6aa6f admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:38.354347 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:38.381667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d75c7-ecfa-475f-8f0a-5db6ebef8689 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:38.386585 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f92a34-308c-483d-9326-19c067537bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:38.387462 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f92a34-308c-483d-9326-19c067537bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:38.387753 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f92a34-308c-483d-9326-19c067537bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:38.388035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f92a34-308c-483d-9326-19c067537bd9 admin admin] PATH_INFO: `/v3/users/443e1c3323ec4ef6960a3d43a7557f01` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:38.389399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f92a34-308c-483d-9326-19c067537bd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=443e1c3323ec4ef6960a3d43a7557f01)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:38.391365 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f92a34-308c-483d-9326-19c067537bd9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:38.403623 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec53e40-991d-4197-9327-7650901acf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:38.404496 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec53e40-991d-4197-9327-7650901acf19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:38.404778 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec53e40-991d-4197-9327-7650901acf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:38.405055 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec53e40-991d-4197-9327-7650901acf19 admin admin] PATH_INFO: `/v3/users/7ba6c02d8d554900bb6e10b40f52a979` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:38.406256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec53e40-991d-4197-9327-7650901acf19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ba6c02d8d554900bb6e10b40f52a979)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:38.408184 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec53e40-991d-4197-9327-7650901acf19 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:38.451472 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-03f92a34-308c-483d-9326-19c067537bd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '443e1c3323ec4ef6960a3d43a7557f01'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:38.453598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:38.458757 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-03f92a34-308c-483d-9326-19c067537bd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '443e1c3323ec4ef6960a3d43a7557f01'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:38.461010 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8ec53e40-991d-4197-9327-7650901acf19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ba6c02d8d554900bb6e10b40f52a979'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:38.471460 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8ec53e40-991d-4197-9327-7650901acf19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ba6c02d8d554900bb6e10b40f52a979'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:38.474593 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-03f92a34-308c-483d-9326-19c067537bd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '443e1c3323ec4ef6960a3d43a7557f01'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:38.481056 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8ec53e40-991d-4197-9327-7650901acf19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ba6c02d8d554900bb6e10b40f52a979'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:38.481696 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8ec53e40-991d-4197-9327-7650901acf19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ba6c02d8d554900bb6e10b40f52a979'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:38.482332 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-8ec53e40-991d-4197-9327-7650901acf19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ba6c02d8d554900bb6e10b40f52a979'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:38.488176 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-03f92a34-308c-483d-9326-19c067537bd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '443e1c3323ec4ef6960a3d43a7557f01'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:38.488818 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-03f92a34-308c-483d-9326-19c067537bd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '443e1c3323ec4ef6960a3d43a7557f01'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:38.496101 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1413/2830] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:38 2022] DELETE /identity/v3/users/443e1c3323ec4ef6960a3d43a7557f01 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:38.502163 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1418/2831] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:38 2022] DELETE /identity/v3/users/7ba6c02d8d554900bb6e10b40f52a979 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:38.803762 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f92a34-308c-483d-9326-19c067537bd9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:38.805888 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-03f92a34-308c-483d-9326-19c067537bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:38.887557 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f92a34-308c-483d-9326-19c067537bd9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:38.918622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec53e40-991d-4197-9327-7650901acf19 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:38.920286 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8ec53e40-991d-4197-9327-7650901acf19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:38.980110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bac30b-5222-4890-8199-496adbd70a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:38.981005 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bac30b-5222-4890-8199-496adbd70a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:38.981294 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bac30b-5222-4890-8199-496adbd70a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:38.981797 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bac30b-5222-4890-8199-496adbd70a0a admin admin] PATH_INFO: `/v3/projects/351126bfcac343c885532328acc2c77e` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:38.983479 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bac30b-5222-4890-8199-496adbd70a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=351126bfcac343c885532328acc2c77e)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:38.985386 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bac30b-5222-4890-8199-496adbd70a0a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:38.993749 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:39.007629 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec53e40-991d-4197-9327-7650901acf19 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:39.013080 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31dd1a-dc9d-4daf-865c-3ba86f1e11b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:39.013957 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31dd1a-dc9d-4daf-865c-3ba86f1e11b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:39.014254 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31dd1a-dc9d-4daf-865c-3ba86f1e11b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:39.014571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31dd1a-dc9d-4daf-865c-3ba86f1e11b0 admin admin] PATH_INFO: `/v3/projects/7baa4b0d6972464ab8a3488be1e00262` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:39.015820 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31dd1a-dc9d-4daf-865c-3ba86f1e11b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7baa4b0d6972464ab8a3488be1e00262)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:39.017920 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31dd1a-dc9d-4daf-865c-3ba86f1e11b0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:39.043500 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c4bac30b-5222-4890-8199-496adbd70a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '351126bfcac343c885532328acc2c77e', 'request_id': 'req-c4bac30b-5222-4890-8199-496adbd70a0a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:39.051059 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c4bac30b-5222-4890-8199-496adbd70a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '351126bfcac343c885532328acc2c77e', 'request_id': 'req-c4bac30b-5222-4890-8199-496adbd70a0a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:39.059848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c4bac30b-5222-4890-8199-496adbd70a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '351126bfcac343c885532328acc2c77e', 'request_id': 'req-c4bac30b-5222-4890-8199-496adbd70a0a'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:39.079073 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c4bac30b-5222-4890-8199-496adbd70a0a admin admin] The token cache is being invalidate because project 351126bfcac343c885532328acc2c77e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:39.079424 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c4bac30b-5222-4890-8199-496adbd70a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:39.080371 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c4bac30b-5222-4890-8199-496adbd70a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:39.082248 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1414/2832] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:38 2022] DELETE /identity/v3/projects/351126bfcac343c885532328acc2c77e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:39.087521 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1d31dd1a-dc9d-4daf-865c-3ba86f1e11b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7baa4b0d6972464ab8a3488be1e00262', 'request_id': 'req-1d31dd1a-dc9d-4daf-865c-3ba86f1e11b0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:39.098577 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1d31dd1a-dc9d-4daf-865c-3ba86f1e11b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7baa4b0d6972464ab8a3488be1e00262', 'request_id': 'req-1d31dd1a-dc9d-4daf-865c-3ba86f1e11b0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:39.108107 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1d31dd1a-dc9d-4daf-865c-3ba86f1e11b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7baa4b0d6972464ab8a3488be1e00262', 'request_id': 'req-1d31dd1a-dc9d-4daf-865c-3ba86f1e11b0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:39.123854 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1d31dd1a-dc9d-4daf-865c-3ba86f1e11b0 admin admin] The token cache is being invalidate because project 7baa4b0d6972464ab8a3488be1e00262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:39.124201 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1d31dd1a-dc9d-4daf-865c-3ba86f1e11b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:39.124834 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-1d31dd1a-dc9d-4daf-865c-3ba86f1e11b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:39.127086 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1419/2833] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:38 2022] DELETE /identity/v3/projects/7baa4b0d6972464ab8a3488be1e00262 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:39.131114 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bac30b-5222-4890-8199-496adbd70a0a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:39.133732 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c4bac30b-5222-4890-8199-496adbd70a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:39.215090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bac30b-5222-4890-8199-496adbd70a0a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:39.303834 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07889835-6b69-433e-aafb-fd5958e371dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:39.304764 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07889835-6b69-433e-aafb-fd5958e371dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:39.305052 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07889835-6b69-433e-aafb-fd5958e371dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:39.305334 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07889835-6b69-433e-aafb-fd5958e371dc admin admin] PATH_INFO: `/v3/users/eab99f4ab91f46879dec7da5ba01ec0b` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:39.306716 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07889835-6b69-433e-aafb-fd5958e371dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=eab99f4ab91f46879dec7da5ba01ec0b)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:39.308730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07889835-6b69-433e-aafb-fd5958e371dc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:39.364777 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:39.368389 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-07889835-6b69-433e-aafb-fd5958e371dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eab99f4ab91f46879dec7da5ba01ec0b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:39.378843 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-07889835-6b69-433e-aafb-fd5958e371dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eab99f4ab91f46879dec7da5ba01ec0b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:39.393924 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-07889835-6b69-433e-aafb-fd5958e371dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eab99f4ab91f46879dec7da5ba01ec0b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:39.402935 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-07889835-6b69-433e-aafb-fd5958e371dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eab99f4ab91f46879dec7da5ba01ec0b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:39.403552 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-07889835-6b69-433e-aafb-fd5958e371dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eab99f4ab91f46879dec7da5ba01ec0b'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:39.409937 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1415/2834] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:39 2022] DELETE /identity/v3/users/eab99f4ab91f46879dec7da5ba01ec0b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:39.684397 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31dd1a-dc9d-4daf-865c-3ba86f1e11b0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:39.685865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1d31dd1a-dc9d-4daf-865c-3ba86f1e11b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:39.699881 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31dd1a-dc9d-4daf-865c-3ba86f1e11b0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:39.747810 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:39.762910 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16c749-7803-46f9-900d-8c39e78c2796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:39.763706 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16c749-7803-46f9-900d-8c39e78c2796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:39.763986 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16c749-7803-46f9-900d-8c39e78c2796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:39.764262 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16c749-7803-46f9-900d-8c39e78c2796 admin admin] PATH_INFO: `/v3/projects/b5f8c68e80244185ace5961fb373cc7a` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:39.765451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16c749-7803-46f9-900d-8c39e78c2796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5f8c68e80244185ace5961fb373cc7a)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:39.767400 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16c749-7803-46f9-900d-8c39e78c2796 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:39.814404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-fe16c749-7803-46f9-900d-8c39e78c2796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f8c68e80244185ace5961fb373cc7a', 'request_id': 'req-fe16c749-7803-46f9-900d-8c39e78c2796'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:39.820502 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-fe16c749-7803-46f9-900d-8c39e78c2796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f8c68e80244185ace5961fb373cc7a', 'request_id': 'req-fe16c749-7803-46f9-900d-8c39e78c2796'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:39.828963 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-fe16c749-7803-46f9-900d-8c39e78c2796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f8c68e80244185ace5961fb373cc7a', 'request_id': 'req-fe16c749-7803-46f9-900d-8c39e78c2796'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:39.847493 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-fe16c749-7803-46f9-900d-8c39e78c2796 admin admin] The token cache is being invalidate because project b5f8c68e80244185ace5961fb373cc7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:39.847846 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-fe16c749-7803-46f9-900d-8c39e78c2796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:39.848573 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-fe16c749-7803-46f9-900d-8c39e78c2796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:39.850410 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1420/2835] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:39 2022] DELETE /identity/v3/projects/b5f8c68e80244185ace5961fb373cc7a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:39.856975 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a8ead-78d2-417b-a1fc-947ddb4d6d5f None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:39.857460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a8ead-78d2-417b-a1fc-947ddb4d6d5f None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:39.857560 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a8ead-78d2-417b-a1fc-947ddb4d6d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:39.879872 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-340a8ead-78d2-417b-a1fc-947ddb4d6d5f None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:39.881117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-340a8ead-78d2-417b-a1fc-947ddb4d6d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:39.947249 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1416/2836] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:40.011100 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7c3c7-99ec-4b65-abad-380e99e556d0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:40.011392 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7c3c7-99ec-4b65-abad-380e99e556d0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:40.011708 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7c3c7-99ec-4b65-abad-380e99e556d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:40.030384 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-07e7c3c7-99ec-4b65-abad-380e99e556d0 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:40.031576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-07e7c3c7-99ec-4b65-abad-380e99e556d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:40.040541 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1421/2837] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:40.045053 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a8ead-78d2-417b-a1fc-947ddb4d6d5f None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:40.056667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a8ead-78d2-417b-a1fc-947ddb4d6d5f None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:40.061413 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e994a5e-543c-42c4-9416-1f6d70c1f8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:40.062069 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e994a5e-543c-42c4-9416-1f6d70c1f8fc admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:40.062384 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e994a5e-543c-42c4-9416-1f6d70c1f8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:40.062673 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e994a5e-543c-42c4-9416-1f6d70c1f8fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:40.063407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e994a5e-543c-42c4-9416-1f6d70c1f8fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:37:40.063717 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e994a5e-543c-42c4-9416-1f6d70c1f8fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:40.065351 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e994a5e-543c-42c4-9416-1f6d70c1f8fc admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:40.077899 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1417/2838] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 19:37:40.082491 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7c3c7-99ec-4b65-abad-380e99e556d0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:40.091850 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7c3c7-99ec-4b65-abad-380e99e556d0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:40.096860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1898f1c-001c-4ebe-8a51-361ff255a9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:40.097512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1898f1c-001c-4ebe-8a51-361ff255a9fe admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:40.097801 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1898f1c-001c-4ebe-8a51-361ff255a9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:40.098082 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1898f1c-001c-4ebe-8a51-361ff255a9fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:40.098886 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1898f1c-001c-4ebe-8a51-361ff255a9fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:40.100841 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1898f1c-001c-4ebe-8a51-361ff255a9fe admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:40.127966 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1422/2839] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:40 2022] POST /identity/v3/projects => generated 401 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:40.132738 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e994a5e-543c-42c4-9416-1f6d70c1f8fc admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:40.145075 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e994a5e-543c-42c4-9416-1f6d70c1f8fc admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:40.163113 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1898f1c-001c-4ebe-8a51-361ff255a9fe admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:40.165448 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-a1898f1c-001c-4ebe-8a51-361ff255a9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:40.207165 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8c306-df69-4981-8d2c-0f65a796b5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:40.207839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8c306-df69-4981-8d2c-0f65a796b5a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:40.208130 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8c306-df69-4981-8d2c-0f65a796b5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:40.208406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8c306-df69-4981-8d2c-0f65a796b5a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:40.209102 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8c306-df69-4981-8d2c-0f65a796b5a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:40.212006 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8c306-df69-4981-8d2c-0f65a796b5a5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:40.237412 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1418/2840] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:40 2022] POST /identity/v3/users => generated 301 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:40.237679 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1898f1c-001c-4ebe-8a51-361ff255a9fe admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:40.238577 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8c306-df69-4981-8d2c-0f65a796b5a5 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:40.240166 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66567641-9cba-4729-9977-5ee3ffe62095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:40.241049 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66567641-9cba-4729-9977-5ee3ffe62095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:40.241329 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66567641-9cba-4729-9977-5ee3ffe62095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:40.241605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66567641-9cba-4729-9977-5ee3ffe62095 admin admin] PATH_INFO: `/v3/users/259c06e0c6d14e44b9fff5254087e2b5` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:40.242892 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66567641-9cba-4729-9977-5ee3ffe62095 admin admin] RBAC: Authorizing `identity:delete_user(user_id=259c06e0c6d14e44b9fff5254087e2b5)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:40.244825 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66567641-9cba-4729-9977-5ee3ffe62095 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:40.249708 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8c306-df69-4981-8d2c-0f65a796b5a5 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:40.255479 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52561b63-434e-4484-a7cd-8013405d4726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:40.256144 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52561b63-434e-4484-a7cd-8013405d4726 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:40.256421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52561b63-434e-4484-a7cd-8013405d4726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:40.256693 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52561b63-434e-4484-a7cd-8013405d4726 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:40.257414 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52561b63-434e-4484-a7cd-8013405d4726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:40.259265 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52561b63-434e-4484-a7cd-8013405d4726 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:40.270798 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1419/2841] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:40.276066 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52561b63-434e-4484-a7cd-8013405d4726 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:40.290854 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52561b63-434e-4484-a7cd-8013405d4726 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:40.296404 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2567e-45e5-4a6b-a8f8-9a4315962ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:40.297075 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2567e-45e5-4a6b-a8f8-9a4315962ebb admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:40.297486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2567e-45e5-4a6b-a8f8-9a4315962ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:40.297766 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2567e-45e5-4a6b-a8f8-9a4315962ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:40.298532 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2567e-45e5-4a6b-a8f8-9a4315962ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:40.300110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2567e-45e5-4a6b-a8f8-9a4315962ebb admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:40.303237 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-66567641-9cba-4729-9977-5ee3ffe62095 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '259c06e0c6d14e44b9fff5254087e2b5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:40.305262 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:40.311747 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1420/2842] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 19:37:40.313174 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-66567641-9cba-4729-9977-5ee3ffe62095 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '259c06e0c6d14e44b9fff5254087e2b5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:40.315806 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2567e-45e5-4a6b-a8f8-9a4315962ebb admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:40.321713 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-66567641-9cba-4729-9977-5ee3ffe62095 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '259c06e0c6d14e44b9fff5254087e2b5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:40.322571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-66567641-9cba-4729-9977-5ee3ffe62095 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '259c06e0c6d14e44b9fff5254087e2b5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:40.323232 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-66567641-9cba-4729-9977-5ee3ffe62095 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '259c06e0c6d14e44b9fff5254087e2b5'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:40.326734 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2567e-45e5-4a6b-a8f8-9a4315962ebb admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:40.331460 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc6e19-199d-4144-8832-3a4f394de9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:40.332335 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc6e19-199d-4144-8832-3a4f394de9cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:40.332610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc6e19-199d-4144-8832-3a4f394de9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:40.332883 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc6e19-199d-4144-8832-3a4f394de9cd admin admin] PATH_INFO: `/v3/projects/fde4e4771f984515ac5c5e5a70fd8ad2/users/e3a9107a349c4f7fae0e848c43782b1a/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:40.342037 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1423/2843] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:40 2022] DELETE /identity/v3/users/259c06e0c6d14e44b9fff5254087e2b5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:40.346090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:40.346587 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a572e-8dcc-4c23-b742-04e78e41c3b0 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:40.346911 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a572e-8dcc-4c23-b742-04e78e41c3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:40.347198 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a572e-8dcc-4c23-b742-04e78e41c3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:40.349953 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc6e19-199d-4144-8832-3a4f394de9cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde4e4771f984515ac5c5e5a70fd8ad2, user_id=e3a9107a349c4f7fae0e848c43782b1a, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:40.353626 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc6e19-199d-4144-8832-3a4f394de9cd admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:40.368069 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-de5a572e-8dcc-4c23-b742-04e78e41c3b0 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:40.369308 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-de5a572e-8dcc-4c23-b742-04e78e41c3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:40.370214 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1421/2844] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:40 2022] PUT /identity/v3/projects/fde4e4771f984515ac5c5e5a70fd8ad2/users/e3a9107a349c4f7fae0e848c43782b1a/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:40.381759 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ce6e3-15aa-48b1-88ad-9c07598f3bf5 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:40.382054 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ce6e3-15aa-48b1-88ad-9c07598f3bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:40.382366 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ce6e3-15aa-48b1-88ad-9c07598f3bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:40.412234 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-c42ce6e3-15aa-48b1-88ad-9c07598f3bf5 None None] MFA Rules not processed for user `e3a9107a349c4f7fae0e848c43782b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:40.413530 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c42ce6e3-15aa-48b1-88ad-9c07598f3bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:40.489620 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1422/2845] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:40.494397 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ce6e3-15aa-48b1-88ad-9c07598f3bf5 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:40.495804 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-c42ce6e3-15aa-48b1-88ad-9c07598f3bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:40.562783 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1424/2846] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:37:40.571038 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ce6e3-15aa-48b1-88ad-9c07598f3bf5 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:40.573021 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a572e-8dcc-4c23-b742-04e78e41c3b0 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:40.574572 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-de5a572e-8dcc-4c23-b742-04e78e41c3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:40.576097 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae438c-2d31-48ab-b8e4-9482d0b61131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:40.581838 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae438c-2d31-48ab-b8e4-9482d0b61131 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:40.581838 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae438c-2d31-48ab-b8e4-9482d0b61131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:40.581838 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae438c-2d31-48ab-b8e4-9482d0b61131 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:40.581838 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae438c-2d31-48ab-b8e4-9482d0b61131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:40.581838 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae438c-2d31-48ab-b8e4-9482d0b61131 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:40.609531 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1423/2847] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:40 2022] POST /identity/v3/projects => generated 399 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:37:40.613539 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae438c-2d31-48ab-b8e4-9482d0b61131 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:40.652634 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a572e-8dcc-4c23-b742-04e78e41c3b0 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:40.696834 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae438c-2d31-48ab-b8e4-9482d0b61131 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:40.701669 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0529cfb-884c-4871-a7c2-e53296616683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:40.702360 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0529cfb-884c-4871-a7c2-e53296616683 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:40.702648 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0529cfb-884c-4871-a7c2-e53296616683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:40.702926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0529cfb-884c-4871-a7c2-e53296616683 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:40.703079 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577fc99-ec2a-4e74-9782-e05173bbba3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:40.703661 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577fc99-ec2a-4e74-9782-e05173bbba3a service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:40.703795 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0529cfb-884c-4871-a7c2-e53296616683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:40.703969 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577fc99-ec2a-4e74-9782-e05173bbba3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:40.704244 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577fc99-ec2a-4e74-9782-e05173bbba3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:40.705688 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0529cfb-884c-4871-a7c2-e53296616683 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:40.714621 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577fc99-ec2a-4e74-9782-e05173bbba3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:40.716141 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577fc99-ec2a-4e74-9782-e05173bbba3a service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:40.716418 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:40.727768 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1425/2848] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:37:40.733723 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1424/2849] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:40 2022] POST /identity/v3/users => generated 306 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:37:40.737792 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577fc99-ec2a-4e74-9782-e05173bbba3a service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:40.747528 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577fc99-ec2a-4e74-9782-e05173bbba3a service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:40.752666 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcffff-62fd-4bdd-a219-70d491182061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:40.753432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcffff-62fd-4bdd-a219-70d491182061 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:40.753771 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcffff-62fd-4bdd-a219-70d491182061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:40.754113 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bcffff-62fd-4bdd-a219-70d491182061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:40.754957 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcffff-62fd-4bdd-a219-70d491182061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:40.756614 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bcffff-62fd-4bdd-a219-70d491182061 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:40.768500 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1426/2850] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:40.772848 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0529cfb-884c-4871-a7c2-e53296616683 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:40.784629 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0529cfb-884c-4871-a7c2-e53296616683 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:40.790117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7bf52f-484d-4add-a451-f472684c3304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:40.791051 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bf52f-484d-4add-a451-f472684c3304 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:40.791340 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bf52f-484d-4add-a451-f472684c3304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:40.791630 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bf52f-484d-4add-a451-f472684c3304 admin admin] PATH_INFO: `/v3/projects/c6179eed696244d6b6d4d36ce7fcec59/users/de5a6a9b77b248caabf6301e9714b62d/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:40.808260 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7bf52f-484d-4add-a451-f472684c3304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6179eed696244d6b6d4d36ce7fcec59, user_id=de5a6a9b77b248caabf6301e9714b62d, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:40.810957 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7bf52f-484d-4add-a451-f472684c3304 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:40.827932 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1425/2851] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:40 2022] PUT /identity/v3/projects/c6179eed696244d6b6d4d36ce7fcec59/users/de5a6a9b77b248caabf6301e9714b62d/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:40.829234 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcffff-62fd-4bdd-a219-70d491182061 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:40.840803 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bcffff-62fd-4bdd-a219-70d491182061 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:40.853945 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:40.916864 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad758ff-5fb2-4d69-98ea-3eea637cc882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:40.917638 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad758ff-5fb2-4d69-98ea-3eea637cc882 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:40.917955 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad758ff-5fb2-4d69-98ea-3eea637cc882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:40.918328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad758ff-5fb2-4d69-98ea-3eea637cc882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:40.919110 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad758ff-5fb2-4d69-98ea-3eea637cc882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:40.920718 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad758ff-5fb2-4d69-98ea-3eea637cc882 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:40.931717 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1427/2852] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:40.936451 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7bf52f-484d-4add-a451-f472684c3304 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:40.948994 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7bf52f-484d-4add-a451-f472684c3304 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:40.954090 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c60d97-070d-41e4-b95f-bcbc622d30f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:40.955097 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c60d97-070d-41e4-b95f-bcbc622d30f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:40.955478 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c60d97-070d-41e4-b95f-bcbc622d30f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:40.955829 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c60d97-070d-41e4-b95f-bcbc622d30f9 admin admin] PATH_INFO: `/v3/projects/c6179eed696244d6b6d4d36ce7fcec59/users/de5a6a9b77b248caabf6301e9714b62d/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:40.958110 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c60d97-070d-41e4-b95f-bcbc622d30f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6179eed696244d6b6d4d36ce7fcec59, user_id=de5a6a9b77b248caabf6301e9714b62d, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:40.960946 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c60d97-070d-41e4-b95f-bcbc622d30f9 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:40.975973 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1426/2853] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:40 2022] PUT /identity/v3/projects/c6179eed696244d6b6d4d36ce7fcec59/users/de5a6a9b77b248caabf6301e9714b62d/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:40.986494 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249eb541-47db-4ba6-bde0-523f9489c43e None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:40.986811 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249eb541-47db-4ba6-bde0-523f9489c43e None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:40.987109 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249eb541-47db-4ba6-bde0-523f9489c43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:41.023795 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-249eb541-47db-4ba6-bde0-523f9489c43e None None] MFA Rules not processed for user `de5a6a9b77b248caabf6301e9714b62d`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:41.025959 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-249eb541-47db-4ba6-bde0-523f9489c43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:41.041407 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c60d97-070d-41e4-b95f-bcbc622d30f9 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:41.043466 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e6c60d97-070d-41e4-b95f-bcbc622d30f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:41.124762 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c60d97-070d-41e4-b95f-bcbc622d30f9 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:41.128141 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1428/2854] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:40 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:41.129631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd431a93-1c07-4678-a2d8-d9481207efa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:41.130586 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd431a93-1c07-4678-a2d8-d9481207efa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:41.130834 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd431a93-1c07-4678-a2d8-d9481207efa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:41.131124 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd431a93-1c07-4678-a2d8-d9481207efa3 admin admin] PATH_INFO: `/v3/projects/278a1fcb95c946ac91de7115474ff4c3` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:41.132631 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd431a93-1c07-4678-a2d8-d9481207efa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=278a1fcb95c946ac91de7115474ff4c3)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:41.135289 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd431a93-1c07-4678-a2d8-d9481207efa3 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:41.140423 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249eb541-47db-4ba6-bde0-523f9489c43e None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:41.142112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-249eb541-47db-4ba6-bde0-523f9489c43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:41.189104 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cd431a93-1c07-4678-a2d8-d9481207efa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '278a1fcb95c946ac91de7115474ff4c3', 'request_id': 'req-cd431a93-1c07-4678-a2d8-d9481207efa3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:41.196845 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cd431a93-1c07-4678-a2d8-d9481207efa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '278a1fcb95c946ac91de7115474ff4c3', 'request_id': 'req-cd431a93-1c07-4678-a2d8-d9481207efa3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:41.206232 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249eb541-47db-4ba6-bde0-523f9489c43e None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:41.206502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cd431a93-1c07-4678-a2d8-d9481207efa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '278a1fcb95c946ac91de7115474ff4c3', 'request_id': 'req-cd431a93-1c07-4678-a2d8-d9481207efa3'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:41.217822 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cd431a93-1c07-4678-a2d8-d9481207efa3 admin admin] The token cache is being invalidate because project 278a1fcb95c946ac91de7115474ff4c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:41.218240 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cd431a93-1c07-4678-a2d8-d9481207efa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:41.218941 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-cd431a93-1c07-4678-a2d8-d9481207efa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:41.220539 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1427/2855] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:41 2022] DELETE /identity/v3/projects/278a1fcb95c946ac91de7115474ff4c3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:41.264893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdea15-5ac5-4159-b070-0db9aaf45145 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:41.265607 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdea15-5ac5-4159-b070-0db9aaf45145 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:41.266059 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdea15-5ac5-4159-b070-0db9aaf45145 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:41.266364 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdea15-5ac5-4159-b070-0db9aaf45145 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:41.268350 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e7fdea15-5ac5-4159-b070-0db9aaf45145 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:41.276395 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=100 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:41.359363 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fdea15-5ac5-4159-b070-0db9aaf45145 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:41.361156 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fdea15-5ac5-4159-b070-0db9aaf45145 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:41.373001 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1429/2856] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:41 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 19:37:41.457709 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd431a93-1c07-4678-a2d8-d9481207efa3 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:41.457976 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-cd431a93-1c07-4678-a2d8-d9481207efa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:41.471050 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd431a93-1c07-4678-a2d8-d9481207efa3 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:41.474731 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9241c-540d-4f31-88f2-38e14367b060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:41.475399 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9241c-540d-4f31-88f2-38e14367b060 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:41.475684 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9241c-540d-4f31-88f2-38e14367b060 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:41.475962 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9241c-540d-4f31-88f2-38e14367b060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:41.478583 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-09e9241c-540d-4f31-88f2-38e14367b060 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:41.525244 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:41.541696 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9241c-540d-4f31-88f2-38e14367b060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:41.543171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9241c-540d-4f31-88f2-38e14367b060 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:41.552743 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1428/2857] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:41 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:45.631732 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdea15-5ac5-4159-b070-0db9aaf45145 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:45.633185 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e7fdea15-5ac5-4159-b070-0db9aaf45145 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:45.698581 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdea15-5ac5-4159-b070-0db9aaf45145 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:45.704070 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332a497-c166-4396-90aa-cb5e6bccc8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:45.704852 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332a497-c166-4396-90aa-cb5e6bccc8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:45.705154 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332a497-c166-4396-90aa-cb5e6bccc8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:45.705425 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332a497-c166-4396-90aa-cb5e6bccc8ec admin admin] PATH_INFO: `/v3/users/e3a9107a349c4f7fae0e848c43782b1a` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:45.706688 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332a497-c166-4396-90aa-cb5e6bccc8ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a9107a349c4f7fae0e848c43782b1a)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:45.708584 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332a497-c166-4396-90aa-cb5e6bccc8ec admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:45.755390 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3332a497-c166-4396-90aa-cb5e6bccc8ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a9107a349c4f7fae0e848c43782b1a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:45.762186 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3332a497-c166-4396-90aa-cb5e6bccc8ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a9107a349c4f7fae0e848c43782b1a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:45.769992 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3332a497-c166-4396-90aa-cb5e6bccc8ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a9107a349c4f7fae0e848c43782b1a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:45.770769 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3332a497-c166-4396-90aa-cb5e6bccc8ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a9107a349c4f7fae0e848c43782b1a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:45.771407 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-3332a497-c166-4396-90aa-cb5e6bccc8ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a9107a349c4f7fae0e848c43782b1a'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:45.790494 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1430/2858] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:45 2022] DELETE /identity/v3/users/e3a9107a349c4f7fae0e848c43782b1a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:45.795153 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696d19c-5da6-495f-9ca8-eb8abb8d0672 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:45.795634 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696d19c-5da6-495f-9ca8-eb8abb8d0672 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:45.795770 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696d19c-5da6-495f-9ca8-eb8abb8d0672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:45.813063 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-1696d19c-5da6-495f-9ca8-eb8abb8d0672 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:45.814256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1696d19c-5da6-495f-9ca8-eb8abb8d0672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:45.875844 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1429/2859] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:37:45.889451 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332a497-c166-4396-90aa-cb5e6bccc8ec admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:45.891248 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-3332a497-c166-4396-90aa-cb5e6bccc8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:45.920653 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:45.953705 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332a497-c166-4396-90aa-cb5e6bccc8ec admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:45.957691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca3cfa-d8f4-4000-b0f1-7daaf9df72b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:45.958699 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca3cfa-d8f4-4000-b0f1-7daaf9df72b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:45.959172 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca3cfa-d8f4-4000-b0f1-7daaf9df72b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:45.959630 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca3cfa-d8f4-4000-b0f1-7daaf9df72b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:45.972174 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca3cfa-d8f4-4000-b0f1-7daaf9df72b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:45.973599 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca3cfa-d8f4-4000-b0f1-7daaf9df72b5 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:45.982927 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1431/2860] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:46.256473 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696d19c-5da6-495f-9ca8-eb8abb8d0672 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:46.258654 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-1696d19c-5da6-495f-9ca8-eb8abb8d0672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:46.270737 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696d19c-5da6-495f-9ca8-eb8abb8d0672 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:46.275376 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4cb6c-fad9-4f87-907d-04f66367bb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:46.276398 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4cb6c-fad9-4f87-907d-04f66367bb1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:46.276655 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4cb6c-fad9-4f87-907d-04f66367bb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:46.277046 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4cb6c-fad9-4f87-907d-04f66367bb1c admin admin] PATH_INFO: `/v3/projects/fde4e4771f984515ac5c5e5a70fd8ad2` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:46.278355 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4cb6c-fad9-4f87-907d-04f66367bb1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fde4e4771f984515ac5c5e5a70fd8ad2)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:46.280667 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4cb6c-fad9-4f87-907d-04f66367bb1c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:46.333866 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a5c4cb6c-fad9-4f87-907d-04f66367bb1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fde4e4771f984515ac5c5e5a70fd8ad2', 'request_id': 'req-a5c4cb6c-fad9-4f87-907d-04f66367bb1c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:46.340239 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a5c4cb6c-fad9-4f87-907d-04f66367bb1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fde4e4771f984515ac5c5e5a70fd8ad2', 'request_id': 'req-a5c4cb6c-fad9-4f87-907d-04f66367bb1c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:46.347934 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a5c4cb6c-fad9-4f87-907d-04f66367bb1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fde4e4771f984515ac5c5e5a70fd8ad2', 'request_id': 'req-a5c4cb6c-fad9-4f87-907d-04f66367bb1c'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:46.358280 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a5c4cb6c-fad9-4f87-907d-04f66367bb1c admin admin] The token cache is being invalidate because project fde4e4771f984515ac5c5e5a70fd8ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:46.358617 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a5c4cb6c-fad9-4f87-907d-04f66367bb1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:46.359237 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-a5c4cb6c-fad9-4f87-907d-04f66367bb1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:46.360793 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1430/2861] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:46 2022] DELETE /identity/v3/projects/fde4e4771f984515ac5c5e5a70fd8ad2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:46.364836 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca3cfa-d8f4-4000-b0f1-7daaf9df72b5 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:46.375267 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca3cfa-d8f4-4000-b0f1-7daaf9df72b5 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:46.431160 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275bf97-55d7-4355-8227-14c98f242813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:46.432029 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275bf97-55d7-4355-8227-14c98f242813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:46.432316 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275bf97-55d7-4355-8227-14c98f242813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:46.432591 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275bf97-55d7-4355-8227-14c98f242813 admin admin] PATH_INFO: `/v3/users/de5a6a9b77b248caabf6301e9714b62d` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:46.433778 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275bf97-55d7-4355-8227-14c98f242813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de5a6a9b77b248caabf6301e9714b62d)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:46.435744 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275bf97-55d7-4355-8227-14c98f242813 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:46.482673 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2275bf97-55d7-4355-8227-14c98f242813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de5a6a9b77b248caabf6301e9714b62d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:46.489580 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2275bf97-55d7-4355-8227-14c98f242813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de5a6a9b77b248caabf6301e9714b62d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:46.497875 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2275bf97-55d7-4355-8227-14c98f242813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de5a6a9b77b248caabf6301e9714b62d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:46.498539 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2275bf97-55d7-4355-8227-14c98f242813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de5a6a9b77b248caabf6301e9714b62d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:46.499186 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-2275bf97-55d7-4355-8227-14c98f242813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de5a6a9b77b248caabf6301e9714b62d'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:46.518774 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1432/2862] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:46 2022] DELETE /identity/v3/users/de5a6a9b77b248caabf6301e9714b62d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:46.833198 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4cb6c-fad9-4f87-907d-04f66367bb1c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:46.834817 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-a5c4cb6c-fad9-4f87-907d-04f66367bb1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:46.848306 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4cb6c-fad9-4f87-907d-04f66367bb1c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:46.909491 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf54409-a2e6-4ed5-97dd-60527e4c08c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:46.910410 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf54409-a2e6-4ed5-97dd-60527e4c08c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:46.910684 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf54409-a2e6-4ed5-97dd-60527e4c08c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:46.910964 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf54409-a2e6-4ed5-97dd-60527e4c08c7 admin admin] PATH_INFO: `/v3/projects/c6179eed696244d6b6d4d36ce7fcec59` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:46.912398 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf54409-a2e6-4ed5-97dd-60527e4c08c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6179eed696244d6b6d4d36ce7fcec59)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:46.915033 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf54409-a2e6-4ed5-97dd-60527e4c08c7 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:46.926345 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:46.962596 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3bf54409-a2e6-4ed5-97dd-60527e4c08c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6179eed696244d6b6d4d36ce7fcec59', 'request_id': 'req-3bf54409-a2e6-4ed5-97dd-60527e4c08c7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:46.968596 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3bf54409-a2e6-4ed5-97dd-60527e4c08c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6179eed696244d6b6d4d36ce7fcec59', 'request_id': 'req-3bf54409-a2e6-4ed5-97dd-60527e4c08c7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:46.976112 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3bf54409-a2e6-4ed5-97dd-60527e4c08c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6179eed696244d6b6d4d36ce7fcec59', 'request_id': 'req-3bf54409-a2e6-4ed5-97dd-60527e4c08c7'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:46.990886 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3bf54409-a2e6-4ed5-97dd-60527e4c08c7 admin admin] The token cache is being invalidate because project c6179eed696244d6b6d4d36ce7fcec59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:46.991181 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3bf54409-a2e6-4ed5-97dd-60527e4c08c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:46.991846 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3bf54409-a2e6-4ed5-97dd-60527e4c08c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:46.993444 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1431/2863] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:46 2022] DELETE /identity/v3/projects/c6179eed696244d6b6d4d36ce7fcec59 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 19:37:46.999477 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c452bb4-23ce-424a-82df-3031b5e0f036 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:47.000008 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c452bb4-23ce-424a-82df-3031b5e0f036 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:47.000138 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c452bb4-23ce-424a-82df-3031b5e0f036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:47.020020 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-1c452bb4-23ce-424a-82df-3031b5e0f036 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:47.021240 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-1c452bb4-23ce-424a-82df-3031b5e0f036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:47.062700 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:47.082574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1433/2864] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:47.090745 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39537ef-7894-45e5-a999-f3fa13c11424 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:47.091035 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39537ef-7894-45e5-a999-f3fa13c11424 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:47.091314 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39537ef-7894-45e5-a999-f3fa13c11424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:47.110709 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-e39537ef-7894-45e5-a999-f3fa13c11424 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:47.111926 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-e39537ef-7894-45e5-a999-f3fa13c11424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:47.119978 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1432/2865] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:47.124208 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c452bb4-23ce-424a-82df-3031b5e0f036 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:47.133909 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c452bb4-23ce-424a-82df-3031b5e0f036 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:47.138584 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603997c-094d-495f-b439-cab016f10980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:47.139241 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603997c-094d-495f-b439-cab016f10980 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:47.139527 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603997c-094d-495f-b439-cab016f10980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:47.139804 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603997c-094d-495f-b439-cab016f10980 admin admin] PATH_INFO: `/v3/domains` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:47.140540 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603997c-094d-495f-b439-cab016f10980 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80233) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:37:47.140847 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603997c-094d-495f-b439-cab016f10980 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:47.142485 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e603997c-094d-495f-b439-cab016f10980 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:47.154444 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1434/2866] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:37:47.159049 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39537ef-7894-45e5-a999-f3fa13c11424 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:47.169421 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39537ef-7894-45e5-a999-f3fa13c11424 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:47.176079 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb9fbd-d62a-4310-a0f6-d8673616f558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:47.176920 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb9fbd-d62a-4310-a0f6-d8673616f558 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:47.177207 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb9fbd-d62a-4310-a0f6-d8673616f558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:47.177483 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb9fbd-d62a-4310-a0f6-d8673616f558 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:47.178189 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb9fbd-d62a-4310-a0f6-d8673616f558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:47.180149 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb9fbd-d62a-4310-a0f6-d8673616f558 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:47.208797 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1433/2867] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:47 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:47.210145 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603997c-094d-495f-b439-cab016f10980 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:47.220797 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603997c-094d-495f-b439-cab016f10980 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:47.283027 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbb26e-31cf-440a-88f8-8ce4975669a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:47.283872 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbb26e-31cf-440a-88f8-8ce4975669a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:47.284220 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbb26e-31cf-440a-88f8-8ce4975669a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:47.284553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbb26e-31cf-440a-88f8-8ce4975669a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:47.285264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbb26e-31cf-440a-88f8-8ce4975669a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:47.287555 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbb26e-31cf-440a-88f8-8ce4975669a0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:47.310136 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1435/2868] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:47 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:47.314331 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb9fbd-d62a-4310-a0f6-d8673616f558 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:47.325492 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb9fbd-d62a-4310-a0f6-d8673616f558 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:47.332176 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41d3d1-2f9c-4965-80e3-997448c9da56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:47.332915 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41d3d1-2f9c-4965-80e3-997448c9da56 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:47.333118 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41d3d1-2f9c-4965-80e3-997448c9da56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:47.333397 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41d3d1-2f9c-4965-80e3-997448c9da56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:47.334129 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41d3d1-2f9c-4965-80e3-997448c9da56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:47.335855 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41d3d1-2f9c-4965-80e3-997448c9da56 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:47.346596 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1434/2869] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:47.350672 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbb26e-31cf-440a-88f8-8ce4975669a0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:47.361231 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbb26e-31cf-440a-88f8-8ce4975669a0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:47.365849 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35123597-461b-4408-92b9-1b375dda5099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:47.366544 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35123597-461b-4408-92b9-1b375dda5099 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:47.366832 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35123597-461b-4408-92b9-1b375dda5099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:47.367664 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35123597-461b-4408-92b9-1b375dda5099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:47.368388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35123597-461b-4408-92b9-1b375dda5099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:47.370018 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35123597-461b-4408-92b9-1b375dda5099 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:47.380948 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1436/2870] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:47.385071 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41d3d1-2f9c-4965-80e3-997448c9da56 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:47.395201 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41d3d1-2f9c-4965-80e3-997448c9da56 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:47.400121 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98107e6-e037-40c2-9a8e-86b9af188853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:47.401156 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98107e6-e037-40c2-9a8e-86b9af188853 admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:47.401283 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98107e6-e037-40c2-9a8e-86b9af188853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:47.401549 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98107e6-e037-40c2-9a8e-86b9af188853 admin admin] PATH_INFO: `/v3/projects/1b94c0e8b21e453dba5bc3813a5de171/users/5e49369af5cb4239ae354f5cdfd8e712/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:47.417143 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98107e6-e037-40c2-9a8e-86b9af188853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b94c0e8b21e453dba5bc3813a5de171, user_id=5e49369af5cb4239ae354f5cdfd8e712, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:47.420039 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98107e6-e037-40c2-9a8e-86b9af188853 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:47.433487 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1435/2871] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:47 2022] PUT /identity/v3/projects/1b94c0e8b21e453dba5bc3813a5de171/users/5e49369af5cb4239ae354f5cdfd8e712/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:47.443783 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac5727-e407-4fc2-b9ef-d06fa3d6f1e8 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:47.444104 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac5727-e407-4fc2-b9ef-d06fa3d6f1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:47.444388 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac5727-e407-4fc2-b9ef-d06fa3d6f1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:47.471681 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8cac5727-e407-4fc2-b9ef-d06fa3d6f1e8 None None] MFA Rules not processed for user `5e49369af5cb4239ae354f5cdfd8e712`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:47.472916 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8cac5727-e407-4fc2-b9ef-d06fa3d6f1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:47.536237 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1437/2872] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 19:37:47.541595 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98107e6-e037-40c2-9a8e-86b9af188853 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:47.605406 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98107e6-e037-40c2-9a8e-86b9af188853 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:47.610831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415b407-14cd-40a1-8182-7ef50fac842a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:47.611481 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415b407-14cd-40a1-8182-7ef50fac842a admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:47.611761 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415b407-14cd-40a1-8182-7ef50fac842a admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:47.612036 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415b407-14cd-40a1-8182-7ef50fac842a admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:47.612729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415b407-14cd-40a1-8182-7ef50fac842a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:47.614646 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415b407-14cd-40a1-8182-7ef50fac842a admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:47.641866 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1436/2873] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:47 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:37:47.647133 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac5727-e407-4fc2-b9ef-d06fa3d6f1e8 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:47.658763 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac5727-e407-4fc2-b9ef-d06fa3d6f1e8 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:47.698513 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:47.719318 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded21d5-7864-4b9e-81a2-08ad5e49a601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:47.720002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded21d5-7864-4b9e-81a2-08ad5e49a601 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:47.720285 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded21d5-7864-4b9e-81a2-08ad5e49a601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:47.720562 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded21d5-7864-4b9e-81a2-08ad5e49a601 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:47.721264 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded21d5-7864-4b9e-81a2-08ad5e49a601 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:47.723269 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded21d5-7864-4b9e-81a2-08ad5e49a601 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:47.744867 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1438/2874] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:47 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:47.749013 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415b407-14cd-40a1-8182-7ef50fac842a admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:47.760063 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415b407-14cd-40a1-8182-7ef50fac842a admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:47.764677 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d608e-3861-411b-88e3-e7316f356af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:47.765448 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d608e-3861-411b-88e3-e7316f356af0 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:47.765733 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d608e-3861-411b-88e3-e7316f356af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:47.766007 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d608e-3861-411b-88e3-e7316f356af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:47.766765 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d608e-3861-411b-88e3-e7316f356af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:47.768348 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d608e-3861-411b-88e3-e7316f356af0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:47.779611 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1437/2875] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:47.783894 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded21d5-7864-4b9e-81a2-08ad5e49a601 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:47.795114 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded21d5-7864-4b9e-81a2-08ad5e49a601 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:47.800649 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd55ec5-eca0-4142-a0b6-b6b170a085b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:47.801329 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd55ec5-eca0-4142-a0b6-b6b170a085b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:47.801615 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd55ec5-eca0-4142-a0b6-b6b170a085b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:47.801895 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd55ec5-eca0-4142-a0b6-b6b170a085b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:47.802669 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd55ec5-eca0-4142-a0b6-b6b170a085b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:47.804277 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd55ec5-eca0-4142-a0b6-b6b170a085b0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:47.815568 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1439/2876] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:47.820021 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d608e-3861-411b-88e3-e7316f356af0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:47.835401 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d608e-3861-411b-88e3-e7316f356af0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:47.842837 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49238c1a-62e7-49d6-a3d9-26ad6560113c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:47.844373 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49238c1a-62e7-49d6-a3d9-26ad6560113c admin admin] REQUEST_METHOD: `PUT` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:47.844880 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49238c1a-62e7-49d6-a3d9-26ad6560113c admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:47.845363 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49238c1a-62e7-49d6-a3d9-26ad6560113c admin admin] PATH_INFO: `/v3/projects/78b01bcc96ae46df9c9919f0f2c73473/users/8e3555675f7f45fba26189976b00cbbc/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:47.855869 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:47.864711 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49238c1a-62e7-49d6-a3d9-26ad6560113c admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b01bcc96ae46df9c9919f0f2c73473, user_id=8e3555675f7f45fba26189976b00cbbc, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:47.867817 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49238c1a-62e7-49d6-a3d9-26ad6560113c admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:47.881156 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1438/2877] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:47 2022] PUT /identity/v3/projects/78b01bcc96ae46df9c9919f0f2c73473/users/8e3555675f7f45fba26189976b00cbbc/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:47.892662 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a1853-2b99-4755-8b70-485364d21f99 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:47.892946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a1853-2b99-4755-8b70-485364d21f99 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:47.893226 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a1853-2b99-4755-8b70-485364d21f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:47.922756 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-d83a1853-2b99-4755-8b70-485364d21f99 None None] MFA Rules not processed for user `8e3555675f7f45fba26189976b00cbbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:47.923986 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-d83a1853-2b99-4755-8b70-485364d21f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:47.991005 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1440/2878] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:47.996140 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49238c1a-62e7-49d6-a3d9-26ad6560113c admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:48.061502 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49238c1a-62e7-49d6-a3d9-26ad6560113c admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:48.066486 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0ca14-d60c-4bb1-97b4-d5c13fe138d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:48.067154 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0ca14-d60c-4bb1-97b4-d5c13fe138d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:48.067439 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0ca14-d60c-4bb1-97b4-d5c13fe138d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:48.067721 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0ca14-d60c-4bb1-97b4-d5c13fe138d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:48.068419 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0ca14-d60c-4bb1-97b4-d5c13fe138d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:48.070898 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0ca14-d60c-4bb1-97b4-d5c13fe138d0 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:48.099377 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1439/2879] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:47 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:48.104743 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a1853-2b99-4755-8b70-485364d21f99 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:48.120374 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a1853-2b99-4755-8b70-485364d21f99 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:48.185507 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5078ff-59d0-4470-b409-94d96e7a7e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:48.186176 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5078ff-59d0-4470-b409-94d96e7a7e05 admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:48.186512 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5078ff-59d0-4470-b409-94d96e7a7e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:48.186789 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5078ff-59d0-4470-b409-94d96e7a7e05 admin admin] PATH_INFO: `/v3/users` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:48.187489 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5078ff-59d0-4470-b409-94d96e7a7e05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:48.189392 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5078ff-59d0-4470-b409-94d96e7a7e05 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:48.209877 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1441/2880] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:48 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 19:37:48.214750 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0ca14-d60c-4bb1-97b4-d5c13fe138d0 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:48.228748 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0ca14-d60c-4bb1-97b4-d5c13fe138d0 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:48.233571 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26ebdc-4afd-449c-8bd1-6b7c51748029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:48.234239 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26ebdc-4afd-449c-8bd1-6b7c51748029 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:48.234554 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26ebdc-4afd-449c-8bd1-6b7c51748029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:48.234831 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26ebdc-4afd-449c-8bd1-6b7c51748029 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:48.235555 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26ebdc-4afd-449c-8bd1-6b7c51748029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:48.237149 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26ebdc-4afd-449c-8bd1-6b7c51748029 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:48.247981 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1440/2881] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:48.252328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5078ff-59d0-4470-b409-94d96e7a7e05 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:48.262665 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5078ff-59d0-4470-b409-94d96e7a7e05 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:48.267650 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b2eae-7449-4ea9-ab0c-fff805418d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:48.268533 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b2eae-7449-4ea9-ab0c-fff805418d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:48.268820 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b2eae-7449-4ea9-ab0c-fff805418d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:48.269101 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b2eae-7449-4ea9-ab0c-fff805418d53 admin admin] PATH_INFO: `/v3/projects/abacbf0e8b954df6ba467faaa2c96076/users/79ebc8be60d74ed4b211e61a77364094/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:48.286089 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b2eae-7449-4ea9-ab0c-fff805418d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abacbf0e8b954df6ba467faaa2c96076, user_id=79ebc8be60d74ed4b211e61a77364094, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:48.289025 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b2eae-7449-4ea9-ab0c-fff805418d53 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:48.309589 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1442/2882] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:48 2022] PUT /identity/v3/projects/abacbf0e8b954df6ba467faaa2c96076/users/79ebc8be60d74ed4b211e61a77364094/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:48.314516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26ebdc-4afd-449c-8bd1-6b7c51748029 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:48.327117 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26ebdc-4afd-449c-8bd1-6b7c51748029 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:48.386724 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918db70-897a-4457-981d-a8264b70a783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:48.387309 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918db70-897a-4457-981d-a8264b70a783 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:48.387596 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918db70-897a-4457-981d-a8264b70a783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:48.387876 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918db70-897a-4457-981d-a8264b70a783 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:48.388606 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918db70-897a-4457-981d-a8264b70a783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:48.390196 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918db70-897a-4457-981d-a8264b70a783 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:48.400601 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1441/2883] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:48.404967 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b2eae-7449-4ea9-ab0c-fff805418d53 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:48.415582 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b2eae-7449-4ea9-ab0c-fff805418d53 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:48.420328 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d9e43-e8c6-4556-a137-13f228cf0645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:48.421576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d9e43-e8c6-4556-a137-13f228cf0645 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:48.421576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d9e43-e8c6-4556-a137-13f228cf0645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:48.421820 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d9e43-e8c6-4556-a137-13f228cf0645 admin admin] PATH_INFO: `/v3/projects/abacbf0e8b954df6ba467faaa2c96076/users/79ebc8be60d74ed4b211e61a77364094/roles/6322f657162c45ca85f019a408655ff3` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:48.423910 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d9e43-e8c6-4556-a137-13f228cf0645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abacbf0e8b954df6ba467faaa2c96076, user_id=79ebc8be60d74ed4b211e61a77364094, role_id=6322f657162c45ca85f019a408655ff3)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:48.426559 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d9e43-e8c6-4556-a137-13f228cf0645 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:48.433719 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:48.438785 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1443/2884] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:48 2022] PUT /identity/v3/projects/abacbf0e8b954df6ba467faaa2c96076/users/79ebc8be60d74ed4b211e61a77364094/roles/6322f657162c45ca85f019a408655ff3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:48.449930 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eebe1a-97c6-4e43-81e8-57fdfd744e85 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:48.450221 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eebe1a-97c6-4e43-81e8-57fdfd744e85 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:48.450614 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eebe1a-97c6-4e43-81e8-57fdfd744e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:48.480945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-23eebe1a-97c6-4e43-81e8-57fdfd744e85 None None] MFA Rules not processed for user `79ebc8be60d74ed4b211e61a77364094`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:48.482160 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-23eebe1a-97c6-4e43-81e8-57fdfd744e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:48.527584 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:48.553144 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1442/2885] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:48.565224 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d9e43-e8c6-4556-a137-13f228cf0645 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:48.567055 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-e21d9e43-e8c6-4556-a137-13f228cf0645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:48.629457 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d9e43-e8c6-4556-a137-13f228cf0645 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:48.633730 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa11de-9efe-4559-adc0-a32b33309820 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:48.634434 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa11de-9efe-4559-adc0-a32b33309820 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:48.634716 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa11de-9efe-4559-adc0-a32b33309820 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:48.634985 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa11de-9efe-4559-adc0-a32b33309820 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:48.690015 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa11de-9efe-4559-adc0-a32b33309820 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:48.691417 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa11de-9efe-4559-adc0-a32b33309820 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:48.702359 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1444/2886] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:50.197046 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eebe1a-97c6-4e43-81e8-57fdfd744e85 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:50.198489 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-23eebe1a-97c6-4e43-81e8-57fdfd744e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:50.210544 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eebe1a-97c6-4e43-81e8-57fdfd744e85 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:50.214606 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf152a-366a-437b-818b-edf6d836ebc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:50.215242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf152a-366a-437b-818b-edf6d836ebc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:50.215527 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf152a-366a-437b-818b-edf6d836ebc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:50.215805 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf152a-366a-437b-818b-edf6d836ebc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:50.272470 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf152a-366a-437b-818b-edf6d836ebc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:50.274511 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf152a-366a-437b-818b-edf6d836ebc8 service cinder] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:50.284947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1443/2887] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:51.000338 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa11de-9efe-4559-adc0-a32b33309820 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:51.010578 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa11de-9efe-4559-adc0-a32b33309820 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:51.014201 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507d87e-05e4-42fd-b7ab-cb95407cdb0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:51.014865 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507d87e-05e4-42fd-b7ab-cb95407cdb0d service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:51.015145 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507d87e-05e4-42fd-b7ab-cb95407cdb0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:51.015420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507d87e-05e4-42fd-b7ab-cb95407cdb0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:51.026123 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507d87e-05e4-42fd-b7ab-cb95407cdb0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:51.027830 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507d87e-05e4-42fd-b7ab-cb95407cdb0d service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:51.040574 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1445/2888] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:54.982772 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf152a-366a-437b-818b-edf6d836ebc8 service cinder] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:55.044536 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf152a-366a-437b-818b-edf6d836ebc8 service cinder] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:55.049106 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0863737-f8c0-4521-87f1-7fab48810168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:55.049971 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0863737-f8c0-4521-87f1-7fab48810168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:55.050254 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0863737-f8c0-4521-87f1-7fab48810168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:55.050589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0863737-f8c0-4521-87f1-7fab48810168 admin admin] PATH_INFO: `/v3/users/5e49369af5cb4239ae354f5cdfd8e712` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:55.051785 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0863737-f8c0-4521-87f1-7fab48810168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e49369af5cb4239ae354f5cdfd8e712)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:55.053705 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0863737-f8c0-4521-87f1-7fab48810168 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:55.102823 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d0863737-f8c0-4521-87f1-7fab48810168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e49369af5cb4239ae354f5cdfd8e712'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:55.110038 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d0863737-f8c0-4521-87f1-7fab48810168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e49369af5cb4239ae354f5cdfd8e712'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:55.122155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d0863737-f8c0-4521-87f1-7fab48810168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e49369af5cb4239ae354f5cdfd8e712'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:55.129693 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d0863737-f8c0-4521-87f1-7fab48810168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e49369af5cb4239ae354f5cdfd8e712'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:55.130379 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-d0863737-f8c0-4521-87f1-7fab48810168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e49369af5cb4239ae354f5cdfd8e712'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:55.132591 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:55.138155 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1444/2889] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:54 2022] DELETE /identity/v3/users/5e49369af5cb4239ae354f5cdfd8e712 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:55.142630 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e127e-1b88-4efb-8fef-e24e472ef51c None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:55.143122 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e127e-1b88-4efb-8fef-e24e472ef51c None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:55.143248 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e127e-1b88-4efb-8fef-e24e472ef51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:55.160208 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-306e127e-1b88-4efb-8fef-e24e472ef51c None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:55.161404 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-306e127e-1b88-4efb-8fef-e24e472ef51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:55.219778 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1446/2890] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:55.230444 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0863737-f8c0-4521-87f1-7fab48810168 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:55.231924 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d0863737-f8c0-4521-87f1-7fab48810168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:55.289437 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0863737-f8c0-4521-87f1-7fab48810168 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:55.293085 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8042b2e-4234-4ca1-b28c-d3421c464a2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:55.293714 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8042b2e-4234-4ca1-b28c-d3421c464a2b service neutron] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:55.294016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8042b2e-4234-4ca1-b28c-d3421c464a2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:55.294339 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8042b2e-4234-4ca1-b28c-d3421c464a2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:55.303292 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8042b2e-4234-4ca1-b28c-d3421c464a2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:55.304725 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8042b2e-4234-4ca1-b28c-d3421c464a2b service neutron] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:55.314241 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1445/2891] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:55.587120 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e127e-1b88-4efb-8fef-e24e472ef51c None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:55.592480 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-306e127e-1b88-4efb-8fef-e24e472ef51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:55.610106 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e127e-1b88-4efb-8fef-e24e472ef51c None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:55.615119 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099210b3-4a18-4976-80fe-46ccd630f6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:55.616022 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099210b3-4a18-4976-80fe-46ccd630f6f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:55.616436 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099210b3-4a18-4976-80fe-46ccd630f6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:55.616637 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099210b3-4a18-4976-80fe-46ccd630f6f2 admin admin] PATH_INFO: `/v3/projects/1b94c0e8b21e453dba5bc3813a5de171` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:55.618287 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099210b3-4a18-4976-80fe-46ccd630f6f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b94c0e8b21e453dba5bc3813a5de171)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:55.620289 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099210b3-4a18-4976-80fe-46ccd630f6f2 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:55.660112 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:55.671143 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-099210b3-4a18-4976-80fe-46ccd630f6f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b94c0e8b21e453dba5bc3813a5de171', 'request_id': 'req-099210b3-4a18-4976-80fe-46ccd630f6f2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:55.677605 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-099210b3-4a18-4976-80fe-46ccd630f6f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b94c0e8b21e453dba5bc3813a5de171', 'request_id': 'req-099210b3-4a18-4976-80fe-46ccd630f6f2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:55.683200 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-099210b3-4a18-4976-80fe-46ccd630f6f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b94c0e8b21e453dba5bc3813a5de171', 'request_id': 'req-099210b3-4a18-4976-80fe-46ccd630f6f2'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:55.700288 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-099210b3-4a18-4976-80fe-46ccd630f6f2 admin admin] The token cache is being invalidate because project 1b94c0e8b21e453dba5bc3813a5de171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:55.700581 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-099210b3-4a18-4976-80fe-46ccd630f6f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:55.701238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-099210b3-4a18-4976-80fe-46ccd630f6f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:55.703184 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1447/2892] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:55 2022] DELETE /identity/v3/projects/1b94c0e8b21e453dba5bc3813a5de171 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:55.707990 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8042b2e-4234-4ca1-b28c-d3421c464a2b service neutron] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:55.719294 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8042b2e-4234-4ca1-b28c-d3421c464a2b service neutron] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:55.777316 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84a3bc-27ae-42f7-9710-bb4a10006432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:55.778358 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84a3bc-27ae-42f7-9710-bb4a10006432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:55.778591 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84a3bc-27ae-42f7-9710-bb4a10006432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:55.778922 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84a3bc-27ae-42f7-9710-bb4a10006432 admin admin] PATH_INFO: `/v3/users/8e3555675f7f45fba26189976b00cbbc` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:55.780228 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84a3bc-27ae-42f7-9710-bb4a10006432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e3555675f7f45fba26189976b00cbbc)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:55.782516 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84a3bc-27ae-42f7-9710-bb4a10006432 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:55.833680 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-de84a3bc-27ae-42f7-9710-bb4a10006432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e3555675f7f45fba26189976b00cbbc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:55.843180 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-de84a3bc-27ae-42f7-9710-bb4a10006432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e3555675f7f45fba26189976b00cbbc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:55.854996 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-de84a3bc-27ae-42f7-9710-bb4a10006432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e3555675f7f45fba26189976b00cbbc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:55.862593 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-de84a3bc-27ae-42f7-9710-bb4a10006432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e3555675f7f45fba26189976b00cbbc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:55.863222 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-de84a3bc-27ae-42f7-9710-bb4a10006432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e3555675f7f45fba26189976b00cbbc'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:55.869230 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1446/2893] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:55 2022] DELETE /identity/v3/users/8e3555675f7f45fba26189976b00cbbc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:56.145320 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099210b3-4a18-4976-80fe-46ccd630f6f2 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:56.146837 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-099210b3-4a18-4976-80fe-46ccd630f6f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:56.160397 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099210b3-4a18-4976-80fe-46ccd630f6f2 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:56.218553 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239dcdc8-15fa-4dbd-ac9c-b2f8420ce7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:56.219488 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dcdc8-15fa-4dbd-ac9c-b2f8420ce7b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:56.219772 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dcdc8-15fa-4dbd-ac9c-b2f8420ce7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:56.220052 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dcdc8-15fa-4dbd-ac9c-b2f8420ce7b0 admin admin] PATH_INFO: `/v3/projects/78b01bcc96ae46df9c9919f0f2c73473` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:56.221250 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239dcdc8-15fa-4dbd-ac9c-b2f8420ce7b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78b01bcc96ae46df9c9919f0f2c73473)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:56.223236 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239dcdc8-15fa-4dbd-ac9c-b2f8420ce7b0 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:56.268625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-239dcdc8-15fa-4dbd-ac9c-b2f8420ce7b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78b01bcc96ae46df9c9919f0f2c73473', 'request_id': 'req-239dcdc8-15fa-4dbd-ac9c-b2f8420ce7b0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:56.274710 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-239dcdc8-15fa-4dbd-ac9c-b2f8420ce7b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78b01bcc96ae46df9c9919f0f2c73473', 'request_id': 'req-239dcdc8-15fa-4dbd-ac9c-b2f8420ce7b0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:56.280931 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-239dcdc8-15fa-4dbd-ac9c-b2f8420ce7b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78b01bcc96ae46df9c9919f0f2c73473', 'request_id': 'req-239dcdc8-15fa-4dbd-ac9c-b2f8420ce7b0'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:56.293919 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-239dcdc8-15fa-4dbd-ac9c-b2f8420ce7b0 admin admin] The token cache is being invalidate because project 78b01bcc96ae46df9c9919f0f2c73473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:56.294201 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-239dcdc8-15fa-4dbd-ac9c-b2f8420ce7b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:56.294838 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-239dcdc8-15fa-4dbd-ac9c-b2f8420ce7b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:56.296355 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1448/2894] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:56 2022] DELETE /identity/v3/projects/78b01bcc96ae46df9c9919f0f2c73473 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:56.300413 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84a3bc-27ae-42f7-9710-bb4a10006432 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:56.301810 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-de84a3bc-27ae-42f7-9710-bb4a10006432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:56.316202 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84a3bc-27ae-42f7-9710-bb4a10006432 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:56.333947 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:56.375610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11aeab5-076a-4e81-9ac5-f25b203810f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:56.376485 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aeab5-076a-4e81-9ac5-f25b203810f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:56.376752 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aeab5-076a-4e81-9ac5-f25b203810f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:56.377023 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11aeab5-076a-4e81-9ac5-f25b203810f5 admin admin] PATH_INFO: `/v3/users/79ebc8be60d74ed4b211e61a77364094` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:56.378193 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11aeab5-076a-4e81-9ac5-f25b203810f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ebc8be60d74ed4b211e61a77364094)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:56.380112 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11aeab5-076a-4e81-9ac5-f25b203810f5 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:56.426977 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c11aeab5-076a-4e81-9ac5-f25b203810f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ebc8be60d74ed4b211e61a77364094'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:56.434520 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c11aeab5-076a-4e81-9ac5-f25b203810f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ebc8be60d74ed4b211e61a77364094'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:56.446173 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c11aeab5-076a-4e81-9ac5-f25b203810f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ebc8be60d74ed4b211e61a77364094'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:56.453514 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c11aeab5-076a-4e81-9ac5-f25b203810f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ebc8be60d74ed4b211e61a77364094'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:56.454128 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-c11aeab5-076a-4e81-9ac5-f25b203810f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ebc8be60d74ed4b211e61a77364094'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:56.460113 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1447/2895] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:37:56 2022] DELETE /identity/v3/users/79ebc8be60d74ed4b211e61a77364094 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:56.732359 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239dcdc8-15fa-4dbd-ac9c-b2f8420ce7b0 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:56.733855 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-239dcdc8-15fa-4dbd-ac9c-b2f8420ce7b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:56.747002 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239dcdc8-15fa-4dbd-ac9c-b2f8420ce7b0 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:56.799570 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:56.808309 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac6523-da26-47cb-ba37-d19922557158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:56.809735 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac6523-da26-47cb-ba37-d19922557158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:56.810051 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac6523-da26-47cb-ba37-d19922557158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:56.810362 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac6523-da26-47cb-ba37-d19922557158 admin admin] PATH_INFO: `/v3/projects/abacbf0e8b954df6ba467faaa2c96076` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:56.811873 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac6523-da26-47cb-ba37-d19922557158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abacbf0e8b954df6ba467faaa2c96076)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:56.814003 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac6523-da26-47cb-ba37-d19922557158 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:56.861023 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-62ac6523-da26-47cb-ba37-d19922557158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abacbf0e8b954df6ba467faaa2c96076', 'request_id': 'req-62ac6523-da26-47cb-ba37-d19922557158'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:56.868321 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-62ac6523-da26-47cb-ba37-d19922557158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abacbf0e8b954df6ba467faaa2c96076', 'request_id': 'req-62ac6523-da26-47cb-ba37-d19922557158'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:56.873903 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-62ac6523-da26-47cb-ba37-d19922557158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abacbf0e8b954df6ba467faaa2c96076', 'request_id': 'req-62ac6523-da26-47cb-ba37-d19922557158'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:56.888011 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-62ac6523-da26-47cb-ba37-d19922557158 admin admin] The token cache is being invalidate because project abacbf0e8b954df6ba467faaa2c96076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80233) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:37:56.888305 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-62ac6523-da26-47cb-ba37-d19922557158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:56.888995 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-62ac6523-da26-47cb-ba37-d19922557158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:37:56.890619 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1449/2896] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:37:56 2022] DELETE /identity/v3/projects/abacbf0e8b954df6ba467faaa2c96076 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:56.895682 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db808ee6-52c5-488d-a621-1670a4077eba None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:56.895973 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db808ee6-52c5-488d-a621-1670a4077eba None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:56.896281 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db808ee6-52c5-488d-a621-1670a4077eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:56.915911 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-db808ee6-52c5-488d-a621-1670a4077eba None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:56.917116 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-db808ee6-52c5-488d-a621-1670a4077eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:56.975503 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1448/2897] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:56.983973 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b3f2e-8612-431f-92d2-61a1bf5954b6 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:56.984266 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b3f2e-8612-431f-92d2-61a1bf5954b6 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:56.984573 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b3f2e-8612-431f-92d2-61a1bf5954b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:57.002428 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-4b2b3f2e-8612-431f-92d2-61a1bf5954b6 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:57.003625 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-4b2b3f2e-8612-431f-92d2-61a1bf5954b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:57.011551 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1450/2898] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:57.015784 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db808ee6-52c5-488d-a621-1670a4077eba None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:57.026021 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db808ee6-52c5-488d-a621-1670a4077eba None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:57.031095 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939bdd0b-af20-4078-8e39-b9dfeb909685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:57.031745 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bdd0b-af20-4078-8e39-b9dfeb909685 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:57.032028 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bdd0b-af20-4078-8e39-b9dfeb909685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:57.032302 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939bdd0b-af20-4078-8e39-b9dfeb909685 admin admin] PATH_INFO: `/v3/domains` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:57.033056 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939bdd0b-af20-4078-8e39-b9dfeb909685 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80234) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 19:37:57.033358 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939bdd0b-af20-4078-8e39-b9dfeb909685 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:57.035016 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939bdd0b-af20-4078-8e39-b9dfeb909685 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:57.047264 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1449/2899] 10.222.0.18 () {58 vars in 1152 bytes} [Wed Jul 20 19:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 19:37:57.051491 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b3f2e-8612-431f-92d2-61a1bf5954b6 None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:57.060673 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b3f2e-8612-431f-92d2-61a1bf5954b6 None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:57.065331 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6cf51-e594-44c7-9508-e50ab3a9797c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:57.065971 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6cf51-e594-44c7-9508-e50ab3a9797c admin admin] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:57.066254 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6cf51-e594-44c7-9508-e50ab3a9797c admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:57.066563 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6cf51-e594-44c7-9508-e50ab3a9797c admin admin] PATH_INFO: `/v3/projects` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:57.067256 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6cf51-e594-44c7-9508-e50ab3a9797c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:57.069141 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6cf51-e594-44c7-9508-e50ab3a9797c admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:57.097148 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1451/2900] 10.222.0.18 () {60 vars in 1152 bytes} [Wed Jul 20 19:37:57 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:57.101828 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939bdd0b-af20-4078-8e39-b9dfeb909685 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:57.111950 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939bdd0b-af20-4078-8e39-b9dfeb909685 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:57.138094 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:57.188977 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbdeb1-ea47-4607-a38a-537c2cf69d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:57.189657 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbdeb1-ea47-4607-a38a-537c2cf69d18 admin admin] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:57.189945 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbdeb1-ea47-4607-a38a-537c2cf69d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:57.190258 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbdeb1-ea47-4607-a38a-537c2cf69d18 admin admin] PATH_INFO: `/v3/users` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:57.191017 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbdeb1-ea47-4607-a38a-537c2cf69d18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:57.193086 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbdeb1-ea47-4607-a38a-537c2cf69d18 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:57.212839 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1450/2901] 10.222.0.18 () {60 vars in 1143 bytes} [Wed Jul 20 19:37:57 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 19:37:57.216950 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6cf51-e594-44c7-9508-e50ab3a9797c admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:57.227751 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6cf51-e594-44c7-9508-e50ab3a9797c admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:57.232302 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bd208-3de7-4ce0-b75e-9a4c18524b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:57.232947 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bd208-3de7-4ce0-b75e-9a4c18524b64 admin admin] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:57.233226 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bd208-3de7-4ce0-b75e-9a4c18524b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:57.233497 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bd208-3de7-4ce0-b75e-9a4c18524b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:57.234207 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67bd208-3de7-4ce0-b75e-9a4c18524b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:57.235820 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67bd208-3de7-4ce0-b75e-9a4c18524b64 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:57.246686 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1452/2902] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:57.250545 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbdeb1-ea47-4607-a38a-537c2cf69d18 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:57.260589 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbdeb1-ea47-4607-a38a-537c2cf69d18 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:57.265320 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75889e57-d805-4782-9fcf-e4c4da6462c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:57.265969 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75889e57-d805-4782-9fcf-e4c4da6462c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:57.266255 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75889e57-d805-4782-9fcf-e4c4da6462c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:57.266564 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75889e57-d805-4782-9fcf-e4c4da6462c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:57.267292 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75889e57-d805-4782-9fcf-e4c4da6462c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:57.268881 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75889e57-d805-4782-9fcf-e4c4da6462c6 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:57.282397 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1451/2903] 10.222.0.18 () {58 vars in 1121 bytes} [Wed Jul 20 19:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 19:37:57.283893 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bd208-3de7-4ce0-b75e-9a4c18524b64 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:57.294571 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bd208-3de7-4ce0-b75e-9a4c18524b64 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:57.299086 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a4176-c021-44ec-b2da-28304301fce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:57.299961 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a4176-c021-44ec-b2da-28304301fce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:57.300237 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a4176-c021-44ec-b2da-28304301fce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:57.300507 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a4176-c021-44ec-b2da-28304301fce5 admin admin] PATH_INFO: `/v3/projects/9840d96dd9cd4e318e91c21e19bcaed5/users/cebdc0414c2a4a38b3ff092dff89baf1/roles/8b31123e2813440db5a70f87fa5bd932` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:57.315295 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a4176-c021-44ec-b2da-28304301fce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9840d96dd9cd4e318e91c21e19bcaed5, user_id=cebdc0414c2a4a38b3ff092dff89baf1, role_id=8b31123e2813440db5a70f87fa5bd932)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:57.317891 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a4176-c021-44ec-b2da-28304301fce5 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:57.330547 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1453/2904] 10.222.0.18 () {60 vars in 1482 bytes} [Wed Jul 20 19:37:57 2022] PUT /identity/v3/projects/9840d96dd9cd4e318e91c21e19bcaed5/users/cebdc0414c2a4a38b3ff092dff89baf1/roles/8b31123e2813440db5a70f87fa5bd932 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:37:57.341610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc6f43-2c25-420a-a5b7-039f8264f97b None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:57.342120 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc6f43-2c25-420a-a5b7-039f8264f97b None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:57.342242 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc6f43-2c25-420a-a5b7-039f8264f97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:57.368506 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-0efc6f43-2c25-420a-a5b7-039f8264f97b None None] MFA Rules not processed for user `cebdc0414c2a4a38b3ff092dff89baf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:57.369639 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-0efc6f43-2c25-420a-a5b7-039f8264f97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:57.434970 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1452/2905] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:57.446917 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a4176-c021-44ec-b2da-28304301fce5 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:57.449167 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-fd8a4176-c021-44ec-b2da-28304301fce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:57.503856 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a4176-c021-44ec-b2da-28304301fce5 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:57.508051 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa85e03-8225-40e8-8c90-559446871c72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd4ce33a2a1248c6a3199265f40e86f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:57.508688 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa85e03-8225-40e8-8c90-559446871c72 service cinder] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:57.508972 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa85e03-8225-40e8-8c90-559446871c72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:57.509245 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa85e03-8225-40e8-8c90-559446871c72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:57.517432 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa85e03-8225-40e8-8c90-559446871c72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:57.518887 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa85e03-8225-40e8-8c90-559446871c72 service cinder] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:57.527700 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1454/2906] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:37:58.870662 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f1e0b-d449-45b0-bbc0-b45b7b0c2049 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:58.871175 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f1e0b-d449-45b0-bbc0-b45b7b0c2049 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:58.871292 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f1e0b-d449-45b0-bbc0-b45b7b0c2049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:58.888487 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-123f1e0b-d449-45b0-bbc0-b45b7b0c2049 None None] MFA Rules not processed for user `cebdc0414c2a4a38b3ff092dff89baf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:37:58.889679 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-123f1e0b-d449-45b0-bbc0-b45b7b0c2049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:58.896610 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1453/2907] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:37:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:37:59.375096 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa85e03-8225-40e8-8c90-559446871c72 service cinder] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:37:59.376666 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8aa85e03-8225-40e8-8c90-559446871c72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:59.406672 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:37:59.452691 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa85e03-8225-40e8-8c90-559446871c72 service cinder] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:37:59.457640 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad1670-2904-403a-ae29-f7b193ff1173 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd310799ac43e42bc9c7810e1296ddb9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:37:59.458290 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad1670-2904-403a-ae29-f7b193ff1173 service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:37:59.458598 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad1670-2904-403a-ae29-f7b193ff1173 service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:37:59.458882 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad1670-2904-403a-ae29-f7b193ff1173 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:37:59.460693 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-08ad1670-2904-403a-ae29-f7b193ff1173 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:37:59.475156 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad1670-2904-403a-ae29-f7b193ff1173 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:37:59.477283 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad1670-2904-403a-ae29-f7b193ff1173 service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:37:59.487666 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1455/2908] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:37:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:38:07.467103 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f1e0b-d449-45b0-bbc0-b45b7b0c2049 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:07.468626 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-123f1e0b-d449-45b0-bbc0-b45b7b0c2049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:07.552627 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f1e0b-d449-45b0-bbc0-b45b7b0c2049 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:07.558777 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8631c89-7f88-4d20-acfd-f7a71ee49197 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1f0f6bc94de4645a8c82038ff2bd34a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:07.559430 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8631c89-7f88-4d20-acfd-f7a71ee49197 service nova] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:07.559717 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8631c89-7f88-4d20-acfd-f7a71ee49197 service nova] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:07.560022 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8631c89-7f88-4d20-acfd-f7a71ee49197 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:07.561865 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d8631c89-7f88-4d20-acfd-f7a71ee49197 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:07.575116 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8631c89-7f88-4d20-acfd-f7a71ee49197 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:07.576693 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8631c89-7f88-4d20-acfd-f7a71ee49197 service nova] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:07.589345 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1454/2909] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:38:09.483200 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=21 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:13.745048 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77504d75-4aa9-4d52-9c60-b650087662c5 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:13.745641 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77504d75-4aa9-4d52-9c60-b650087662c5 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:13.745641 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77504d75-4aa9-4d52-9c60-b650087662c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:13.763463 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-77504d75-4aa9-4d52-9c60-b650087662c5 None None] MFA Rules not processed for user `e78792e617d84a7cbb384ed764c391fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:13.764661 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-77504d75-4aa9-4d52-9c60-b650087662c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:13.819800 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1456/2910] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 20 19:38:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:13.831607 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8631c89-7f88-4d20-acfd-f7a71ee49197 service nova] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:13.833050 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-d8631c89-7f88-4d20-acfd-f7a71ee49197 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:13.852112 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:13.904436 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8631c89-7f88-4d20-acfd-f7a71ee49197 service nova] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:13.909425 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75959293-1aed-4929-8d43-e35cc87cec54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebd7c59f0014a3886fa75fb35a40e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:13.910062 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75959293-1aed-4929-8d43-e35cc87cec54 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:13.910373 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75959293-1aed-4929-8d43-e35cc87cec54 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:13.910656 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75959293-1aed-4929-8d43-e35cc87cec54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:13.919584 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75959293-1aed-4929-8d43-e35cc87cec54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:13.921142 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75959293-1aed-4929-8d43-e35cc87cec54 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:13.929171 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1455/2911] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 20 19:38:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:38:14.442732 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b9dd6-1a48-498a-ba5f-c8226739a6ce None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:14.443086 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b9dd6-1a48-498a-ba5f-c8226739a6ce None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:14.443369 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b9dd6-1a48-498a-ba5f-c8226739a6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:14.461420 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-2e3b9dd6-1a48-498a-ba5f-c8226739a6ce None None] MFA Rules not processed for user `e78792e617d84a7cbb384ed764c391fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:14.462642 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-2e3b9dd6-1a48-498a-ba5f-c8226739a6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:14.469676 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1457/2912] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jul 20 19:38:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:14.484730 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75959293-1aed-4929-8d43-e35cc87cec54 service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:14.498954 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75959293-1aed-4929-8d43-e35cc87cec54 service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:14.504398 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ebb99-e8ad-413b-be9a-975e3605c480 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebd7c59f0014a3886fa75fb35a40e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:14.505075 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ebb99-e8ad-413b-be9a-975e3605c480 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:14.505390 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ebb99-e8ad-413b-be9a-975e3605c480 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:14.505688 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ebb99-e8ad-413b-be9a-975e3605c480 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:14.514944 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ebb99-e8ad-413b-be9a-975e3605c480 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:14.516660 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ebb99-e8ad-413b-be9a-975e3605c480 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:14.526185 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1456/2913] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 20 19:38:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 19:38:14.716480 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ef063-4f1b-46a5-9f4a-063866b67767 None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:14.716798 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ef063-4f1b-46a5-9f4a-063866b67767 None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:14.717081 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ef063-4f1b-46a5-9f4a-063866b67767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:14.734757 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-8a8ef063-4f1b-46a5-9f4a-063866b67767 None None] MFA Rules not processed for user `e78792e617d84a7cbb384ed764c391fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:14.736000 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-8a8ef063-4f1b-46a5-9f4a-063866b67767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:14.743431 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1458/2914] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Jul 20 19:38:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:14.755910 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ebb99-e8ad-413b-be9a-975e3605c480 service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:14.767061 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ebb99-e8ad-413b-be9a-975e3605c480 service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:14.771997 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043569f-baef-43ec-889d-1c8f68e7030c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebd7c59f0014a3886fa75fb35a40e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:14.773253 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043569f-baef-43ec-889d-1c8f68e7030c service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:14.773537 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043569f-baef-43ec-889d-1c8f68e7030c service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:14.773816 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043569f-baef-43ec-889d-1c8f68e7030c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:14.781870 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043569f-baef-43ec-889d-1c8f68e7030c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:14.783473 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043569f-baef-43ec-889d-1c8f68e7030c service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:14.791815 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1457/2915] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 20 19:38:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:38:15.109014 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd1e73-4730-4cb5-a64f-74b8ae79993b None None] REQUEST_METHOD: `POST` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:15.109496 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd1e73-4730-4cb5-a64f-74b8ae79993b None None] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:15.109614 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd1e73-4730-4cb5-a64f-74b8ae79993b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:15.127422 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.auth.core [None req-68cd1e73-4730-4cb5-a64f-74b8ae79993b None None] MFA Rules not processed for user `e78792e617d84a7cbb384ed764c391fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80233) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:15.128622 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-68cd1e73-4730-4cb5-a64f-74b8ae79993b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:15.136360 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1459/2916] 10.222.0.18 () {58 vars in 967 bytes} [Wed Jul 20 19:38:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:15.148301 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043569f-baef-43ec-889d-1c8f68e7030c service swift] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:15.159524 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043569f-baef-43ec-889d-1c8f68e7030c service swift] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:15.165007 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62293861-516c-4584-98cc-3d3100b69d54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ebd7c59f0014a3886fa75fb35a40e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:15.165576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62293861-516c-4584-98cc-3d3100b69d54 service swift] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:15.165863 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62293861-516c-4584-98cc-3d3100b69d54 service swift] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:15.166142 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62293861-516c-4584-98cc-3d3100b69d54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:15.174509 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62293861-516c-4584-98cc-3d3100b69d54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:15.176070 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62293861-516c-4584-98cc-3d3100b69d54 service swift] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:15.184606 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1458/2917] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Jul 20 19:38:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 19:38:17.249036 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd1e73-4730-4cb5-a64f-74b8ae79993b None None] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:17.312229 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd1e73-4730-4cb5-a64f-74b8ae79993b None None] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:17.316600 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee60c4-af6c-474b-a924-58b8dee65111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:17.317460 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee60c4-af6c-474b-a924-58b8dee65111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:17.317740 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee60c4-af6c-474b-a924-58b8dee65111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:17.318015 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee60c4-af6c-474b-a924-58b8dee65111 admin admin] PATH_INFO: `/v3/users/cebdc0414c2a4a38b3ff092dff89baf1` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:17.319238 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee60c4-af6c-474b-a924-58b8dee65111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cebdc0414c2a4a38b3ff092dff89baf1)` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:17.321143 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee60c4-af6c-474b-a924-58b8dee65111 admin admin] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:17.371576 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f8ee60c4-af6c-474b-a924-58b8dee65111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cebdc0414c2a4a38b3ff092dff89baf1'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:17.378413 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f8ee60c4-af6c-474b-a924-58b8dee65111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cebdc0414c2a4a38b3ff092dff89baf1'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:17.385791 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f8ee60c4-af6c-474b-a924-58b8dee65111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cebdc0414c2a4a38b3ff092dff89baf1'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:17.386434 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f8ee60c4-af6c-474b-a924-58b8dee65111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cebdc0414c2a4a38b3ff092dff89baf1'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:17.387050 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.notifications [None req-f8ee60c4-af6c-474b-a924-58b8dee65111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cebdc0414c2a4a38b3ff092dff89baf1'} {{(pid=80233) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:17.404174 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1460/2918] 10.222.0.18 () {58 vars in 1223 bytes} [Wed Jul 20 19:38:17 2022] DELETE /identity/v3/users/cebdc0414c2a4a38b3ff092dff89baf1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:17.408658 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc9e80-6df3-490b-8d66-c4480d4c5fe0 None None] REQUEST_METHOD: `POST` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:17.409138 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc9e80-6df3-490b-8d66-c4480d4c5fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:17.409256 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc9e80-6df3-490b-8d66-c4480d4c5fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:17.427271 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.auth.core [None req-8ddc9e80-6df3-490b-8d66-c4480d4c5fe0 None None] MFA Rules not processed for user `b8c2d1f725864ea29520d2932bc19d10`. Rule list: `[]` (Enabled: `True`). {{(pid=80234) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 19:38:17.428490 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8ddc9e80-6df3-490b-8d66-c4480d4c5fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:17.486150 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1459/2919] 10.222.0.18 () {58 vars in 957 bytes} [Wed Jul 20 19:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 19:38:17.496687 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee60c4-af6c-474b-a924-58b8dee65111 admin admin] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:17.498125 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-f8ee60c4-af6c-474b-a924-58b8dee65111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:17.504904 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:17.562860 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee60c4-af6c-474b-a924-58b8dee65111 admin admin] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:17.566946 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed6f9c-f45d-4596-9760-53a516ffde47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c7b88e083d04718bf19d982724babd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:17.567772 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed6f9c-f45d-4596-9760-53a516ffde47 service neutron] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:17.568217 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed6f9c-f45d-4596-9760-53a516ffde47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:17.568682 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed6f9c-f45d-4596-9760-53a516ffde47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:17.580973 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed6f9c-f45d-4596-9760-53a516ffde47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:17.582705 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed6f9c-f45d-4596-9760-53a516ffde47 service neutron] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:17.594200 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1461/2920] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:38:17.777588 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc9e80-6df3-490b-8d66-c4480d4c5fe0 None None] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:17.779119 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-8ddc9e80-6df3-490b-8d66-c4480d4c5fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:17.794781 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc9e80-6df3-490b-8d66-c4480d4c5fe0 None None] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:17.799696 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b324bfb-05a8-42ae-99f4-18cab1fee730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c2d1f725864ea29520d2932bc19d10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b67a2f849d994ba1b870dbba687449fc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:17.800575 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b324bfb-05a8-42ae-99f4-18cab1fee730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:17.800858 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b324bfb-05a8-42ae-99f4-18cab1fee730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:17.801146 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b324bfb-05a8-42ae-99f4-18cab1fee730 admin admin] PATH_INFO: `/v3/projects/9840d96dd9cd4e318e91c21e19bcaed5` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:17.802389 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b324bfb-05a8-42ae-99f4-18cab1fee730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9840d96dd9cd4e318e91c21e19bcaed5)` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:17.804576 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b324bfb-05a8-42ae-99f4-18cab1fee730 admin admin] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:17.852123 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3b324bfb-05a8-42ae-99f4-18cab1fee730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9840d96dd9cd4e318e91c21e19bcaed5', 'request_id': 'req-3b324bfb-05a8-42ae-99f4-18cab1fee730'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:17.858428 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3b324bfb-05a8-42ae-99f4-18cab1fee730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9840d96dd9cd4e318e91c21e19bcaed5', 'request_id': 'req-3b324bfb-05a8-42ae-99f4-18cab1fee730'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:17.866360 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3b324bfb-05a8-42ae-99f4-18cab1fee730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9840d96dd9cd4e318e91c21e19bcaed5', 'request_id': 'req-3b324bfb-05a8-42ae-99f4-18cab1fee730'} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:17.867564 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:17.878763 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3b324bfb-05a8-42ae-99f4-18cab1fee730 admin admin] The token cache is being invalidate because project 9840d96dd9cd4e318e91c21e19bcaed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80234) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 19:38:17.879051 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3b324bfb-05a8-42ae-99f4-18cab1fee730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:17.879685 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.notifications [None req-3b324bfb-05a8-42ae-99f4-18cab1fee730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80234) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 19:38:17.881239 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1460/2921] 10.222.0.18 () {58 vars in 1232 bytes} [Wed Jul 20 19:38:17 2022] DELETE /identity/v3/projects/9840d96dd9cd4e318e91c21e19bcaed5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 19:38:27.589623 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=24 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:27.878125 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG dbcounter [-] [80234] Writing DB stats keystone:DELETE=2,keystone:SELECT=3 {{(pid=80234) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:38:34.271868 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed6f9c-f45d-4596-9760-53a516ffde47 service neutron] Authenticating user token {{(pid=80233) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:38:34.273910 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-5eed6f9c-f45d-4596-9760-53a516ffde47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:34.343331 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed6f9c-f45d-4596-9760-53a516ffde47 service neutron] Validating token access rules against request {{(pid=80233) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:38:34.402994 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13aa7a-dcf6-48b8-98c7-0fafb8fd9207 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd310799ac43e42bc9c7810e1296ddb9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80233) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:38:34.403677 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13aa7a-dcf6-48b8-98c7-0fafb8fd9207 service placement] REQUEST_METHOD: `GET` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:38:34.403965 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13aa7a-dcf6-48b8-98c7-0fafb8fd9207 service placement] SCRIPT_NAME: `/identity` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:38:34.404271 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13aa7a-dcf6-48b8-98c7-0fafb8fd9207 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80233) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:38:34.406062 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.fernet_utils [None req-fe13aa7a-dcf6-48b8-98c7-0fafb8fd9207 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80233) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:38:34.417529 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13aa7a-dcf6-48b8-98c7-0fafb8fd9207 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:38:34.419169 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13aa7a-dcf6-48b8-98c7-0fafb8fd9207 service placement] RBAC: Authorization granted {{(pid=80233) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:38:34.429258 dv-cinder-819149-14-smb devstack@keystone.service[80233]: [pid: 80233|app: 0|req: 1462/2922] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:38:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 19:38:44.424872 dv-cinder-819149-14-smb devstack@keystone.service[80233]: DEBUG dbcounter [-] [80233] Writing DB stats keystone:SELECT=58 {{(pid=80233) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 19:43:36.241233 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b324bfb-05a8-42ae-99f4-18cab1fee730 admin admin] Authenticating user token {{(pid=80234) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 19:43:36.242729 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.fernet_utils [None req-3b324bfb-05a8-42ae-99f4-18cab1fee730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80234) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 19:43:36.332822 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b324bfb-05a8-42ae-99f4-18cab1fee730 admin admin] Validating token access rules against request {{(pid=80234) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 19:43:36.338084 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c9a37-47ec-46de-be87-7b039e8fb7a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd310799ac43e42bc9c7810e1296ddb9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '416a38494ed54934ba8ab0d8e18afb35', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80234) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 19:43:36.338767 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c9a37-47ec-46de-be87-7b039e8fb7a5 service placement] REQUEST_METHOD: `GET` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 19:43:36.339055 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c9a37-47ec-46de-be87-7b039e8fb7a5 service placement] SCRIPT_NAME: `/identity` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 19:43:36.340013 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c9a37-47ec-46de-be87-7b039e8fb7a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80234) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 19:43:36.349170 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c9a37-47ec-46de-be87-7b039e8fb7a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 19:43:36.350798 dv-cinder-819149-14-smb devstack@keystone.service[80234]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c9a37-47ec-46de-be87-7b039e8fb7a5 service placement] RBAC: Authorization granted {{(pid=80234) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 19:43:36.360770 dv-cinder-819149-14-smb devstack@keystone.service[80234]: [pid: 80234|app: 0|req: 1461/2923] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Jul 20 19:43:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)